Benchmark

non-incremental/QF_BV/sage/app7/bench_591.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3181827
Compressed Size198652
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3181819
Compressed Size198657
Max. Term Depth12189
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1923 and1
=2568 let12085 extract1405 bvand33168
bvor21894 bvxor1708 bvadd35129 bvmul1
bvsub11395 bvult461 bvule505 bvslt210
bvsle116 bvshl11213 bvashr21294 zero_extend1130

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.46939 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.49324 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.48574 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.48240 —
abziz_portfolio_2012_solvers default unsat ✅ 0.48270 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.48849 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.63158 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.76664 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.67803 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 152.74700 —
CVC3-SMT-COMP-2011 default unsat ✅ 129.06000 —
CVC3-SMT-COMP-2012 default unsat ✅ 134.94700 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.71359 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.26914 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.95439 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.90807 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.19195 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.15613 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.82683 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.71961 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 5.96592 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.29190 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.50352 —
STP2-SMT-COMP-2012 default unsat ✅ 0.47219 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.50484 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.51829 —
Z3-SMT-COMP-2011 default unsat ✅ 0.47719 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.92377 0.92286
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 4.15518 6.74397
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 4.15292 6.74697
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.67324 0.67190
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2401.00000
STP stp-cryptominisat4 default unsat ✅ 0.44754 0.44693
stp-cmsat4-v15 default unsat ✅ 0.45037 0.44893
stp-cmsat4-mt-v15 default unsat ✅ 0.44620 0.44493
stp-minisat-v15 default unsat ✅ 0.44487 0.44393
Yices2 Yices default unsat ✅ 0.18647 0.18497
Z3 z3 4.4.0 default unsat ✅ 0.50552 0.50592
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.79285 1.79380
ABC_glucose glucose unsat ✅ 1.78549 1.78682
Boolector Boolector boolector unsat ✅ 1.04097 1.04151
Boolector preprop boolector unsat ✅ 1.01205 1.01245
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 4.13630 6.73263
MapleSTP MapleSTP default unsat ✅ 0.43697 0.43610
MapleSTP-mt default unsat ✅ 0.43801 0.43819
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.61459 0.61614
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.60755 0.60750
Q3B Q3B default unsat ✅ 0.83200 2.02000
STP stp-cms-exp-2016 default unsat ✅ 0.44555 0.44567
stp-cms-mt-2016 default unsat ✅ 0.45750 0.45772
stp-cms-st-2016 default unsat ✅ 0.45149 0.45109
stp-minisat-st-2016 default unsat ✅ 0.76865 0.76913
Yices2 Yices-2.4.2 default unsat ✅ 0.18369 0.18324
Z3 z3-4.4.1 default unsat ✅ 0.58307 0.58467
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.90847 0.90669
Boolector SMT17 final boolector unsat ✅ 0.83719 0.83564
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.08682 6.56912
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.62495 0.62507
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.20884 1.20760
Q3B Q3B default unsat ✅ 0.80556 1.85243
STP stp_st default unsat ✅ 0.54339 0.54250
stp_mt default unsat ✅ 0.57286 0.57178
Yices2 Yices2-Main default unsat ✅ 0.17353 0.17343
Z3 z3-4.5.0 default unsat ✅ 0.52938 0.52866
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.75373 0.75363
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.77711 3.77734
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.60858 0.60961
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.21294 1.21297
Minkeyrink ST_st unsat ✅ 1.21457 1.21457
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.55652 0.55652
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.56203 0.55456
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.55517 0.55519
Yices2 Yices 2.6.0_default unsat ✅ 0.16620 0.16608
Z3 z3-4.7.1_default unsat ✅ 0.53152 0.53145
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.41624 1.41614
Poolector-wrapped-sq_default unsat ✅ 1.69788 6.33065
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.15427 1.15398
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 3.93577 3.93522
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.85068 0.85085
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.84520 0.84522
Par4 Par4-wrapped-sq_default unsat ✅ 0.17493 0.00604
STP STP-2019-wrapped-sq_default unsat ✅ 0.56672 0.56680
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.55911 0.55925
stp-minisat-wrapped-sq_default unsat ✅ 0.56697 0.56606
stp-mt-wrapped-sq_default unsat ✅ 0.56564 0.56576
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.56025 0.56033
stp-riss-wrapped-sq_default unsat ✅ 0.55590 0.55595
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.17218 0.17214
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.17220 0.17220
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.17200 0.17202
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.17034 0.17031
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.17197 0.17197
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.54134 0.54135
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.17928 1.17922
Boolector Boolector-wrapped-sq_default unsat ✅ 1.41526 1.41529
Poolector-wrapped-sq_default unsat ✅ 1.68929 6.20000
CVC4 CVC4-sq-final_default unsat ✅ 5.17728 5.17647
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.76743 0.76740
MathSAT MathSAT5_default.sh unsat ✅ 0.62286 0.62288
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.70270 0.70273
MinkeyRink Solver 2020.3_default unsat ✅ 0.72748 0.72752
STP STP_default unsat ✅ 0.52700 0.52706
STP ++ Mergsat v1_default unsat ✅ 0.52029 0.52207
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.20815 0.20804
Z3 z3-4.8.8_default unsat ✅ 0.39669 0.39650
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.16992 1.16982
Bitwuzla-wrapped_default unsat ✅ 1.27943 1.27826
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 3.90899 3.90920
MathSAT MathSAT-5.6.8_default unsat ✅ 0.67079 0.67073
STP STP 2022.4_default unsat ✅ 0.58008 0.57988
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.20910 0.20901
Z3++BV z3++bv_0702_default unsat ✅ 0.39572 0.39561
Z3 z3-4.8.17_default unsat ✅ 0.39658 0.39838
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.11141 1.01142
cvc5 cvc5 unsat ✅ 2.00052 1.90033
SMTInterpol SMTInterpol unknown ❌ 1202.72298 1396.38836
STP STP unsat ✅ 35.89297 35.78607
Yices2 Yices2 unsat ✅ 0.35200 0.25208
Z3alpha Z3-alpha unsat ✅ 0.53943 0.43913
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.95848 0.82655
Bitwuzla-MachBV-base unsat ✅ 1.04821 0.93023
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.23309 1.11045
BVDecide bv_decide unknown ❌ 1201.35378 1201.08238
bv_decide-nokernel unknown ❌ 1201.38882 1201.01908
cvc5 cvc5 unsat ✅ 0.88167 0.75922
SMTInterpol SMTInterpol unknown ❌ 1201.90423 2569.90722
Yices2 Yices2 unsat ✅ 0.38075 0.24800
Z3alpha Z3-alpha unsat ✅ 0.94707 0.92620
Z3 Z3-alpha-base unsat ✅ 0.48416 0.36487
Z3-Owl-base unsat ✅ 1.26095 1.13478
z3siri-base unsat ✅ 0.52079 0.39231
Z3-Owl Z3-Owl unsat ✅ 1.04595 0.91761