Benchmark

non-incremental/QF_BV/sage/app7/bench_2009.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size985417
Compressed Size82614
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 985409
Compressed Size82622
Max. Term Depth3780
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1417 and1
=1929 let3723 extract1159 bvand8839
bvor5658 bvxor1311 bvadd10226 bvmul1
bvsub3313 bvult418 bvule425 bvslt185
bvsle96 bvshl3165 bvashr5385 zero_extend882

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.14080 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.19150 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.19469 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.18920 —
abziz_portfolio_2012_solvers default unsat ✅ 0.19048 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.19492 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.19056 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.22258 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.18986 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 101.12300 —
CVC3-SMT-COMP-2011 default unsat ✅ 84.59200 —
CVC3-SMT-COMP-2012 default unsat ✅ 88.13320 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.89934 —
CVC4-SMT-EVAL-2013 default unsat ✅ 1.48885 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.29846 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.28110 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.37914 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.36599 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.26956 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 1.53659 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 1.72453 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.39347 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.14829 —
STP2-SMT-COMP-2012 default unsat ✅ 0.15388 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.13875 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.20517 —
Z3-SMT-COMP-2011 default unsat ✅ 0.18547 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.24889 0.24796
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.34862 2.21566
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.34669 2.21866
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.21735 0.21597
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.65000
STP stp-cryptominisat4 default unsat ✅ 0.12911 0.12798
stp-cmsat4-v15 default unsat ✅ 0.12801 0.12698
stp-cmsat4-mt-v15 default unsat ✅ 0.12847 0.12698
stp-minisat-v15 default unsat ✅ 0.12965 0.12898
Yices2 Yices default unsat ✅ 0.06345 0.06199
Z3 z3 4.4.0 default unsat ✅ 0.24149 0.24096
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.57203 0.57298
ABC_glucose glucose unsat ✅ 0.56137 0.56229
Boolector Boolector boolector unsat ✅ 0.28177 0.28217
Boolector preprop boolector unsat ✅ 0.27285 0.27337
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.33128 2.20263
MapleSTP MapleSTP default unsat ✅ 0.12187 0.12189
MapleSTP-mt default unsat ✅ 0.12180 0.12184
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.19395 0.19472
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.16878 0.16882
Q3B Q3B default unsat ✅ 0.37795 0.62029
STP stp-cms-exp-2016 default unsat ✅ 0.12504 0.12507
stp-cms-mt-2016 default unsat ✅ 0.12758 0.12767
stp-cms-st-2016 default unsat ✅ 0.12766 0.12814
stp-minisat-st-2016 default unsat ✅ 0.12687 0.12693
Yices2 Yices-2.4.2 default unsat ✅ 0.06529 0.06525
Z3 z3-4.4.1 default unsat ✅ 0.22698 0.22856
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.23771 0.23612
Boolector SMT17 final boolector unsat ✅ 0.26366 0.26218
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.40581 2.30921
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.22368 0.22055
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.38258 0.38152
Q3B Q3B default unsat ✅ 0.37359 0.84209
STP stp_st default unsat ✅ 0.19003 0.18013
stp_mt default unsat ✅ 0.16307 0.16305
Yices2 Yices2-Main default unsat ✅ 0.06190 0.06039
Z3 z3-4.5.0 default unsat ✅ 0.22142 0.22137
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.20740 0.20733
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.18304 1.18318
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.19133 0.19232
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.38106 0.38087
Minkeyrink ST_st unsat ✅ 0.37935 0.37877
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.15610 0.15614
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.15583 0.15583
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.15725 0.15729
Yices2 Yices 2.6.0_default unsat ✅ 0.05942 0.05938
Z3 z3-4.7.1_default unsat ✅ 0.20488 0.20481
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.31402 0.31398
Boolector Boolector-wrapped-sq_default unsat ✅ 0.37872 0.37854
Poolector-wrapped-sq_default unsat ✅ 0.58038 1.77212
CVC4 CVC4-sq-final_default unsat ✅ 1.55846 1.55843
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.24285 0.24276
MathSAT MathSAT5_default.sh unsat ✅ 0.19858 0.19849
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.25265 0.25257
MinkeyRink Solver 2020.3_default unsat ✅ 0.26157 0.26170
STP STP_default unsat ✅ 0.15323 0.15335
STP ++ Mergsat v1_default unsat ✅ 0.14566 0.14737
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.07139 0.07135
Z3 z3-4.8.8_default unsat ✅ 0.20463 0.20459
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.31167 0.31159
MathSAT mathsat-5.6.6_default unsat ✅ 0.20670 0.20665
STP STP 2021.0_default unsat ✅ 0.16095 0.16109
Z3 z3-4.8.11_default unsat ✅ 0.13206 0.13199
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.48510 0.35657
Bitwuzla-MachBV-base unsat ✅ 0.48004 0.35729
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.55381 0.43287
BVDecide bv_decide unsat ✅ 141.12365 140.98264
bv_decide-nokernel unsat ✅ 119.62458 119.46772
cvc5 cvc5 unsat ✅ 0.51413 0.39542
SMTInterpol SMTInterpol unknown ❌ 1201.85680 3584.63886
Yices2 Yices2 unsat ✅ 0.29116 0.17168
Z3alpha Z3-alpha unsat ✅ 0.45901 0.37504
Z3 Z3-alpha-base unsat ✅ 0.35621 0.23393
Z3-Owl-base unsat ✅ 0.58632 0.46165
z3siri-base unsat ✅ 0.41819 0.29182
Z3-Owl Z3-Owl unsat ✅ 0.86611 0.73581