Benchmark

non-incremental/QF_BV/sage/app7/bench_915.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size2648501
Compressed Size169235
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 2648493
Compressed Size169242
Max. Term Depth10178
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1807 and1
=2424 let10079 extract1323 bvand27356
bvor17972 bvxor1580 bvadd29156 bvmul1
bvsub9438 bvult445 bvule490 bvslt207
bvsle104 bvshl9268 bvashr17509 zero_extend1040

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.39665 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.38513 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.39849 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.39137 —
abziz_portfolio_2012_solvers default unsat ✅ 0.39297 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.38606 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.53275 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.63476 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.56446 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 130.82400 —
CVC3-SMT-COMP-2011 default unsat ✅ 110.64300 —
CVC3-SMT-COMP-2012 default unsat ✅ 115.70300 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.15802 —
CVC4-SMT-EVAL-2013 default unsat ✅ 3.37010 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.80607 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.77636 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.99528 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.97697 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.69472 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.29121 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 4.94254 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.07958 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.41939 —
STP2-SMT-COMP-2012 default unsat ✅ 0.39925 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.42159 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.48323 —
Z3-SMT-COMP-2011 default unsat ✅ 0.38661 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.77271 0.77188
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 3.46917 5.61415
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 3.45591 5.59915
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.54007 0.53892
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.71000
STP stp-cryptominisat4 default unsat ✅ 0.37477 0.37394
stp-cmsat4-v15 default unsat ✅ 0.37384 0.37294
stp-cmsat4-mt-v15 default unsat ✅ 0.37484 0.37394
stp-minisat-v15 default unsat ✅ 0.37484 0.37394
Yices2 Yices default unsat ✅ 0.15386 0.15298
Z3 z3 4.4.0 default unsat ✅ 0.41570 0.41594
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.50438 1.50487
ABC_glucose glucose unsat ✅ 1.54978 1.51868
Boolector Boolector boolector unsat ✅ 0.86918 0.86965
Boolector preprop boolector unsat ✅ 0.84056 0.84103
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 3.43294 5.56313
MapleSTP MapleSTP default unsat ✅ 0.36000 0.36019
MapleSTP-mt default unsat ✅ 0.35958 0.35976
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.48454 0.48587
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.48909 0.48935
Q3B Q3B default unsat ✅ 0.72862 1.61000
STP stp-cms-exp-2016 default unsat ✅ 0.37280 0.37286
stp-cms-mt-2016 default unsat ✅ 0.37099 0.37114
stp-cms-st-2016 default unsat ✅ 0.37112 0.37128
stp-minisat-st-2016 default unsat ✅ 0.37184 0.37200
Yices2 Yices-2.4.2 default unsat ✅ 0.15440 0.15448
Z3 z3-4.4.1 default unsat ✅ 0.45341 0.45502
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.69900 0.69886
Boolector SMT17 final boolector unsat ✅ 0.70373 0.70308
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.34760 5.35099
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.52926 0.52942
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.02029 1.01895
Q3B Q3B default unsat ✅ 0.71758 1.67000
STP stp_st default unsat ✅ 0.45919 0.45836
stp_mt default unsat ✅ 0.45856 0.45759
Yices2 Yices2-Main default unsat ✅ 0.14611 0.14505
Z3 z3-4.5.0 default unsat ✅ 0.47421 0.47415
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.63908 0.63900
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.14015 3.14028
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.48576 0.48684
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.01460 1.01463
Minkeyrink ST_st unsat ✅ 1.01439 1.01440
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.46449 0.46459
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.46435 0.46431
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.46213 0.46210
Yices2 Yices 2.6.0_default unsat ✅ 0.14037 0.14027
Z3 z3-4.7.1_default unsat ✅ 0.46925 0.46916
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.98668 0.98657
MathSAT mathsat-5.6.6_default unsat ✅ 0.57623 0.57235
STP STP 2021.0_default unsat ✅ 0.44699 0.44708
Z3 z3-4.8.11_default unsat ✅ 0.42314 0.42308
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 0.91353 0.81363
cvc5 cvc5 unsat ✅ 0.73139 0.63120
SMTInterpol SMTInterpol unknown ❌ 1202.71971 1659.50817
STP STP unsat ✅ 20.79264 20.68730
Yices2 Yices2 unsat ✅ 0.32828 0.22756
Z3alpha Z3-alpha unsat ✅ 0.51476 0.41529
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.81197 0.68956
Bitwuzla-MachBV-base unsat ✅ 0.95607 0.82938
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.10018 0.97950
BVDecide bv_decide unknown ❌ 1201.39221 1200.96404
bv_decide-nokernel unknown ❌ 1201.37340 1201.05546
cvc5 cvc5 unsat ✅ 0.73111 0.61206
SMTInterpol SMTInterpol unknown ❌ 1201.89529 2982.94377
Yices2 Yices2 unsat ✅ 0.33828 0.21926
Z3alpha Z3-alpha unsat ✅ 0.92121 0.86552
Z3 Z3-alpha-base unsat ✅ 0.48591 0.36127
Z3-Owl-base unsat ✅ 1.27917 1.15816
z3siri-base unsat ✅ 0.51220 0.38620
Z3-Owl Z3-Owl unsat ✅ 1.05219 0.91708