Benchmark

non-incremental/QF_BV/sage/app7/bench_735.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3072219
Compressed Size190898
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3072211
Compressed Size190905
Max. Term Depth11770
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1866 and1
=2499 let11665 extract1355 bvand32065
bvor21140 bvxor1625 bvadd33942 bvmul1
bvsub11000 bvult447 bvule503 bvslt210
bvsle106 bvshl10821 bvashr20572 zero_extend1074

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.46144 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.47632 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.47976 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.48606 —
abziz_portfolio_2012_solvers default unsat ✅ 0.46988 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.47011 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.61574 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.73833 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.65003 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 152.00600 —
CVC3-SMT-COMP-2011 default unsat ✅ 128.50000 —
CVC3-SMT-COMP-2012 default unsat ✅ 134.41600 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.68818 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.05354 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.92650 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.88968 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.14894 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.12748 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.80587 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.68966 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 5.76321 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.25505 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.48565 —
STP2-SMT-COMP-2012 default unsat ✅ 0.46195 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.48474 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.50442 —
Z3-SMT-COMP-2011 default unsat ✅ 0.46991 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.89298 0.89186
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 4.01484 6.51401
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 4.02689 6.53500
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.65226 0.65190
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.97000
STP stp-cryptominisat4 default unsat ✅ 0.43099 0.42993
stp-cmsat4-v15 default unsat ✅ 0.43176 0.43093
stp-cmsat4-mt-v15 default unsat ✅ 0.43600 0.43493
stp-minisat-v15 default unsat ✅ 0.43110 0.42993
Yices2 Yices default unsat ✅ 0.17925 0.17797
Z3 z3 4.4.0 default unsat ✅ 0.61572 0.61591
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.80448 1.77457
ABC_glucose glucose unsat ✅ 1.72165 1.72239
Boolector Boolector boolector unsat ✅ 1.00208 1.00260
Boolector preprop boolector unsat ✅ 0.98323 0.98399
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 3.95964 6.43510
MapleSTP MapleSTP default unsat ✅ 0.41337 0.41357
MapleSTP-mt default unsat ✅ 0.41245 0.41293
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.58669 0.58782
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.56870 0.56903
Q3B Q3B default unsat ✅ 0.79549 1.84000
STP stp-cms-exp-2016 default unsat ✅ 0.41990 0.42006
stp-cms-mt-2016 default unsat ✅ 0.42862 0.42883
stp-cms-st-2016 default unsat ✅ 0.42622 0.42642
stp-minisat-st-2016 default unsat ✅ 0.42600 0.42624
Yices2 Yices-2.4.2 default unsat ✅ 0.17759 0.17767
Z3 z3-4.4.1 default unsat ✅ 0.61539 0.61704
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.91302 0.89472
Boolector SMT17 final boolector unsat ✅ 0.81817 0.81837
CVC4 CVC4-smtcomp2017-main default unsat ✅ 9.99250 6.97514
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.61195 0.61122
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.96263 1.27117
Q3B Q3B default unsat ✅ 0.89256 1.82000
STP stp_st default unsat ✅ 0.77989 0.61174
stp_mt default unsat ✅ 0.61598 0.60161
Yices2 Yices2-Main default unsat ✅ 0.16723 0.16590
Z3 z3-4.5.0 default unsat ✅ 0.53872 0.53236
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.73306 0.73295
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.62948 3.62944
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.60164 0.59756
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.17852 1.17847
Minkeyrink ST_st unsat ✅ 1.19380 1.19040
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.54213 0.54213
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.54182 0.54185
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.53776 0.53662
Yices2 Yices 2.6.0_default unsat ✅ 0.16042 0.16036
Z3 z3-4.7.1_default unsat ✅ 0.56599 0.56586
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.13467 1.13350
MathSAT mathsat-5.6.6_default unsat ✅ 0.62399 0.62392
STP STP 2021.0_default unsat ✅ 0.52003 0.52016
Z3 z3-4.8.11_default unsat ✅ 0.39881 0.39879
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.01469 0.91482
cvc5 cvc5 unsat ✅ 1.09141 0.99177
SMTInterpol SMTInterpol unknown ❌ 1202.75181 1563.54804
STP STP unsat ✅ 26.77581 26.66607
Yices2 Yices2 unsat ✅ 0.34564 0.24588
Z3alpha Z3-alpha unsat ✅ 0.55079 0.45117