Benchmark

non-incremental/QF_BV/sage/app1/bench_2099.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size74506
Compressed Size10774
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 74498
Compressed Size10798
Max. Term Depth179
Asserts 1
Declared Functions0
Declared Constants285
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite79 not73 and1
=191 let169 extract1 bvand40
bvor171 bvadd367 bvmul5 bvsub240
bvult258 bvule561 bvslt1 bvsle48
bvshl172 bvashr5 zero_extend307

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.87154 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.04982 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.04662 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.05171 —
abziz_portfolio_2012_solvers default unsat ✅ 0.05651 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.04973 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.11741 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.11575 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.11154 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 3.55065 —
CVC3-SMT-COMP-2011 default unsat ✅ 3.19636 —
CVC3-SMT-COMP-2012 default unsat ✅ 3.26760 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.59021 —
CVC4-SMT-EVAL-2013 default unsat ✅ 1.14592 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.35423 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.83414 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.34181 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.34540 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.21896 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 0.26478 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.77754 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.21953 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.03839 —
STP2-SMT-COMP-2012 default unsat ✅ 0.04487 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.08670 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.03906 —
Z3-SMT-COMP-2011 default unsat ✅ 0.04135 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.02243 0.02099
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.04070 2.02669
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.04873 2.04569
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.90817 0.90786
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2401.22000
STP stp-cryptominisat4 default unsat ✅ 0.05075 0.04999
stp-cmsat4-v15 default unsat ✅ 0.04938 0.04799
stp-cmsat4-mt-v15 default unsat ✅ 0.05020 0.04899
stp-minisat-v15 default unsat ✅ 0.04905 0.04799
Yices2 Yices default unsat ✅ 0.04251 0.04099
Z3 z3 4.4.0 default unsat ✅ 0.35470 0.35495
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.89499 0.89498
ABC_glucose glucose unsat ✅ 11.65570 11.64920
Boolector Boolector boolector unsat ✅ 0.02681 0.02677
Boolector preprop boolector unsat ✅ 0.02592 0.02632
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.01445 1.97992
MapleSTP MapleSTP default unsat ✅ 0.03988 0.03985
MapleSTP-mt default unsat ✅ 0.03800 0.03800
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.75852 0.75979
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.05153 0.05137
Q3B Q3B default unsat ✅ 0.43534 1.03986
STP stp-cms-exp-2016 default unsat ✅ 0.03861 0.03860
stp-cms-mt-2016 default unsat ✅ 0.03855 0.03853
stp-cms-st-2016 default unsat ✅ 0.03822 0.03855
stp-minisat-st-2016 default unsat ✅ 0.03782 0.03781
Yices2 Yices-2.4.2 default unsat ✅ 0.04394 0.04393
Z3 z3-4.4.1 default unsat ✅ 0.36968 0.36985
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.02551 0.02546
Boolector SMT17 final boolector unsat ✅ 0.02604 0.02483
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.03324 2.01406
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.85030 0.83413
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.04148 0.04106
Q3B Q3B default unsat ✅ 0.45235 1.08389
STP stp_st default unsat ✅ 0.05502 0.05430
stp_mt default unsat ✅ 0.05570 0.05463
Yices2 Yices2-Main default unsat ✅ 0.03938 0.03855
Z3 z3-4.5.0 default unsat ✅ 0.37419 0.37269
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.01831 0.01826
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.11324 2.11368
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.67272 0.67359
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.04410 0.04420
Minkeyrink ST_st unsat ✅ 0.04350 0.04351
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.07287 0.07296
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.07281 0.07290
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.07264 0.07271
Yices2 Yices 2.6.0_default unsat ✅ 0.04119 0.04109
Z3 z3-4.7.1_default unsat ✅ 0.39359 0.39355
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.04309 0.04311
Poolector-wrapped-sq_default unsat ✅ 0.17634 0.26190
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.03582 0.03584
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.88117 0.88145
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.05364 0.05377
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.05223 0.05231
Par4 Par4-wrapped-sq_default unsat ✅ 0.02897 0.00614
STP STP-2019-wrapped-sq_default unsat ✅ 0.08805 0.08817
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.08739 0.08755
stp-minisat-wrapped-sq_default unsat ✅ 0.08827 0.08842
stp-mt-wrapped-sq_default unsat ✅ 0.08561 0.08568
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.08778 0.08796
stp-riss-wrapped-sq_default unsat ✅ 0.08945 0.08956
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.04092 0.04091
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.04041 0.04041
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.04062 0.04061
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.09669 0.09667
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.04024 0.04022
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.35429 0.35425
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.25005 0.15041
cvc5 cvc5 unsat ✅ 1.15683 1.05725
SMTInterpol SMTInterpol unsat ✅ 312.99615 347.11038
STP STP unsat ✅ 0.27714 0.17753
Yices2 Yices2 unsat ✅ 0.23763 0.13845
Z3alpha Z3-alpha unsat ✅ 0.29511 0.19527
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.31124 0.18255
Bitwuzla-MachBV-base unsat ✅ 0.31597 0.18100
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.46723 0.34546
BVDecide bv_decide unsat ✅ 15.70316 15.54800
bv_decide-nokernel unsat ✅ 7.97262 7.82639
cvc5 cvc5 unsat ✅ 0.90788 0.78818
SMTInterpol SMTInterpol unknown ❌ 1201.60137 1227.59243
Yices2 Yices2 unsat ✅ 0.28904 0.17020
Z3alpha Z3-alpha unsat ✅ 0.44101 0.41820
Z3 Z3-alpha-base unsat ✅ 0.29739 0.17477
Z3-Owl-base unsat ✅ 0.40768 0.28515
z3siri-base unsat ✅ 0.28981 0.17109
Z3-Owl Z3-Owl unsat ✅ 0.83563 0.71002