Benchmark

non-incremental/QF_BV/sage/app7/bench_1588.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1488532
Compressed Size109958
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1488524
Compressed Size109965
Max. Term Depth5722
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1577 and1
=2135 let5665 extract1229 bvand14398
bvor9326 bvxor1416 bvadd15947 bvmul1
bvsub5158 bvult432 bvule463 bvslt201
bvsle97 bvshl4991 bvashr9019 zero_extend939

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.20999 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.22977 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.24487 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.23304 —
abziz_portfolio_2012_solvers default unsat ✅ 0.23311 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.23301 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.28526 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.34780 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.30322 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 48.44090 —
CVC3-SMT-COMP-2011 default unsat ✅ 41.06010 —
CVC3-SMT-COMP-2012 default unsat ✅ 42.85120 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.22681 —
CVC4-SMT-EVAL-2013 default unsat ✅ 2.01880 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.45255 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.43997 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.57008 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.54972 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.40202 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 2.21415 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 2.68999 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.58261 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.22253 —
STP2-SMT-COMP-2012 default unsat ✅ 0.21163 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.22177 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.24923 —
Z3-SMT-COMP-2011 default unsat ✅ 0.22909 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.40570 0.40494
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.99874 3.26650
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.98882 3.25850
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.32310 0.32195
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.83000
STP stp-cryptominisat4 default unsat ✅ 0.19991 0.19897
stp-cmsat4-v15 default unsat ✅ 0.19918 0.19797
stp-cmsat4-mt-v15 default unsat ✅ 0.19957 0.19897
stp-minisat-v15 default unsat ✅ 0.19918 0.19797
Yices2 Yices default unsat ✅ 0.09085 0.08998
Z3 z3 4.4.0 default unsat ✅ 0.25540 0.25496
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.84924 0.84971
ABC_glucose glucose unsat ✅ 0.84431 0.84437
Boolector Boolector boolector unsat ✅ 0.51282 0.51309
Boolector preprop boolector unsat ✅ 0.50338 0.50368
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.95608 3.20806
MapleSTP MapleSTP default unsat ✅ 0.19027 0.19031
MapleSTP-mt default unsat ✅ 0.19054 0.19118
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.29024 0.29138
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.25675 0.25687
Q3B Q3B default unsat ✅ 0.50127 0.50330
STP stp-cms-exp-2016 default unsat ✅ 0.19742 0.19748
stp-cms-mt-2016 default unsat ✅ 0.19886 0.19892
stp-cms-st-2016 default unsat ✅ 0.19675 0.19680
stp-minisat-st-2016 default unsat ✅ 0.19942 0.19972
Yices2 Yices-2.4.2 default unsat ✅ 0.09117 0.09116
Z3 z3-4.4.1 default unsat ✅ 0.22278 0.22452
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.36905 0.36912
Boolector SMT17 final boolector unsat ✅ 0.36903 0.36832
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.94191 3.14546
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.30523 0.30295
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.58447 0.58402
Q3B Q3B default unsat ✅ 0.50972 0.51028
STP stp_st default unsat ✅ 0.24384 0.24264
stp_mt default unsat ✅ 0.28163 0.28098
Yices2 Yices2-Main default unsat ✅ 0.08743 0.08620
Z3 z3-4.5.0 default unsat ✅ 0.28344 0.28216
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.33183 0.33176
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.80000 1.79981
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.28585 0.28688
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.57822 0.57820
Minkeyrink ST_st unsat ✅ 0.58058 0.58058
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.24616 0.24618
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.24591 0.24577
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.24518 0.24522
Yices2 Yices 2.6.0_default unsat ✅ 0.08449 0.08432
Z3 z3-4.7.1_default unsat ✅ 0.28268 0.28259
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.64320 0.64293
Poolector-wrapped-sq_default unsat ✅ 0.88367 2.98908
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.51330 0.51320
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.83339 1.83353
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.43668 0.43675
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.43568 0.43575
Par4 Par4-wrapped-sq_default unsat ✅ 0.09499 0.00621
STP STP-2019-wrapped-sq_default unsat ✅ 0.25354 0.25367
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.25290 0.25305
stp-minisat-wrapped-sq_default unsat ✅ 0.25351 0.25358
stp-mt-wrapped-sq_default unsat ✅ 0.25495 0.25506
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.25185 0.25198
stp-riss-wrapped-sq_default unsat ✅ 0.25252 0.25263
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.08833 0.08834
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.08770 0.08771
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.08797 0.08798
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.08687 0.08687
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.08787 0.08787
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.27646 0.27643
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.70897 0.60954
cvc5 cvc5 unsat ✅ 0.89337 0.79407
SMTInterpol SMTInterpol unsat ✅ 975.90957 1403.53362
STP STP unsat ✅ 8.03073 7.92755
Yices2 Yices2 unsat ✅ 0.27686 0.17700
Z3alpha Z3-alpha unsat ✅ 0.39018 0.29036
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.53389 0.41674
Bitwuzla-MachBV-base unsat ✅ 0.58654 0.46570
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.73481 0.60519
BVDecide bv_decide unsat ✅ 390.63617 390.46083
bv_decide-nokernel unsat ✅ 350.28701 350.07670
cvc5 cvc5 unsat ✅ 0.48916 0.36885
SMTInterpol SMTInterpol unknown ❌ 1201.87196 3296.50652
Yices2 Yices2 unsat ✅ 0.33848 0.21293
Z3alpha Z3-alpha unsat ✅ 0.61902 0.53507
Z3 Z3-alpha-base unsat ✅ 0.44577 0.32309
Z3-Owl-base unsat ✅ 0.75934 0.63394
z3siri-base unsat ✅ 0.35362 0.23790
Z3-Owl Z3-Owl unsat ✅ 0.91091 0.79103