Benchmark

non-incremental/QF_BV/sage/app7/bench_737.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3071808
Compressed Size191606
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3071800
Compressed Size191614
Max. Term Depth11767
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1867 and1
=2498 let11662 extract1353 bvand32065
bvor21139 bvxor1625 bvadd33940 bvmul1
bvsub10999 bvult447 bvule503 bvslt210
bvsle106 bvshl10819 bvashr20571 zero_extend1072

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.46023 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.46714 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.46723 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.46568 —
abziz_portfolio_2012_solvers default unsat ✅ 0.46854 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.46818 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.62072 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.73983 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.65045 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 152.69200 —
CVC3-SMT-COMP-2011 default unsat ✅ 129.07300 —
CVC3-SMT-COMP-2012 default unsat ✅ 134.98000 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.68697 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.04433 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.92352 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.88358 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.15279 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.12138 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.80077 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.69061 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 5.75919 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.24808 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.49563 —
STP2-SMT-COMP-2012 default unsat ✅ 0.46438 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.49239 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.49876 —
Z3-SMT-COMP-2011 default unsat ✅ 0.46357 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.89680 0.89586
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 4.01218 6.50101
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 4.01111 6.51001
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.64894 0.64790
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.98000
STP stp-cryptominisat4 default unsat ✅ 0.43151 0.43093
stp-cmsat4-v15 default unsat ✅ 0.42936 0.42893
stp-cmsat4-mt-v15 default unsat ✅ 0.43108 0.42993
stp-minisat-v15 default unsat ✅ 0.43075 0.42993
Yices2 Yices default unsat ✅ 0.17666 0.17597
Z3 z3 4.4.0 default unsat ✅ 0.44338 0.44293
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.75198 1.75300
ABC_glucose glucose unsat ✅ 1.73259 1.73342
Boolector Boolector boolector unsat ✅ 1.00180 1.00244
Boolector preprop boolector unsat ✅ 0.97535 0.97618
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 3.95239 6.42479
MapleSTP MapleSTP default unsat ✅ 0.41134 0.41155
MapleSTP-mt default unsat ✅ 0.41088 0.41109
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.58918 0.59039
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.57032 0.57073
Q3B Q3B default unsat ✅ 0.79219 2.06000
STP stp-cms-exp-2016 default unsat ✅ 0.43300 0.43325
stp-cms-mt-2016 default unsat ✅ 0.42599 0.42621
stp-cms-st-2016 default unsat ✅ 0.43192 0.43213
stp-minisat-st-2016 default unsat ✅ 0.42585 0.42607
Yices2 Yices-2.4.2 default unsat ✅ 0.17500 0.17507
Z3 z3-4.4.1 default unsat ✅ 0.45811 0.45965
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.82161 0.81980
Boolector SMT17 final boolector unsat ✅ 0.82248 0.82057
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.96588 6.36362
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.60439 0.60307
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.21027 1.20948
Q3B Q3B default unsat ✅ 0.79682 1.86000
STP stp_st default unsat ✅ 0.56994 0.56928
stp_mt default unsat ✅ 0.54869 0.54338
Yices2 Yices2-Main default unsat ✅ 0.16672 0.16596
Z3 z3-4.5.0 default unsat ✅ 0.51660 0.51200
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.73108 0.73098
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.65295 3.65293
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.59070 0.59155
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.17881 1.17852
Minkeyrink ST_st unsat ✅ 1.17101 1.17104
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.53639 0.53642
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.53741 0.53725
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.54095 0.53536
Yices2 Yices 2.6.0_default unsat ✅ 0.15997 0.15991
Z3 z3-4.7.1_default unsat ✅ 0.58422 0.58417
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.36409 1.36374
Poolector-wrapped-sq_default unsat ✅ 1.69109 6.13451
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.12390 1.12388
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 3.77553 3.77542
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.82195 0.82203
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.82003 0.82011
Par4 Par4-wrapped-sq_default unsat ✅ 0.17370 0.00634
STP STP-2019-wrapped-sq_default unsat ✅ 0.54248 0.54249
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.53862 0.53877
stp-minisat-wrapped-sq_default unsat ✅ 0.54264 0.54372
stp-mt-wrapped-sq_default unsat ✅ 0.54394 0.54404
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.53843 0.53855
stp-riss-wrapped-sq_default unsat ✅ 0.54369 0.54380
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.16792 0.16790
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.16664 0.16661
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.16732 0.16733
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.16491 0.16486
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.16763 0.16758
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.45768 0.45766
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.13093 1.13083
Bitwuzla-wrapped_default unsat ✅ 1.23259 1.23238
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 3.82326 3.82373
MathSAT MathSAT-5.6.8_default unsat ✅ 0.62533 0.62528
STP STP 2022.4_default unsat ✅ 0.55444 0.55441
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.20203 0.20198
Z3++BV z3++bv_0702_default unsat ✅ 0.39827 0.39805
Z3 z3-4.8.17_default unsat ✅ 0.39625 0.39771
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.03999 0.93992
cvc5 cvc5 unsat ✅ 0.72969 0.62994
SMTInterpol SMTInterpol unknown ❌ 1202.74901 1410.50049
STP STP unsat ✅ 26.19446 26.09312
Yices2 Yices2 unsat ✅ 0.34310 0.24378
Z3alpha Z3-alpha unsat ✅ 0.56332 0.46334