Benchmark

non-incremental/QF_BV/sage/app7/bench_2170.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size838980
Compressed Size74392
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 838972
Compressed Size74399
Max. Term Depth3171
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1344 and1
=1843 let3114 extract1133 bvand7297
bvor4654 bvxor1250 bvadd8606 bvmul1
bvsub2800 bvult409 bvule391 bvslt183
bvsle95 bvshl2653 bvashr4356 zero_extend854

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.11549 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.16766 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.16651 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.16902 —
abziz_portfolio_2012_solvers default unsat ✅ 0.18320 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.17136 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.15513 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.19714 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.16216 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 98.56930 —
CVC3-SMT-COMP-2011 default unsat ✅ 82.23250 —
CVC3-SMT-COMP-2012 default unsat ✅ 85.58210 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.75575 —
CVC4-SMT-EVAL-2013 default unsat ✅ 1.26226 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.26205 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.24508 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.33005 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.31428 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.23269 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 1.35423 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 1.44735 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.32015 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.12224 —
STP2-SMT-COMP-2012 default unsat ✅ 0.11645 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.12193 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.18733 —
Z3-SMT-COMP-2011 default unsat ✅ 0.16262 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.20708 0.20597
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.18903 1.97070
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.21657 2.01869
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.19001 0.18897
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.98000
STP stp-cryptominisat4 default unsat ✅ 0.11257 0.11198
stp-cmsat4-v15 default unsat ✅ 0.11086 0.10998
stp-cmsat4-mt-v15 default unsat ✅ 0.11084 0.10998
stp-minisat-v15 default unsat ✅ 0.10999 0.10898
Yices2 Yices default unsat ✅ 0.05411 0.05299
Z3 z3 4.4.0 default unsat ✅ 0.23201 0.23196
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.48319 0.48348
ABC_glucose glucose unsat ✅ 0.47917 0.47989
Boolector Boolector boolector unsat ✅ 0.23485 0.23562
Boolector preprop boolector unsat ✅ 0.22834 0.22843
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.15105 1.90543
MapleSTP MapleSTP default unsat ✅ 0.10502 0.10502
MapleSTP-mt default unsat ✅ 0.10490 0.10493
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.17070 0.17201
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.13908 0.13912
Q3B Q3B default unsat ✅ 0.33202 0.73080
STP stp-cms-exp-2016 default unsat ✅ 0.10740 0.10740
stp-cms-mt-2016 default unsat ✅ 0.10962 0.11008
stp-cms-st-2016 default unsat ✅ 0.11077 0.11081
stp-minisat-st-2016 default unsat ✅ 0.10981 0.10984
Yices2 Yices-2.4.2 default unsat ✅ 0.05508 0.05507
Z3 z3-4.4.1 default unsat ✅ 0.15938 0.16077
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.48259 0.22714
Boolector SMT17 final boolector unsat ✅ 0.21334 0.21345
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.26688 2.05332
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.18768 0.18696
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.34706 0.34580
Q3B Q3B default unsat ✅ 0.32300 0.68336
STP stp_st default unsat ✅ 0.14283 0.14212
stp_mt default unsat ✅ 0.16712 0.16384
Yices2 Yices2-Main default unsat ✅ 0.05332 0.05290
Z3 z3-4.5.0 default unsat ✅ 0.21386 0.21249
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.17237 0.17230
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.07555 1.07576
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.16800 0.16904
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.32341 0.32342
Minkeyrink ST_st unsat ✅ 0.32496 0.32498
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.13312 0.13315
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.13290 0.13296
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.13422 0.13422
Yices2 Yices 2.6.0_default unsat ✅ 0.05222 0.05210
Z3 z3-4.7.1_default unsat ✅ 0.19172 0.19162
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.30923 0.30924
Poolector-wrapped-sq_default unsat ✅ 0.47924 1.46809
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.25295 0.25295
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.05227 1.05261
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.27206 0.27223
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.27233 0.27236
Par4 Par4-wrapped-sq_default unsat ✅ 0.06046 0.00605
STP STP-2019-wrapped-sq_default unsat ✅ 0.14224 0.14236
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.14218 0.14232
stp-minisat-wrapped-sq_default unsat ✅ 0.14318 0.14335
stp-mt-wrapped-sq_default unsat ✅ 0.14398 0.14416
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.14580 0.14575
stp-riss-wrapped-sq_default unsat ✅ 0.14205 0.14223
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.05404 0.05408
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.05420 0.05416
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.05435 0.05437
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.05396 0.05396
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.05417 0.05414
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.18496 0.18495
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.48167 0.48151
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.83882 0.83766
STP STP 2022.4_default unsat ✅ 0.14247 0.14252
STP 2022.4_default unsat ✅ 0.14117 0.14121
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 296.26400 342.25900
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.06071 0.06065
Z3-Owl z3-Owl-Final_default unsat ✅ 0.81496 0.81476
z3-Owl-Final_default unsat ✅ 0.82736 0.82751
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.42249 0.32258
cvc5 cvc5 unsat ✅ 0.51602 0.41655
SMTInterpol SMTInterpol unsat ✅ 640.74575 921.49117
STP STP unsat ✅ 2.61356 2.51341
Yices2 Yices2 unsat ✅ 0.26204 0.16235
Z3alpha Z3-alpha unsat ✅ 0.38290 0.28321