Benchmark

non-incremental/QF_BV/sage/app7/bench_2112.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size871013
Compressed Size77008
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 871005
Compressed Size77015
Max. Term Depth3299
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1379 and1
=1880 let3242 extract1143 bvand7594
bvor4842 bvxor1267 bvadd8939 bvmul1
bvsub2908 bvult411 bvule395 bvslt185
bvsle96 bvshl2753 bvashr4550 zero_extend865

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.11948 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.14493 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.14415 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.15042 —
abziz_portfolio_2012_solvers default unsat ✅ 0.14467 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.14422 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.16230 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.19616 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.16648 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 4.74285 —
CVC3-SMT-COMP-2011 default unsat ✅ 4.07985 —
CVC3-SMT-COMP-2012 default unsat ✅ 4.20869 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.77009 —
CVC4-SMT-EVAL-2013 default unsat ✅ 1.28884 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.26970 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.26223 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.33903 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.32452 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.24001 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 1.38191 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 1.50214 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.33163 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.12560 —
STP2-SMT-COMP-2012 default unsat ✅ 0.11894 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.12649 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.14686 —
Z3-SMT-COMP-2011 default unsat ✅ 0.13966 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.21997 0.21896
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.21759 2.01569
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.22981 2.03669
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.19621 0.19497
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2401.20000
STP stp-cryptominisat4 default unsat ✅ 0.11506 0.11398
stp-cmsat4-v15 default unsat ✅ 0.11363 0.11298
stp-cmsat4-mt-v15 default unsat ✅ 0.11451 0.11398
stp-minisat-v15 default unsat ✅ 0.11417 0.11298
Yices2 Yices default unsat ✅ 0.05633 0.05499
Z3 z3 4.4.0 default unsat ✅ 0.18256 0.18197
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.50650 0.50328
ABC_glucose glucose unsat ✅ 0.50205 0.49449
Boolector Boolector boolector unsat ✅ 0.25423 0.25492
Boolector preprop boolector unsat ✅ 0.24750 0.24757
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.19810 1.98803
MapleSTP MapleSTP default unsat ✅ 0.11203 0.10961
MapleSTP-mt default unsat ✅ 0.11039 0.11041
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.17615 0.17715
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.14338 0.14372
Q3B Q3B default unsat ✅ 0.35004 0.78207
STP stp-cms-exp-2016 default unsat ✅ 0.11116 0.11118
stp-cms-mt-2016 default unsat ✅ 0.11286 0.11291
stp-cms-st-2016 default unsat ✅ 0.11351 0.11353
stp-minisat-st-2016 default unsat ✅ 0.11317 0.11320
Yices2 Yices-2.4.2 default unsat ✅ 0.05643 0.05642
Z3 z3-4.4.1 default unsat ✅ 0.16000 0.16138
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.20344 0.20250
Boolector SMT17 final boolector unsat ✅ 0.20476 0.20274
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.19633 1.96438
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.17926 0.17882
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.33458 0.33333
Q3B Q3B default unsat ✅ 0.32065 0.69207
STP stp_st default unsat ✅ 0.14331 0.13765
stp_mt default unsat ✅ 0.13844 0.13748
Yices2 Yices2-Main default unsat ✅ 0.05801 0.05396
Z3 z3-4.5.0 default unsat ✅ 0.18300 0.18292
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.18588 0.18576
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.08484 2.09494
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.17299 0.17396
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.33832 0.33837
Minkeyrink ST_st unsat ✅ 0.33738 0.33747
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.13836 0.13844
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.13827 0.13827
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.13864 0.13866
Yices2 Yices 2.6.0_default unsat ✅ 0.05456 0.05446
Z3 z3-4.7.1_default unsat ✅ 0.26132 0.26126
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.27626 0.27619
Boolector Boolector-wrapped-sq_default unsat ✅ 0.32660 0.32653
Poolector-wrapped-sq_default unsat ✅ 0.47799 1.53479
CVC4 CVC4-sq-final_default unsat ✅ 1.39917 1.39941
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.21571 0.21563
MathSAT MathSAT5_default.sh unsat ✅ 0.18005 0.18003
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.23084 0.23094
MinkeyRink Solver 2020.3_default unsat ✅ 0.23916 0.23927
STP STP_default unsat ✅ 0.13514 0.13522
STP ++ Mergsat v1_default unsat ✅ 0.13059 0.13232
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.06528 0.06520
Z3 z3-4.8.8_default unsat ✅ 0.13979 0.13967
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.44312 0.34261
cvc5 cvc5 unsat ✅ 0.45299 0.35329
SMTInterpol SMTInterpol unsat ✅ 669.89960 981.64339
STP STP unsat ✅ 2.73627 2.63601
Yices2 Yices2 unsat ✅ 0.25385 0.15396
Z3alpha Z3-alpha unsat ✅ 0.34874 0.24866
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.43884 0.31263
Bitwuzla-MachBV-base unsat ✅ 0.48452 0.35981
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.55269 0.43406
BVDecide bv_decide unsat ✅ 85.82200 85.68183
bv_decide-nokernel unsat ✅ 70.43674 70.29683
cvc5 cvc5 unsat ✅ 0.57609 0.45065
SMTInterpol SMTInterpol unknown ❌ 1201.88725 3456.67808
Yices2 Yices2 unsat ✅ 0.31801 0.18922
Z3alpha Z3-alpha unsat ✅ 0.50432 0.39789
Z3 Z3-alpha-base unsat ✅ 0.40208 0.28115
Z3-Owl-base unsat ✅ 0.85051 0.72854
z3siri-base unsat ✅ 0.36790 0.24786
Z3-Owl Z3-Owl unsat ✅ 0.93228 0.79749