Benchmark

non-incremental/QF_BV/sage/app7/bench_711.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3105208
Compressed Size193330
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3105200
Compressed Size193335
Max. Term Depth11898
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1874 and1
=2509 let11793 extract1362 bvand32414
bvor21372 bvxor1640 bvadd34303 bvmul1
bvsub11125 bvult450 bvule505 bvslt210
bvsle109 bvshl10944 bvashr20808 zero_extend1082

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.46430 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.46720 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.47772 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.47404 —
abziz_portfolio_2012_solvers default unsat ✅ 0.47314 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.47570 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.62917 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.75518 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.65857 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 152.59400 —
CVC3-SMT-COMP-2011 default unsat ✅ 128.79700 —
CVC3-SMT-COMP-2012 default unsat ✅ 134.66800 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.70650 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.08072 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.93328 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.89888 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.17255 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.13560 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.80770 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.71748 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 5.81995 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.25785 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.49615 —
STP2-SMT-COMP-2012 default unsat ✅ 0.46862 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.49465 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.51333 —
Z3-SMT-COMP-2011 default unsat ✅ 0.46755 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.89908 0.89786
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 4.06507 6.59500
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 4.05785 6.59100
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.65789 0.65690
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.95000
STP stp-cryptominisat4 default unsat ✅ 0.43754 0.43693
stp-cmsat4-v15 default unsat ✅ 0.43514 0.43393
stp-cmsat4-mt-v15 default unsat ✅ 0.43750 0.43693
stp-minisat-v15 default unsat ✅ 0.43498 0.43393
Yices2 Yices default unsat ✅ 0.17932 0.17797
Z3 z3 4.4.0 default unsat ✅ 0.47049 0.47093
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.78028 1.78080
ABC_glucose glucose unsat ✅ 1.74211 1.74302
Boolector Boolector boolector unsat ✅ 1.02794 1.02848
Boolector preprop boolector unsat ✅ 1.00668 1.00627
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 3.99006 6.49337
MapleSTP MapleSTP default unsat ✅ 0.41375 0.41392
MapleSTP-mt default unsat ✅ 0.42107 0.42128
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.60437 0.59601
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.57815 0.57846
Q3B Q3B default unsat ✅ 0.80439 1.99000
STP stp-cms-exp-2016 default unsat ✅ 0.42261 0.42281
stp-cms-mt-2016 default unsat ✅ 0.43766 0.43781
stp-cms-st-2016 default unsat ✅ 0.43285 0.43306
stp-minisat-st-2016 default unsat ✅ 0.43158 0.43177
Yices2 Yices-2.4.2 default unsat ✅ 0.17736 0.17741
Z3 z3-4.4.1 default unsat ✅ 0.46289 0.46441
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.82786 0.82689
Boolector SMT17 final boolector unsat ✅ 0.88716 0.88601
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.94912 6.32445
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.59962 0.59953
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.20116 1.19959
Q3B Q3B default unsat ✅ 0.82361 2.04000
STP stp_st default unsat ✅ 0.59893 0.59733
stp_mt default unsat ✅ 0.56116 0.55988
Yices2 Yices2-Main default unsat ✅ 0.16889 0.16757
Z3 z3-4.5.0 default unsat ✅ 0.47032 0.46898
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.73667 0.73630
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.69430 3.69422
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.59761 0.59861
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.18317 2.25302
Minkeyrink ST_st unsat ✅ 1.18528 1.18513
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.54186 0.54188
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.54116 0.54117
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.54478 0.54422
Yices2 Yices 2.6.0_default unsat ✅ 0.16178 0.16173
Z3 z3-4.7.1_default unsat ✅ 0.75875 0.75866
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.13794 1.13794
MathSAT mathsat-5.6.6_default unsat ✅ 0.62427 0.62416
STP STP 2021.0_default unsat ✅ 0.52312 0.52325
Z3 z3-4.8.11_default unsat ✅ 0.62752 0.62397
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.15482 1.15406
Bitwuzla-wrapped_default unsat ✅ 1.24476 1.24471
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 3.86701 3.86691
MathSAT MathSAT-5.6.8_default unsat ✅ 0.63246 0.63233
STP STP 2022.4_default unsat ✅ 0.57065 0.56973
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.20491 0.20483
Z3++BV z3++bv_0702_default unsat ✅ 0.40680 0.40663
Z3 z3-4.8.17_default unsat ✅ 0.41962 0.42041
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.01956 0.91915
cvc5 cvc5 unsat ✅ 1.69029 1.58974
SMTInterpol SMTInterpol unknown ❌ 1202.72547 1439.62536
STP STP unsat ✅ 30.89923 30.79868
Yices2 Yices2 unsat ✅ 0.35408 0.25410
Z3alpha Z3-alpha unsat ✅ 0.53924 0.43970
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.93415 0.79986
Bitwuzla-MachBV-base unsat ✅ 1.05273 0.92358
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.20783 1.08812
BVDecide bv_decide unknown ❌ 1201.39313 1200.92563
bv_decide-nokernel unknown ❌ 1201.38907 1201.01797
cvc5 cvc5 unsat ✅ 1.13467 1.00913
SMTInterpol SMTInterpol unknown ❌ 1201.89124 2606.01588
Yices2 Yices2 unsat ✅ 0.38386 0.25900
Z3alpha Z3-alpha unsat ✅ 0.95239 0.93070
Z3 Z3-alpha-base unsat ✅ 0.60860 0.48885
Z3-Owl-base unsat ✅ 1.98815 1.86227
z3siri-base unsat ✅ 0.64161 0.52458
Z3-Owl Z3-Owl unsat ✅ 1.16846 1.02781