Benchmark

non-incremental/QF_BV/sage/app7/bench_8606.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3335782
Compressed Size211457
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3335774
Compressed Size211462
Max. Term Depth12812
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not2243 and1
=2946 let12707 extract1617 bvand34146
bvor22407 bvxor2082 bvadd36786 bvmul7
bvsub11947 bvsdiv17 bvult548 bvule594
bvslt216 bvsle123 bvshl11740 bvashr22019
zero_extend1398

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.49722 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.54057 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.54156 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.54283 —
abziz_portfolio_2012_solvers default unsat ✅ 0.55197 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.54716 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.65971 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.79754 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.70177 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 351.35700 —
CVC3-SMT-COMP-2011 default unsat ✅ 293.86100 —
CVC3-SMT-COMP-2012 default unsat ✅ 306.46100 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.86211 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.54840 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.99438 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.95412 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.23717 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.21429 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.87328 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.07961 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.17273 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.33981 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.53273 —
STP2-SMT-COMP-2012 default unsat ✅ 0.49824 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.53223 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.58895 —
Z3-SMT-COMP-2011 default unsat ✅ 0.53976 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.87236 0.87194
Boolector SMT17 final boolector unsat ✅ 0.97698 0.95328
CVC4 CVC4-smtcomp2017-main default unsat ✅ 17.10790 7.76140
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.66446 0.66545
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.27894 1.27837
Q3B Q3B default unsat ✅ 0.84171 2.02000
STP stp_st default unsat ✅ 0.56418 0.56360
stp_mt default unsat ✅ 0.56930 0.56870
Yices2 Yices2-Main default unsat ✅ 0.36753 0.36686
Z3 z3-4.5.0 default unsat ✅ 0.48715 0.48567
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.78460 0.78447
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.97380 3.97376
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.63364 0.63465
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.26883 1.26876
Minkeyrink ST_st unsat ✅ 1.27752 1.27764
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.58102 0.58106
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.57825 0.57830
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.57816 0.57815
Yices2 Yices 2.6.0_default unsat ✅ 0.37165 0.37157
Z3 z3-4.7.1_default unsat ✅ 0.79339 0.79330
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.51346 1.51323
Poolector-wrapped-sq_default unsat ✅ 1.81820 6.77457
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.21686 1.21668
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 4.15566 4.15571
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.90104 0.90107
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.89305 0.89307
Par4 Par4-wrapped-sq_default unsat ✅ 0.39017 0.00594
STP STP-2019-wrapped-sq_default unsat ✅ 0.58263 0.58268
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.58835 0.58849
stp-minisat-wrapped-sq_default unsat ✅ 0.59316 0.59327
stp-mt-wrapped-sq_default unsat ✅ 0.59096 0.59106
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.58606 0.58622
stp-riss-wrapped-sq_default unsat ✅ 0.58492 0.58495
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.34394 0.34394
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.34913 0.34908
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.34513 0.34511
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.33589 0.33586
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.34207 0.34200
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.60560 0.60556
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.27260 1.27240
MathSAT mathsat-5.6.6_default unsat ✅ 0.66805 0.66803
STP STP 2021.0_default unsat ✅ 0.56561 0.56572
Z3 z3-4.8.11_default unsat ✅ 0.42811 0.42790
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.24971 1.24950
Bitwuzla-wrapped_default unsat ✅ 1.32395 1.32383
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.24363 4.24378
MathSAT MathSAT-5.6.8_default unsat ✅ 0.70324 0.70311
STP STP 2022.4_default unsat ✅ 0.61054 0.61047
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.37532 0.37525
Z3++BV z3++bv_0702_default unsat ✅ 0.70243 0.70222
Z3 z3-4.8.17_default unsat ✅ 0.61665 0.61806
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.22236 1.12234
cvc5 cvc5 unsat ✅ 1.87883 1.77907
SMTInterpol SMTInterpol unknown ❌ 1202.72607 1376.73168
STP STP unsat ✅ 41.99373 41.89317
Yices2 Yices2 unsat ✅ 0.48756 0.38780
Z3alpha Z3-alpha unsat ✅ 0.55401 0.45431
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.98063 0.85419
Bitwuzla-MachBV-base unsat ✅ 1.21257 1.08359
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.43151 1.30526
BVDecide bv_decide unknown ❌ 1201.37169 1200.94886
bv_decide-nokernel unknown ❌ 1201.38728 1201.06028
cvc5 cvc5 unsat ✅ 0.85363 0.71846
SMTInterpol SMTInterpol unknown ❌ 1201.88796 1574.85857
Yices2 Yices2 unsat ✅ 0.47737 0.35737
Z3alpha Z3-alpha unsat ✅ 0.93405 0.91346
Z3 Z3-alpha-base unsat ✅ 0.54358 0.41897
Z3-Owl-base unsat ✅ 1.36724 1.24737
z3siri-base unsat ✅ 0.54791 0.41983
Z3-Owl Z3-Owl unsat ✅ 1.06840 0.94394