Benchmark

non-incremental/QF_BV/sage/app11/bench_339.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1531069
Compressed Size151145
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1531061
Compressed Size151154
Max. Term Depth4211
Asserts 1
Declared Functions0
Declared Constants8425
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true2 false1 ite92 not1288
and1 =2081 let2878 extract1486
bvand969 bvor273 bvxor2281 bvadd14629
bvmul1183 bvsdiv16 bvult1097 bvule1502
bvslt122 bvsle163 bvshl8908 bvashr13274
zero_extend10174

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.16012 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.41071 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.41490 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.40507 —
abziz_portfolio_2012_solvers default unsat ✅ 0.40941 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.40780 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.21821 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.30008 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.23845 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 30.85390 —
CVC3-SMT-COMP-2011 default unsat ✅ 26.22480 —
CVC3-SMT-COMP-2012 default unsat ✅ 27.25450 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.68918 —
CVC4-SMT-EVAL-2013 default unsat ✅ 13.66140 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.45762 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.45976 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 23.33900 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.54756 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.46538 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 7.90349 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.80568 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.54116 —
STP STP2-SMT-COMP-2011 default unsat ✅ 1.08355 —
STP2-SMT-COMP-2012 default unsat ✅ 0.16558 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.25311 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.44562 —
Z3-SMT-COMP-2011 default unsat ✅ 0.40064 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.32802 0.32688
Boolector SMT17 final boolector unsat ✅ 0.32091 0.31950
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.56290 6.36165
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.32254 0.32238
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.68804 0.68809
Q3B Q3B default unsat ✅ 62.26840 185.00000
STP stp_st default unsat ✅ 25.17430 25.16930
stp_mt default unsat ✅ 24.32360 24.31180
Yices2 Yices2-Main default unsat ✅ 0.12579 0.12431
Z3 z3-4.5.0 default unsat ✅ 0.29097 0.28986
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.29223 0.29216
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.33073 3.33070
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.32125 0.32117
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.68206 0.68205
Minkeyrink ST_st unsat ✅ 0.68559 0.68561
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 13.72900 13.72300
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 13.67540 13.67430
STP-Riss-st-2018_riss-no-stderr unsat ✅ 13.55970 13.55810
Yices2 Yices 2.6.0_default unsat ✅ 0.12227 0.12217
Z3 z3-4.7.1_default unsat ✅ 0.31440 0.31430
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.57235 0.57233
Poolector-wrapped-sq_default unsat ✅ 0.78816 2.72000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.50725 0.50724
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 3.36608 3.36581
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 1.34307 1.34316
MinkeyRink ST-wrapped-sq_default unsat ✅ 1.33432 1.33435
Par4 Par4-wrapped-sq_default unsat ✅ 0.13282 0.00636
STP STP-2019-wrapped-sq_default unsat ✅ 28.87490 28.87070
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 28.62560 28.62560
stp-minisat-wrapped-sq_default unsat ✅ 28.61290 57.09790
stp-mt-wrapped-sq_default unsat ✅ 28.71480 28.71530
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 28.66110 28.65860
stp-riss-wrapped-sq_default unsat ✅ 28.78940 28.78810
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.12587 0.12586
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.12792 0.12794
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.12569 0.12570
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.12482 0.12480
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.12673 0.12674
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.28500 0.28499
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.41704 0.41693
MathSAT mathsat-5.6.6_default unsat ✅ 34.95650 34.95000
STP STP 2021.0_default unsat ✅ 6.15153 6.15194
Z3 z3-4.8.11_default unsat ✅ 0.18722 0.18717
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.70613 0.58085
Bitwuzla-MachBV-base unsat ✅ 0.80838 0.67901
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.86243 0.74015
BVDecide bv_decide unknown ❌ 1201.38381 1200.95747
bv_decide-nokernel unknown ❌ 1201.42172 1201.06928
cvc5 cvc5 unsat ✅ 0.77081 0.64301
SMTInterpol SMTInterpol unknown ❌ 1201.90008 2644.33465
Yices2 Yices2 unsat ✅ 0.41793 0.29216
Z3alpha Z3-alpha unsat ✅ 0.62546 0.54147
Z3 Z3-alpha-base unsat ✅ 0.44029 0.30449
Z3-Owl-base unsat ✅ 0.86629 0.74128
z3siri-base unsat ✅ 0.41621 0.29463
Z3-Owl Z3-Owl unsat ✅ 0.97708 0.85747