Benchmark

non-incremental/QF_BV/sage/app7/bench_8597.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3336078
Compressed Size212074
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3336070
Compressed Size212080
Max. Term Depth12812
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not2243 and1
=2947 let12707 extract1617 bvand34146
bvor22407 bvxor2082 bvadd36787 bvmul7
bvsub11949 bvsdiv18 bvult550 bvule597
bvslt217 bvsle123 bvshl11740 bvashr22019
zero_extend1398

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.49542 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.54564 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.53790 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.54263 —
abziz_portfolio_2012_solvers default unsat ✅ 0.53980 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.54439 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.66254 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.80007 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.70195 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 351.26300 —
CVC3-SMT-COMP-2011 default unsat ✅ 293.84400 —
CVC3-SMT-COMP-2012 default unsat ✅ 306.78800 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.83224 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.54320 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.99308 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.96183 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.23866 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.20663 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.87424 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.07451 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.16625 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.34966 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.51953 —
STP2-SMT-COMP-2012 default unsat ✅ 0.49858 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.52240 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.58869 —
Z3-SMT-COMP-2011 default unsat ✅ 0.53439 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.86453 0.86382
Boolector SMT17 final boolector unsat ✅ 0.94001 0.93892
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.36041 7.01266
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.65170 0.65238
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.26154 1.26098
Q3B Q3B default unsat ✅ 0.88020 2.22000
STP stp_st default unsat ✅ 0.60104 0.60041
stp_mt default unsat ✅ 0.59594 0.58979
Yices2 Yices2-Main default unsat ✅ 0.37154 0.36986
Z3 z3-4.5.0 default unsat ✅ 0.72755 0.72682
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.78555 0.78547
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.97534 3.97543
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.62728 0.62838
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.27299 1.27298
Minkeyrink ST_st unsat ✅ 1.26955 1.26943
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.57719 0.57716
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.57758 0.57760
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.57556 0.57564
Yices2 Yices 2.6.0_default unsat ✅ 0.36783 0.36772
Z3 z3-4.7.1_default unsat ✅ 0.80336 0.80318
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.51182 1.51068
Poolector-wrapped-sq_default unsat ✅ 1.82215 6.76865
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.21904 1.21890
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 4.19376 4.19372
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.88789 0.88753
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.89572 0.89577
Par4 Par4-wrapped-sq_default unsat ✅ 0.38290 0.00601
STP STP-2019-wrapped-sq_default unsat ✅ 0.59450 0.59463
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.58817 0.58822
stp-minisat-wrapped-sq_default unsat ✅ 0.59700 0.59668
stp-mt-wrapped-sq_default unsat ✅ 0.60679 0.59695
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.58894 0.58910
stp-riss-wrapped-sq_default unsat ✅ 0.59577 0.59589
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.34587 0.34584
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.34755 0.34757
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.34394 0.34393
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.33699 0.33694
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.34543 0.34525
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.73811 0.73804
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.24588 1.24583
MathSAT mathsat-5.6.6_default unsat ✅ 0.67095 0.67091
STP STP 2021.0_default unsat ✅ 0.56547 0.56560
Z3 z3-4.8.11_default unsat ✅ 0.61427 0.61423
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.26529 1.26519
Bitwuzla-wrapped_default unsat ✅ 1.32335 1.32304
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.27491 4.27498
MathSAT MathSAT-5.6.8_default unsat ✅ 0.67507 0.67491
STP STP 2022.4_default unsat ✅ 0.60281 0.60286
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.37938 0.37881
Z3++BV z3++bv_0702_default unsat ✅ 0.41557 0.41547
Z3 z3-4.8.17_default unsat ✅ 0.41554 0.41701
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.42034 1.31843
cvc5 cvc5 unsat ✅ 2.08445 1.98532
SMTInterpol SMTInterpol unknown ❌ 1202.74429 1369.27354
STP STP unsat ✅ 34.77570 34.67447
Yices2 Yices2 unsat ✅ 0.46375 0.36406
Z3alpha Z3-alpha unsat ✅ 0.57243 0.47284
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.96689 0.84360
Bitwuzla-MachBV-base unsat ✅ 1.23403 1.10207
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.41081 1.28141
BVDecide bv_decide unknown ❌ 1201.38975 1201.00322
bv_decide-nokernel unknown ❌ 1201.34982 1201.02621
cvc5 cvc5 unsat ✅ 1.29951 1.17811
SMTInterpol SMTInterpol unknown ❌ 1201.85369 1731.88106
Yices2 Yices2 unsat ✅ 0.47041 0.34701
Z3alpha Z3-alpha unsat ✅ 0.97293 0.95200
Z3 Z3-alpha-base unsat ✅ 0.62573 0.50566
Z3-Owl-base unsat ✅ 2.09018 1.96004
z3siri-base unsat ✅ 0.62350 0.50763
Z3-Owl Z3-Owl unsat ✅ 1.26479 1.13175