Benchmark

non-incremental/QF_BV/sage/app7/bench_6025.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3497861
Compressed Size223783
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3497853
Compressed Size223787
Max. Term Depth13391
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2434 and1
=3164 let13286 extract1685 bvand35705
bvor23425 bvxor2213 bvadd38579 bvmul7
bvsub12483 bvsdiv19 bvult588 bvule625
bvslt219 bvsle124 bvshl12296 bvashr23040
zero_extend1489

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.51925 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.57207 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.56811 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.57022 —
abziz_portfolio_2012_solvers default unsat ✅ 0.56688 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.57514 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.70276 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.83793 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.73926 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 344.61100 —
CVC3-SMT-COMP-2011 default unsat ✅ 287.64600 —
CVC3-SMT-COMP-2012 default unsat ✅ 299.84300 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.05577 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.71568 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.04125 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.99716 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.29323 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.26164 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.91352 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.29567 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.45235 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.41320 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.55272 —
STP2-SMT-COMP-2012 default unsat ✅ 0.52713 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.54422 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.61841 —
Z3-SMT-COMP-2011 default unsat ✅ 0.56741 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.92301 0.92217
Boolector SMT17 final boolector unsat ✅ 0.93722 0.93602
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.50345 7.22682
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.69326 0.69297
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.33133 1.32946
Q3B Q3B default unsat ✅ 0.89118 2.18000
STP stp_st default unsat ✅ 0.60291 0.60170
stp_mt default unsat ✅ 0.59846 0.59752
Yices2 Yices2-Main default unsat ✅ 0.38435 0.38426
Z3 z3-4.5.0 default unsat ✅ 0.72452 0.72231
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.84256 0.84016
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 4.21709 4.21022
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.66721 0.66823
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.35024 1.34997
Minkeyrink ST_st unsat ✅ 1.35844 1.35831
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.61191 0.61195
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.61620 0.61452
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.60669 0.60674
Yices2 Yices 2.6.0_default unsat ✅ 0.38264 0.38260
Z3 z3-4.7.1_default unsat ✅ 0.59513 0.59490
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.65918 1.65922
Poolector-wrapped-sq_default unsat ✅ 1.91286 7.14000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.32508 1.32499
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 4.36352 4.36307
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.94723 0.94721
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.94084 0.94076
Par4 Par4-wrapped-sq_default unsat ✅ 0.39933 0.00616
STP STP-2019-wrapped-sq_default unsat ✅ 0.62333 0.62344
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.61334 0.61345
stp-minisat-wrapped-sq_default unsat ✅ 0.62156 0.62169
stp-mt-wrapped-sq_default unsat ✅ 0.61962 0.61978
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.61232 0.61244
stp-riss-wrapped-sq_default unsat ✅ 0.62353 0.62368
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.36595 0.36591
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.36627 0.36627
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.36912 0.36909
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.36265 0.36257
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.36745 0.36743
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.80441 0.80433
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.31733 1.31713
MathSAT mathsat-5.6.6_default unsat ✅ 0.70227 0.70213
STP STP 2021.0_default unsat ✅ 0.59203 0.59216
Z3 z3-4.8.11_default unsat ✅ 0.75553 0.75538
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.23587 1.13595
cvc5 cvc5 unsat ✅ 0.88975 0.79009
SMTInterpol SMTInterpol unknown ❌ 1202.22442 1402.17499
STP STP unsat ✅ 37.73827 37.63789
Yices2 Yices2 unsat ✅ 0.51220 0.41091
Z3alpha Z3-alpha unsat ✅ 0.63919 0.53931