Benchmark

non-incremental/QF_BV/sage/app7/bench_284.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3305146
Compressed Size208596
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3305138
Compressed Size208582
Max. Term Depth12667
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not2103 and1
=2788 let12562 extract1547 bvand34078
bvor22401 bvxor1957 bvadd36505 bvmul2
bvsub11904 bvsdiv5 bvult487 bvule526
bvslt212 bvsle121 bvshl11679 bvashr21951
zero_extend1310

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.49362 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.53511 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.54559 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.53914 —
abziz_portfolio_2012_solvers default unsat ✅ 0.54774 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.53307 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.65406 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.79731 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.69039 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 173.46900 —
CVC3-SMT-COMP-2011 default unsat ✅ 146.71100 —
CVC3-SMT-COMP-2012 default unsat ✅ 153.33900 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.82042 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.49898 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.99865 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.95747 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.23248 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.20189 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.86165 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.95555 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.14808 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.34238 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.52005 —
STP2-SMT-COMP-2012 default unsat ✅ 0.49363 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.51954 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.58740 —
Z3-SMT-COMP-2011 default unsat ✅ 0.52966 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.86032 0.85930
Boolector SMT17 final boolector unsat ✅ 0.86493 0.86322
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.44352 7.15773
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.63196 0.63235
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.25282 1.24974
Q3B Q3B default unsat ✅ 0.88583 2.21000
STP stp_st default unsat ✅ 0.58424 0.57466
stp_mt default unsat ✅ 0.60268 0.60157
Yices2 Yices2-Main default unsat ✅ 0.36417 0.36313
Z3 z3-4.5.0 default unsat ✅ 0.54403 0.54270
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.77286 0.77280
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.86529 3.86534
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.67393 0.67504
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.25842 1.25851
Minkeyrink ST_st unsat ✅ 1.27422 1.27418
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.56791 0.56796
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.57310 0.57308
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.56793 0.56802
Yices2 Yices 2.6.0_default unsat ✅ 0.36525 0.36516
Z3 z3-4.7.1_default unsat ✅ 0.78155 0.78145
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.48875 1.48868
Poolector-wrapped-sq_default unsat ✅ 1.81479 6.70016
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.20662 1.20655
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 4.16187 4.16230
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.88827 0.88844
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.89462 0.89429
Par4 Par4-wrapped-sq_default unsat ✅ 0.37914 0.00586
STP STP-2019-wrapped-sq_default unsat ✅ 0.59251 0.59265
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.58321 0.58336
stp-minisat-wrapped-sq_default unsat ✅ 0.59189 0.59200
stp-mt-wrapped-sq_default unsat ✅ 0.61335 0.61343
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.58340 0.58352
stp-riss-wrapped-sq_default unsat ✅ 0.59137 0.59154
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.34176 0.34172
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.33984 0.33982
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.33961 0.33960
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.33714 0.33700
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.33943 0.33937
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.73635 1.37610
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.91800 1.91758
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 3.02034 3.01858
STP STP 2022.4_default unsat ✅ 0.60064 0.60061
STP 2022.4_default unsat ✅ 0.61114 0.61012
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 1089.26000 1204.61000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.36907 0.36901
Z3-Owl z3-Owl-Final_default unsat ✅ 1.06543 1.06535
z3-Owl-Final_default unsat ✅ 1.08321 2.11333
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.36179 1.26211
cvc5 cvc5 unsat ✅ 1.63723 1.53551
SMTInterpol SMTInterpol unknown ❌ 1202.74401 1370.64676
STP STP unsat ✅ 45.11520 44.98841
Yices2 Yices2 unsat ✅ 0.55084 0.45111
Z3alpha Z3-alpha unsat ✅ 0.54228 0.44245