Benchmark

non-incremental/QF_BV/sage/app7/bench_1891.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size4475289
Compressed Size280389
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 4475281
Compressed Size280377
Max. Term Depth17095
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2787 and1
=3600 let16945 extract1728 bvand46363
bvor30591 bvxor2344 bvadd49922 bvmul9
bvsub16371 bvsdiv28 bvult648 bvule658
bvslt221 bvsle126 bvshl16045 bvashr30286
zero_extend1531

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.71292 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.99111 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.98698 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.98704 —
abziz_portfolio_2012_solvers default unsat ✅ 0.98355 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.99083 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.95758 —
Boolector-SMT-COMP-2011 default unsat ✅ 1.10869 —
Boolector-SMT-COMP-2012 default unsat ✅ 1.01043 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 431.68300 —
CVC3-SMT-COMP-2011 default unsat ✅ 362.16500 —
CVC3-SMT-COMP-2012 default unsat ✅ 377.65300 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.65645 —
CVC4-SMT-EVAL-2013 default unsat ✅ 5.70724 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.32041 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.29656 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.65809 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.61871 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 1.16305 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 5.66860 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 8.29545 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.88292 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.74611 —
STP2-SMT-COMP-2012 default unsat ✅ 0.71599 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.75893 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 1.00917 —
Z3-SMT-COMP-2011 default unsat ✅ 0.97524 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 1.25205 1.25109
Boolector SMT17 final boolector unsat ✅ 1.27080 1.26839
CVC4 CVC4-smtcomp2017-main default unsat ✅ 5.72841 9.08537
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.84923 0.84891
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.83000 1.82761
Q3B Q3B default unsat ✅ 1.13617 3.04000
STP stp_st default unsat ✅ 0.84201 0.84107
stp_mt default unsat ✅ 0.90146 0.89068
Yices2 Yices2-Main default unsat ✅ 0.26560 0.26484
Z3 z3-4.5.0 default unsat ✅ 0.82504 0.82416
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 1.07494 1.07480
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 5.40662 5.40628
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.83853 0.83937
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.73953 1.73954
Minkeyrink ST_st unsat ✅ 1.74180 1.74141
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.83733 0.83733
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.83877 0.83878
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.95399 0.95405
Yices2 Yices 2.6.0_default unsat ✅ 0.25759 0.25753
Z3 z3-4.7.1_default unsat ✅ 0.94801 0.94783
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 2.15314 2.15302
Poolector-wrapped-sq_default unsat ✅ 2.50017 9.41000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.73562 1.73568
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 5.64933 5.64871
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 1.19126 1.19136
MinkeyRink ST-wrapped-sq_default unsat ✅ 1.19093 1.19101
Par4 Par4-wrapped-sq_default unsat ✅ 0.26743 0.00613
STP STP-2019-wrapped-sq_default unsat ✅ 0.82767 0.82776
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.82189 0.82199
stp-minisat-wrapped-sq_default unsat ✅ 0.83581 0.83595
stp-mt-wrapped-sq_default unsat ✅ 0.83414 0.83421
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.82147 0.82159
stp-riss-wrapped-sq_default unsat ✅ 0.83641 0.83652
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.26607 0.26606
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.26604 0.26602
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.26490 0.26490
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.25985 0.25981
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.26561 0.26561
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.90181 0.90167
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.69647 1.69640
Boolector Boolector-wrapped-sq_default unsat ✅ 2.11894 2.11890
Poolector-wrapped-sq_default unsat ✅ 2.48343 9.45000
CVC4 CVC4-sq-final_default unsat ✅ 7.33525 7.33577
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 1.06639 1.06274
MathSAT MathSAT5_default.sh unsat ✅ 0.85840 0.85829
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.99799 0.99802
MinkeyRink Solver 2020.3_default unsat ✅ 1.02261 1.02247
STP STP_default unsat ✅ 0.78624 0.78637
STP ++ Mergsat v1_default unsat ✅ 0.78406 0.78585
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.31467 0.31460
Z3 z3-4.8.8_default unsat ✅ 0.68261 0.68253
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.69056 1.69025
Bitwuzla-wrapped_default unsat ✅ 1.87869 1.87848
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 5.70164 5.70167
MathSAT MathSAT-5.6.8_default unsat ✅ 0.89830 0.89816
STP STP 2022.4_default unsat ✅ 0.86003 0.85994
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.31400 0.31384
Z3++BV z3++bv_0702_default unsat ✅ 0.52656 0.52628
Z3 z3-4.8.17_default unsat ✅ 0.54474 0.54652
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.59228 2.59126
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 4.30407 4.30239
STP STP 2022.4_default unsat ✅ 0.84995 0.84992
STP 2022.4_default unsat ✅ 0.84337 0.84338
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.07000 1331.41000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.30373 0.30368
Z3-Owl z3-Owl-Final_default unsat ✅ 1.51607 1.51592
z3-Owl-Final_default unsat ✅ 1.60020 1.60015
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.42348 1.32367
cvc5 cvc5 unsat ✅ 2.42085 2.32011
SMTInterpol SMTInterpol unknown ❌ 1202.74405 1442.45290
STP STP unsat ✅ 79.35553 79.25270
Yices2 Yices2 unsat ✅ 0.41533 0.31544
Z3alpha Z3-alpha unsat ✅ 0.64321 0.54347