Benchmark

non-incremental/QF_BV/sage/app7/bench_1579.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1518326
Compressed Size112764
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1518318
Compressed Size112771
Max. Term Depth5792
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1580 and1
=2142 let5776 extract1233 bvand14779
bvor9578 bvxor1426 bvadd16332 bvmul1
bvsub5286 bvult432 bvule463 bvslt201
bvsle98 bvshl5120 bvashr9269 zero_extend945

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.21762 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.34012 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.34433 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.34516 —
abziz_portfolio_2012_solvers default unsat ✅ 0.34176 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.34535 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.29551 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.35539 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.30776 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 182.65300 —
CVC3-SMT-COMP-2011 default unsat ✅ 152.51500 —
CVC3-SMT-COMP-2012 default unsat ✅ 158.94200 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.22486 —
CVC4-SMT-EVAL-2013 default unsat ✅ 2.02406 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.46126 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.44247 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.57596 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.55755 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.40129 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 2.24787 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 2.74903 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.59104 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.22791 —
STP2-SMT-COMP-2012 default unsat ✅ 0.21920 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.21829 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.35793 —
Z3-SMT-COMP-2011 default unsat ✅ 0.33619 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.41126 0.40994
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 2.03904 3.33249
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 2.02994 3.32449
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.32870 0.32795
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2401.19000
STP stp-cryptominisat4 default unsat ✅ 0.20461 0.20297
stp-cmsat4-v15 default unsat ✅ 0.20386 0.20297
stp-cmsat4-mt-v15 default unsat ✅ 0.20301 0.20197
stp-minisat-v15 default unsat ✅ 0.20294 0.20197
Yices2 Yices default unsat ✅ 0.09181 0.09098
Z3 z3 4.4.0 default unsat ✅ 0.30586 0.30595
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.86421 0.86228
ABC_glucose glucose unsat ✅ 0.85513 0.85104
Boolector Boolector boolector unsat ✅ 0.49093 0.48951
Boolector preprop boolector unsat ✅ 0.44479 0.44503
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 2.19106 3.62766
MapleSTP MapleSTP default unsat ✅ 0.19301 0.19322
MapleSTP-mt default unsat ✅ 0.19789 0.19799
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.29420 0.29531
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.26409 0.26447
Q3B Q3B default unsat ✅ 0.50249 0.86962
STP stp-cms-exp-2016 default unsat ✅ 0.19800 0.19807
stp-cms-mt-2016 default unsat ✅ 0.20196 0.20203
stp-cms-st-2016 default unsat ✅ 0.20487 0.20417
stp-minisat-st-2016 default unsat ✅ 0.20212 0.20221
Yices2 Yices-2.4.2 default unsat ✅ 0.09052 0.09051
Z3 z3-4.4.1 default unsat ✅ 0.25183 0.25321
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.37913 0.37788
Boolector SMT17 final boolector unsat ✅ 0.41897 0.41823
CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.12606 3.45227
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.30130 0.30147
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.60162 0.60086
Q3B Q3B default unsat ✅ 0.50269 1.22888
STP stp_st default unsat ✅ 0.27496 0.27409
stp_mt default unsat ✅ 0.28681 0.28610
Yices2 Yices2-Main default unsat ✅ 0.08656 0.08581
Z3 z3-4.5.0 default unsat ✅ 0.37418 0.37284
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.34156 0.34131
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.82803 1.82812
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.29139 0.29229
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.59703 0.59705
Minkeyrink ST_st unsat ✅ 0.59725 0.59726
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.24976 0.24971
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.25009 0.24991
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.25001 0.25005
Yices2 Yices 2.6.0_default unsat ✅ 0.08426 0.08403
Z3 z3-4.7.1_default unsat ✅ 0.33339 0.33309
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.65612 0.65606
Poolector-wrapped-sq_default unsat ✅ 0.89002 3.01403
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.53481 0.53483
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.88179 1.88200
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.44760 0.44771
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.44727 0.44727
Par4 Par4-wrapped-sq_default unsat ✅ 0.10448 0.00618
STP STP-2019-wrapped-sq_default unsat ✅ 0.25719 0.25735
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.25666 0.25684
stp-minisat-wrapped-sq_default unsat ✅ 0.25928 0.25941
stp-mt-wrapped-sq_default unsat ✅ 0.25737 0.25753
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.25628 0.25641
stp-riss-wrapped-sq_default unsat ✅ 0.25969 0.25987
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.08831 0.08829
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.08694 0.08693
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.08723 0.08723
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.08644 0.08643
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.08782 0.08782
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.27094 0.27095
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.52197 0.52191
MathSAT mathsat-5.6.6_default unsat ✅ 0.31262 0.31260
STP STP 2021.0_default unsat ✅ 0.24610 0.24619
Z3 z3-4.8.11_default unsat ✅ 0.27879 0.27870
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.51982 0.51969
Bitwuzla-wrapped_default unsat ✅ 0.55266 0.55259
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 1.90509 1.90451
MathSAT MathSAT-5.6.8_default unsat ✅ 0.32106 0.32098
STP STP 2022.4_default unsat ✅ 0.26259 0.26259
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.10382 0.10379
Z3++BV z3++bv_0702_default unsat ✅ 0.25384 0.25376
Z3 z3-4.8.17_default unsat ✅ 0.24535 0.24722
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.83971 0.83368
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.38117 1.38175
STP STP 2022.4_default unsat ✅ 0.26380 0.26379
STP 2022.4_default unsat ✅ 0.26045 0.26050
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 453.03100 515.02600
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.10029 0.10025
Z3-Owl z3-Owl-Final_default unsat ✅ 0.88989 0.88976
z3-Owl-Final_default unsat ✅ 0.92164 0.92177
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.64124 0.54110
cvc5 cvc5 unsat ✅ 0.78011 0.68091
SMTInterpol SMTInterpol unsat ✅ 957.67448 1381.28141
STP STP unsat ✅ 6.69297 6.59283
Yices2 Yices2 unsat ✅ 0.28296 0.18332
Z3alpha Z3-alpha unsat ✅ 0.46867 0.36929