Benchmark

non-incremental/QF_BV/sage/app7/bench_954.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size2522604
Compressed Size162830
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 2522596
Compressed Size162838
Max. Term Depth9688
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1786 and1
=2401 let9589 extract1307 bvand25973
bvor17044 bvxor1554 bvadd27751 bvmul1
bvsub8979 bvult444 bvule490 bvslt206
bvsle104 bvshl8805 bvashr16599 zero_extend1027

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.38203 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.40660 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.40802 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.41990 —
abziz_portfolio_2012_solvers default unsat ✅ 0.40708 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.40896 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.51214 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.59949 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.54561 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 266.14400 —
CVC3-SMT-COMP-2011 default unsat ✅ 222.90300 —
CVC3-SMT-COMP-2012 default unsat ✅ 232.50100 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.09118 —
CVC4-SMT-EVAL-2013 default unsat ✅ 3.25205 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.77282 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.73735 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.95672 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.92547 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.66302 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.19638 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 4.71334 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.03612 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.40775 —
STP2-SMT-COMP-2012 default unsat ✅ 0.37833 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.40333 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.47011 —
Z3-SMT-COMP-2011 default unsat ✅ 0.40422 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.73219 0.73189
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 3.30785 5.34219
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 3.29512 5.33219
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.51455 0.51392
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.78000
STP stp-cryptominisat4 default unsat ✅ 0.35888 0.35795
stp-cmsat4-v15 default unsat ✅ 0.35770 0.35694
stp-cmsat4-mt-v15 default unsat ✅ 0.35825 0.35694
stp-minisat-v15 default unsat ✅ 0.35665 0.35595
Yices2 Yices default unsat ✅ 0.14616 0.14498
Z3 z3 4.4.0 default unsat ✅ 0.44187 0.44193
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.43722 1.43769
ABC_glucose glucose unsat ✅ 1.42907 1.43010
Boolector Boolector boolector unsat ✅ 0.83237 0.83288
Boolector preprop boolector unsat ✅ 0.81326 0.81376
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 3.23249 5.23198
MapleSTP MapleSTP default unsat ✅ 0.34255 0.34269
MapleSTP-mt default unsat ✅ 0.34232 0.34248
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.46719 0.46846
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.47765 0.47802
Q3B Q3B default unsat ✅ 0.70037 1.55000
STP stp-cms-exp-2016 default unsat ✅ 0.35380 0.35396
stp-cms-mt-2016 default unsat ✅ 0.35680 0.35696
stp-cms-st-2016 default unsat ✅ 0.35485 0.35502
stp-minisat-st-2016 default unsat ✅ 0.35474 0.35487
Yices2 Yices-2.4.2 default unsat ✅ 0.14683 0.14688
Z3 z3-4.4.1 default unsat ✅ 0.38101 0.38256
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.66376 0.66276
Boolector SMT17 final boolector unsat ✅ 0.68932 0.68749
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.25767 5.20885
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.47741 0.47817
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.99721 0.99632
Q3B Q3B default unsat ✅ 0.66974 1.55000
STP stp_st default unsat ✅ 0.46588 0.46612
stp_mt default unsat ✅ 0.43311 0.43290
Yices2 Yices2-Main default unsat ✅ 0.14065 0.13977
Z3 z3-4.5.0 default unsat ✅ 0.39497 0.39363
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.61406 0.61293
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.99487 2.99479
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.46323 0.46429
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.97897 0.97855
Minkeyrink ST_st unsat ✅ 0.97026 0.97026
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.44346 0.44344
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.48462 0.48471
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.44230 0.44239
Yices2 Yices 2.6.0_default unsat ✅ 0.13412 0.13400
Z3 z3-4.7.1_default unsat ✅ 0.39267 0.39253
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.13131 1.13127
Poolector-wrapped-sq_default unsat ✅ 1.41741 5.11933
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.92588 0.92584
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 3.14036 3.14055
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.69161 0.69170
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.69320 0.69299
Par4 Par4-wrapped-sq_default unsat ✅ 0.14488 0.00583
STP STP-2019-wrapped-sq_default unsat ✅ 0.44905 0.44911
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.46105 0.46121
stp-minisat-wrapped-sq_default unsat ✅ 0.44752 0.44769
stp-mt-wrapped-sq_default unsat ✅ 0.46667 0.46679
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.44432 0.44442
stp-riss-wrapped-sq_default unsat ✅ 0.44678 0.44687
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.13938 0.13936
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.13924 0.13922
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.13738 0.13735
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.15617 0.13773
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.13927 0.13925
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.59920 0.59918
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.93506 0.93484
Boolector Boolector-wrapped-sq_default unsat ✅ 1.13064 1.13053
Poolector-wrapped-sq_default unsat ✅ 1.38035 5.11008
CVC4 CVC4-sq-final_default unsat ✅ 4.13250 4.13237
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.59069 0.59058
MathSAT MathSAT5_default.sh unsat ✅ 0.47786 0.47777
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.57029 0.57043
MinkeyRink Solver 2020.3_default unsat ✅ 0.59157 0.59167
STP STP_default unsat ✅ 0.42015 0.42024
STP ++ Mergsat v1_default unsat ✅ 0.41688 0.41865
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.16582 0.16578
Z3 z3-4.8.8_default unsat ✅ 0.43866 0.43862
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.36011 1.35998
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 2.34223 2.33728
STP STP 2022.4_default unsat ✅ 0.48088 0.48089
STP 2022.4_default unsat ✅ 0.45861 0.45864
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 612.26500 700.70100
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.16235 0.16233
Z3-Owl z3-Owl-Final_default unsat ✅ 0.92888 0.92878
z3-Owl-Final_default unsat ✅ 0.93166 0.93195
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 0.96026 0.86017
cvc5 cvc5 unsat ✅ 0.73223 0.63173
SMTInterpol SMTInterpol unknown ❌ 1202.76848 1653.81824
STP STP unsat ✅ 20.46465 20.36411
Yices2 Yices2 unsat ✅ 0.31951 0.21949
Z3alpha Z3-alpha unsat ✅ 0.45955 0.35992