Benchmark

non-incremental/QF_BV/sage/app7/bench_8391.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3337987
Compressed Size214026
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3337979
Compressed Size214031
Max. Term Depth12857
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not2296 and1
=3007 let12752 extract1667 bvand34173
bvor22417 bvxor2174 bvadd36883 bvmul7
bvsub11979 bvsdiv19 bvult563 bvule604
bvslt218 bvsle124 bvshl11793 bvashr22031
zero_extend1468

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.49371
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.74815
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.74081
abziz_portfolio_2012_minfeatures default unsat ✅ 0.75376
abziz_portfolio_2012_solvers default unsat ✅ 0.74283
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.74841
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.66634
Boolector-SMT-COMP-2011 default unsat ✅ 0.81266
Boolector-SMT-COMP-2012 default unsat ✅ 0.70478
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 355.43400
CVC3-SMT-COMP-2011 default unsat ✅ 297.26700
CVC3-SMT-COMP-2012 default unsat ✅ 310.14100
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.79567
CVC4-SMT-EVAL-2013 default unsat ✅ 4.52862
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.99110
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.95486
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.24069
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.21723
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.86483
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.11420
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.18675
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.35057
STP STP2-SMT-COMP-2011 default unsat ✅ 0.53243
STP2-SMT-COMP-2012 default unsat ✅ 0.49908
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.52240
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.76788
Z3-SMT-COMP-2011 default unsat ✅ 0.74548
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 1.18316 0.97113
Boolector SMT17 final boolector unsat ✅ 0.95484 0.94730
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.66501 7.49056
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.66236 0.66265
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.35942 1.34557
Q3B Q3B default unsat ✅ 0.87528 2.24000
STP stp_st default unsat ✅ 0.96275 0.65970
stp_mt default unsat ✅ 1.10441 0.67911
Yices2 Yices2-Main default unsat ✅ 0.20892 0.20770
Z3 z3-4.5.0 default unsat ✅ 0.73361 0.73364
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.79794 0.79782
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 4.57440 4.57438
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.63400 0.63506
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.28808 1.28809
Minkeyrink ST_st unsat ✅ 1.29222 1.29234
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.58092 0.58086
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.58122 0.58132
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.58167 0.58170
Yices2 Yices 2.6.0_default unsat ✅ 0.19965 0.19952
Z3 z3-4.7.1_default unsat ✅ 0.77502 0.77483
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.56462 1.56461
Poolector-wrapped-sq_default unsat ✅ 1.90279 7.02905
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.26675 1.26674
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 4.17382 4.17312
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.92094 0.92100
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.91776 0.91778
Par4 Par4-wrapped-sq_default unsat ✅ 0.21363 0.00632
STP STP-2019-wrapped-sq_default unsat ✅ 0.59070 0.59080
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.58503 0.58515
stp-minisat-wrapped-sq_default unsat ✅ 0.58907 0.58921
stp-mt-wrapped-sq_default unsat ✅ 0.59290 0.59305
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.58512 0.58512
stp-riss-wrapped-sq_default unsat ✅ 0.59204 0.59221
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.21098 0.21091
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.21008 0.21006
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.20919 0.20920
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.20687 0.20682
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.21241 0.21240
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.76058 0.76050
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.25413 1.25403
MathSAT mathsat-5.6.6_default unsat ✅ 0.69326 0.69319
STP STP 2021.0_default unsat ✅ 0.56789 0.56796
Z3 z3-4.8.11_default unsat ✅ 0.45265 0.45261
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.23254 1.23233
Bitwuzla-wrapped_default unsat ✅ 1.32693 1.32682
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.25558 4.25602
MathSAT MathSAT-5.6.8_default unsat ✅ 0.67815 0.67803
STP STP 2022.4_default unsat ✅ 0.60632 0.60630
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.24339 0.24327
Z3++BV z3++bv_0702_default unsat ✅ 0.71826 0.71823
Z3 z3-4.8.17_default unsat ✅ 0.66574 0.66748