Benchmark

non-incremental/QF_BV/sage/app12/bench_5329.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size60183
Compressed Size8233
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 60175
Compressed Size8243
Max. Term Depth57
Asserts 1
Declared Functions0
Declared Constants332
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite41 not251 and1
=445 let47 bvor156 bvadd171
bvsub233 bvult169 bvule151 bvslt40
bvsle40 bvshl164 zero_extend340

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 0.39011 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 0.31291 —
abziz_portfolio_2011_solvers_2 default sat ✅ 0.31088 —
abziz_portfolio_2012_minfeatures default sat ✅ 0.31284 —
abziz_portfolio_2012_solvers default sat ✅ 0.31528 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 0.32189 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 3.04713 —
Boolector-SMT-COMP-2011 default sat ✅ 2.59806 —
Boolector-SMT-COMP-2012 default sat ✅ 1.43448 —
CVC3 CVC3-SMT-COMP-2010 default sat ✅ 9.97325 —
CVC3-SMT-COMP-2011 default sat ✅ 8.91987 —
CVC3-SMT-COMP-2012 default sat ✅ 9.17338 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 0.28012 —
CVC4-SMT-EVAL-2013 default sat ✅ 17.47200 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.65559 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 0.93198 —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.13913 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.77963 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 0.11368 —
SONOLAR-SMT-COMP-2010 default sat ✅ 1.36983 —
SONOLAR-SMT-COMP-2011 default sat ✅ 0.56339 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.12331 —
STP STP2-SMT-COMP-2011 default sat ✅ 0.09375 —
STP2-SMT-COMP-2012 default sat ✅ 0.15096 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 0.34378 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.31792 —
Z3-SMT-COMP-2011 default sat ✅ 0.30458 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 4.12753 4.12837
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 0.62687 1.20581
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 0.69011 1.33480
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.67496 0.67390
SMT-RAT SMT-RAT-final default sat ✅ 171.23800 171.27900
STP stp-cryptominisat4 default sat ✅ 0.11413 0.11298
stp-cmsat4-v15 default sat ✅ 0.13229 0.13098
stp-cmsat4-mt-v15 default unknown ❌ 0.11264 0.11098
stp-minisat-v15 default sat ✅ 0.12592 0.12498
Yices2 Yices default sat ✅ 0.01758 0.01700
Z3 z3 4.4.0 default sat ✅ 0.17087 0.17097
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 29.03290 29.05170
ABC_glucose glucose sat ✅ 4.79597 4.79915
Boolector Boolector boolector sat ✅ 3.53962 3.54132
Boolector preprop boolector sat ✅ 3.45442 3.45623
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 0.61276 1.18372
MapleSTP MapleSTP default sat ✅ 0.21408 0.21412
MapleSTP-mt default sat ✅ 0.22403 0.51417
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.73753 0.73860
MinkeyRink Minkeyrink 2016 default sat ✅ 0.26458 0.36723
Q3B Q3B default unknown ❌ 2400.02000 7204.37000
STP stp-cms-exp-2016 default sat ✅ 0.23718 0.23727
stp-cms-mt-2016 default sat ✅ 0.22609 0.51993
stp-cms-st-2016 default sat ✅ 0.20846 0.20848
stp-minisat-st-2016 default sat ✅ 0.80865 0.80902
Yices2 Yices-2.4.2 default sat ✅ 0.02138 0.02134
Z3 z3-4.4.1 default sat ✅ 0.15758 0.15885
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 1.41113 1.41053
Boolector SMT17 final boolector sat ✅ 7.15221 7.15101
CVC4 CVC4-smtcomp2017-main default sat ✅ 0.63413 1.22436
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.86609 0.86036
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.13185 0.11573
Q3B Q3B default unknown ❌ 600.05800 1786.29000
STP stp_st default sat ✅ 0.34058 0.33946
stp_mt default sat ✅ 0.43182 0.78112
Yices2 Yices2-Main default sat ✅ 0.02404 0.02301
Z3 z3-4.5.0 default sat ✅ 0.53312 0.53088
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.49041 0.49035
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.77252 0.77253
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 0.64500 0.64584
MinkeyRink Minkeyrink MT_mt sat ✅ 0.08575 0.09576
Minkeyrink ST_st sat ✅ 0.08344 0.08361
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.57330 0.57333
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.62119 1.05460
STP-Riss-st-2018_riss-no-stderr sat ✅ 1.55147 1.54791
Yices2 Yices 2.6.0_default sat ✅ 0.02073 0.02064
Z3 z3-4.7.1_default sat ✅ 0.40335 0.40324
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 0.29465 0.19470
cvc5 cvc5 sat ✅ 0.62786 0.52824
SMTInterpol SMTInterpol unknown ❌ 1201.71962 1234.63148
STP STP sat ✅ 0.27286 0.17301
Yices2 Yices2 sat ✅ 0.28364 0.18358
Z3alpha Z3-alpha sat ✅ 0.39150 0.29188