Benchmark

non-incremental/QF_BV/sage/app12/bench_47.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size50246
Compressed Size6918
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 50238
Compressed Size6920
Max. Term Depth52
Asserts 1
Declared Functions0
Declared Constants284
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite35 not202 and1
=360 let42 bvor132 bvadd145
bvsub184 bvult146 bvule129 bvslt29
bvsle28 bvshl137 zero_extend292

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 0.34459 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 0.28000 —
abziz_portfolio_2011_solvers_2 default sat ✅ 0.28107 —
abziz_portfolio_2012_minfeatures default sat ✅ 0.28245 —
abziz_portfolio_2012_solvers default sat ✅ 0.28411 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 0.28352 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 5.21602 —
Boolector-SMT-COMP-2011 default sat ✅ 2.56106 —
Boolector-SMT-COMP-2012 default sat ✅ 0.03712 —
CVC3 CVC3-SMT-COMP-2010 default sat ✅ 14.40580 —
CVC3-SMT-COMP-2011 default sat ✅ 12.85910 —
CVC3-SMT-COMP-2012 default sat ✅ 13.16670 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 0.25467 —
CVC4-SMT-EVAL-2013 default sat ✅ 17.24490 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.60183 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 0.82305 —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.14092 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.15156 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 0.10093 —
SONOLAR-SMT-COMP-2010 default sat ✅ 1.32470 —
SONOLAR-SMT-COMP-2011 default sat ✅ 0.43335 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.11758 —
STP STP2-SMT-COMP-2011 default sat ✅ 0.08657 —
STP2-SMT-COMP-2012 default sat ✅ 0.14387 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 0.35606 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.29800 —
Z3-SMT-COMP-2011 default sat ✅ 0.27472 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 3.30033 3.30050
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 0.54246 1.04384
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 0.60646 1.17282
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.52806 0.52692
SMT-RAT SMT-RAT-final default sat ✅ 168.14700 168.20500
STP stp-cryptominisat4 default sat ✅ 0.13409 0.13298
stp-cmsat4-v15 default sat ✅ 0.13132 0.12998
stp-cmsat4-mt-v15 default unknown ❌ 0.10791 0.10698
stp-minisat-v15 default sat ✅ 0.11052 0.10998
Yices2 Yices default sat ✅ 0.01559 0.01500
Z3 z3 4.4.0 default sat ✅ 0.18451 0.18397
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 20.35900 20.37090
ABC_glucose glucose sat ✅ 3.88322 3.88463
Boolector Boolector boolector sat ✅ 2.88523 2.88661
Boolector preprop boolector sat ✅ 2.80180 2.80352
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 0.65049 1.26110
MapleSTP MapleSTP default sat ✅ 0.21287 0.21243
MapleSTP-mt default sat ✅ 0.22948 0.53185
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.68874 0.69038
MinkeyRink Minkeyrink 2016 default sat ✅ 0.28892 0.42481
Q3B Q3B default unknown ❌ 2400.02000 7203.85000
STP stp-cms-exp-2016 default sat ✅ 0.23947 0.23957
stp-cms-mt-2016 default sat ✅ 0.23579 0.54303
stp-cms-st-2016 default sat ✅ 0.22029 0.22035
stp-minisat-st-2016 default sat ✅ 0.39550 0.39570
Yices2 Yices-2.4.2 default sat ✅ 0.01749 0.01745
Z3 z3-4.4.1 default sat ✅ 0.30443 0.30569
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 1.43171 1.42730
Boolector SMT17 final boolector sat ✅ 4.19252 4.19060
CVC4 CVC4-smtcomp2017-main default sat ✅ 0.74417 1.42443
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.69688 0.69678
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.13038 0.12756
Q3B Q3B default unknown ❌ 600.06000 1427.43000
STP stp_st default sat ✅ 1.03415 1.03342
stp_mt default sat ✅ 1.55110 3.39481
Yices2 Yices2-Main default sat ✅ 0.01697 0.01611
Z3 z3-4.5.0 default sat ✅ 0.52260 0.52185
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.52758 0.52752
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.71668 0.71684
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 0.58084 0.58173
MinkeyRink Minkeyrink MT_mt sat ✅ 0.08747 0.10068
Minkeyrink ST_st sat ✅ 0.08077 0.08096
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.47790 0.47770
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.54263 0.92554
STP-Riss-st-2018_riss-no-stderr sat ✅ 1.37609 1.37615
Yices2 Yices 2.6.0_default sat ✅ 0.01741 0.01734
Z3 z3-4.7.1_default sat ✅ 0.45354 0.45345
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 0.74925 0.74917
Poolector-wrapped-sq_default sat ✅ 0.59097 0.55692
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 1.37414 1.37405
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 0.35848 0.35867
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.08776 0.09768
MinkeyRink ST-wrapped-sq_default sat ✅ 0.08164 0.08174
Par4 Par4-wrapped-sq_default sat ✅ 0.02581 0.00585
STP STP-2019-wrapped-sq_default sat ✅ 0.24894 0.23696
stp-mergesat-fixed-wrapped-sq_default sat ✅ 0.34128 0.32955
stp-minisat-wrapped-sq_default sat ✅ 0.28345 0.28365
stp-mt-wrapped-sq_default sat ✅ 0.24921 0.31547
stp-portfolio-fixed-wrapped-sq_default sat ✅ 0.37345 0.53126
stp-riss-wrapped-sq_default unknown ❌ 0.22744 0.22768
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.01924 0.01924
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.03544 0.03546
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 0.08198 0.08199
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 0.45450 0.45450
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.03335 0.03334
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 0.47968 0.47963
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.97407 0.97314
Bitwuzla-wrapped_default sat ✅ 0.11340 0.11334
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 0.33563 0.33240
MathSAT MathSAT-5.6.8_default sat ✅ 0.60272 0.60108
STP STP 2022.4_default sat ✅ 0.08569 0.08572
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.04119 0.04113
Z3++BV z3++bv_0702_default sat ✅ 0.13470 0.13465
Z3 z3-4.8.17_default sat ✅ 0.47923 0.48102