Benchmark

non-incremental/QF_BV/sage/app1/bench_646.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size47432
Compressed Size5761
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 47424
Compressed Size5780
Max. Term Depth68
Asserts 1
Declared Functions0
Declared Constants280
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite27 not57 and1
=140 let58 extract1 bvand17
bvor168 bvadd250 bvsub72 bvult122
bvule264 bvshl169 bvashr5 zero_extend250

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.44 (5/9) 4Simp 4Simp-SMT-COMP-2012 default unknown ❌ — —
Abziz abziz_portfolio_2011_minfeatures_2 default unknown ❌ — —
abziz_portfolio_2011_solvers_2 default sat ✅ 2.68828 —
abziz_portfolio_2012_minfeatures default sat ✅ 2.77814 —
abziz_portfolio_2012_solvers default sat ✅ 2.71979 —
AbzizPortfolio-SMT-COMP-2012 default unknown ❌ — —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌ — —
Boolector-SMT-COMP-2011 default unknown ❌ — —
Boolector-SMT-COMP-2012 default unknown ❌ — —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 1.26608 —
CVC4-SMT-EVAL-2013 default sat ✅ 0.86314 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.81713 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unknown ❌ — —
MathSAT5-SMT-COMP-2011 default unknown ❌ — —
MathSAT5-SMT-COMP-2012 default unknown ❌ — —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌ — —
SONOLAR-SMT-COMP-2010 default unknown ❌ — —
SONOLAR-SMT-COMP-2011 default sat ✅ 0.79372 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.49535 —
STP STP2-SMT-COMP-2011 default sat ✅ 2.57127 —
STP2-SMT-COMP-2012 default unknown ❌ — —
simplifyingSTP-SMT-COMP-2010 default unknown ❌ — —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌ — —
Z3-SMT-COMP-2011 default unknown ❌ — —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 2.32155 2.32165
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 1.97260 3.90641
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 2.43122 4.83126
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 1.49461 1.49377
SMT-RAT SMT-RAT-final default sat ✅ 167.53400 167.57400
STP stp-cryptominisat4 default sat ✅ 5.13863 5.13922
stp-cmsat4-v15 default sat ✅ 9.51785 9.52055
stp-cmsat4-mt-v15 default unknown ❌ 0.38006 0.37894
stp-minisat-v15 default sat ✅ 1.78594 1.78473
Yices2 Yices default sat ✅ 0.02886 0.02799
Z3 z3 4.4.0 default sat ✅ 3.13149 3.13252
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 0.81351 0.81402
ABC_glucose glucose sat ✅ 6.08683 6.09067
Boolector Boolector boolector sat ✅ 1.69301 1.69412
Boolector preprop boolector sat ✅ 1.71214 1.71130
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 2.34153 4.65456
MapleSTP MapleSTP default sat ✅ 1.92844 1.92945
MapleSTP-mt default sat ✅ 1.79453 5.90642
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 1.50479 1.50733
MinkeyRink Minkeyrink 2016 default sat ✅ 2.11977 4.24815
Q3B Q3B default unknown ❌ 2400.02000 7204.22000
STP stp-cms-exp-2016 default sat ✅ 53.39920 53.40870
stp-cms-mt-2016 default sat ✅ 9.18785 35.41650
stp-cms-st-2016 default sat ✅ 8.47656 8.48140
stp-minisat-st-2016 default sat ✅ 28.98320 29.00240
Yices2 Yices-2.4.2 default sat ✅ 0.18933 0.18932
Z3 z3-4.4.1 default sat ✅ 2.64658 2.64931
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.32717 0.32451
Boolector SMT17 final boolector sat ✅ 1.72244 1.72176
CVC4 CVC4-smtcomp2017-main default sat ✅ 2.98651 5.90453
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 1.02417 1.02460
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.95495 0.94276
Q3B Q3B default unknown ❌ 600.02700 1799.39000
STP stp_st default sat ✅ 5.71410 5.70362
stp_mt default sat ✅ 5.15325 14.80320
Yices2 Yices2-Main default sat ✅ 0.03134 0.03125
Z3 z3-4.5.0 default sat ✅ 5.77279 5.77127
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.19182 0.19170
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 3.55468 3.55489
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 1.35605 1.35709
MinkeyRink Minkeyrink MT_mt sat ✅ 0.79927 2.42539
Minkeyrink ST_st sat ✅ 0.72672 0.72654
STP STP-CMS-st-2018_default-no-stderr sat ✅ 4.52617 4.52463
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 5.88706 18.18370
STP-Riss-st-2018_riss-no-stderr sat ✅ 4.41351 4.41371
Yices2 Yices 2.6.0_default sat ✅ 0.17755 0.17749
Z3 z3-4.7.1_default sat ✅ 3.74278 3.74275
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 0.30779 0.30778
Poolector-wrapped-sq_default sat ✅ 0.38289 0.34178
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 1.61825 1.61820
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 2.41390 2.41395
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.62435 1.75461
MinkeyRink ST-wrapped-sq_default sat ✅ 0.55647 0.55654
Par4 Par4-wrapped-sq_default sat ✅ 0.18890 0.00606
STP STP-2019-wrapped-sq_default sat ✅ 10.56010 10.56060
stp-mergesat-fixed-wrapped-sq_default sat ✅ 10.52780 10.52600
stp-minisat-wrapped-sq_default sat ✅ 2.58106 2.57996
stp-mt-wrapped-sq_default sat ✅ 5.70375 18.46720
stp-portfolio-fixed-wrapped-sq_default sat ✅ 11.56560 25.14810
stp-riss-wrapped-sq_default unknown ❌ 0.44883 0.44900
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.37103 0.37105
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.53045 0.53051
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 0.55984 0.55977
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 202.40000 202.34200
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.09729 0.09730
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 2.29179 2.29148
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.29325 0.29319
MathSAT mathsat-5.6.6_default sat ✅ 0.28979 0.28968
STP STP 2021.0_default sat ✅ 0.33099 0.73572
Z3 z3-4.8.11_default sat ✅ 2.10228 2.10230
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.54995 0.54990
Bitwuzla-wrapped_default sat ✅ 0.35065 0.35057
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 2.49313 2.49315
MathSAT MathSAT-5.6.8_default sat ✅ 0.48438 0.48417
STP STP 2022.4_default sat ✅ 0.30536 0.30518
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.38328 0.38315
Z3++BV z3++bv_0702_default sat ✅ 1.58467 1.58457
Z3 z3-4.8.17_default sat ✅ 1.76260 1.76415