Benchmark

non-incremental/QF_BV/sage/app12/bench_1218.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size32030
Compressed Size4325
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status unsat
Size 32022
Compressed Size4336
Max. Term Depth46
Asserts 1
Declared Functions0
Declared Constants192
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite25 not113 and1
=204 let36 bvor88 bvadd102
bvsub93 bvult100 bvule81 bvslt15
bvsle13 bvshl89 zero_extend200

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.25407 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.15120 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.15138 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.13559 —
abziz_portfolio_2012_solvers default unsat ✅ 0.13983 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.13754 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.03737 —
Boolector-SMT-COMP-2011 default unsat ✅ 2.48881 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.03033 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 10.17500 —
CVC3-SMT-COMP-2011 default unsat ✅ 9.12208 —
CVC3-SMT-COMP-2012 default unsat ✅ 9.31884 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.20488 —
CVC4-SMT-EVAL-2013 default unsat ✅ 17.16280 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.49905 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.63289 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.15723 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.52228 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.09287 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 1.17053 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.22610 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.09994 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.07211 —
STP2-SMT-COMP-2012 default unsat ✅ 0.13244 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.31436 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.14350 —
Z3-SMT-COMP-2011 default unsat ✅ 0.13230 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 3.90400 3.90441
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 0.43334 0.83487
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 0.49500 0.96085
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.53883 0.53792
SMT-RAT SMT-RAT-final default sat ✅ 142.95700 143.01400
STP stp-cryptominisat4 default sat ✅ 0.11469 0.11398
stp-cmsat4-v15 default sat ✅ 0.12400 0.12298
stp-cmsat4-mt-v15 default unknown ❌ 0.09690 0.09598
stp-minisat-v15 default sat ✅ 0.09960 0.09898
Yices2 Yices default sat ✅ 0.01373 0.01300
Z3 z3 4.4.0 default sat ✅ 0.15247 0.15198
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 0.30035 0.30024
ABC_glucose glucose sat ✅ 2.35545 2.35710
Boolector Boolector boolector sat ✅ 3.38478 3.38670
Boolector preprop boolector sat ✅ 3.31072 6.49406
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 0.49350 0.95884
MapleSTP MapleSTP default sat ✅ 0.24111 0.24124
MapleSTP-mt default sat ✅ 0.21444 0.52651
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.54838 0.54972
MinkeyRink Minkeyrink 2016 default sat ✅ 0.27423 0.41611
Q3B Q3B default unknown ❌ 2400.03000 7202.61000
STP stp-cms-exp-2016 default sat ✅ 0.23245 0.23253
stp-cms-mt-2016 default sat ✅ 0.22093 0.56113
stp-cms-st-2016 default sat ✅ 0.20269 0.20277
stp-minisat-st-2016 default sat ✅ 0.61233 0.61246
Yices2 Yices-2.4.2 default sat ✅ 0.01450 0.01483
Z3 z3-4.4.1 default sat ✅ 0.16149 0.16287
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 1.26969 1.26889
Boolector SMT17 final boolector sat ✅ 3.05218 3.05209
CVC4 CVC4-smtcomp2017-main default sat ✅ 0.40841 0.78620
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.56196 0.56290
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.17144 0.12543
Q3B Q3B default unknown ❌ 600.06200 1788.25000
STP stp_st default sat ✅ 0.43094 0.42890
stp_mt default sat ✅ 0.58056 1.11749
Yices2 Yices2-Main default sat ✅ 0.02093 0.01555
Z3 z3-4.5.0 default sat ✅ 0.44385 0.44272
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.55476 0.55462
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.60509 0.60525
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 0.56147 0.56228
MinkeyRink Minkeyrink MT_mt sat ✅ 0.07224 0.08602
Minkeyrink ST_st sat ✅ 0.06876 0.06894
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.47470 0.47452
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.54056 1.04799
STP-Riss-st-2018_riss-no-stderr sat ✅ 1.29914 1.29932
Yices2 Yices 2.6.0_default sat ✅ 0.01599 0.01594
Z3 z3-4.7.1_default sat ✅ 0.39006 0.38997
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 0.94654 0.94631
Boolector Boolector-wrapped-sq_default sat ✅ 0.63286 0.63283
Poolector-wrapped-sq_default sat ✅ 0.68930 2.28000
CVC4 CVC4-sq-final_default sat ✅ 0.28216 0.28242
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.05000 1199.96000
MathSAT MathSAT5_default.sh sat ✅ 0.16481 0.16476
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.06331 0.06355
MinkeyRink Solver 2020.3_default sat ✅ 0.06766 0.07851
STP STP_default sat ✅ 0.12025 0.19686
STP ++ Mergsat v1_default sat ✅ 0.17519 0.17693
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.03746 0.03740
Z3 z3-4.8.8_default sat ✅ 0.40563 0.40559
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 0.29695 0.19694
cvc5 cvc5 sat ✅ 0.41300 0.31342
SMTInterpol SMTInterpol unknown ❌ 1201.74971 1231.28935
STP STP sat ✅ 0.41735 0.31663
Yices2 Yices2 sat ✅ 0.21872 0.11898
Z3alpha Z3-alpha sat ✅ 0.41897 0.31928