Benchmark

non-incremental/QF_BV/sage/app12/bench_3600.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size21430
Compressed Size2604
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 21422
Compressed Size2617
Max. Term Depth39
Asserts 1
Declared Functions0
Declared Constants142
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite21 not59 and1
=112 let29 bvor66 bvadd73
bvsub54 bvult61 bvule53 bvshl66
zero_extend149

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 0.18586 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 0.15864 —
abziz_portfolio_2011_solvers_2 default sat ✅ 0.16636 —
abziz_portfolio_2012_minfeatures default sat ✅ 0.15610 —
abziz_portfolio_2012_solvers default sat ✅ 0.15751 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 0.16123 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 0.02973 —
Boolector-SMT-COMP-2011 default sat ✅ 2.74719 —
Boolector-SMT-COMP-2012 default sat ✅ 0.02690 —
CVC3 CVC3-SMT-COMP-2010 default sat ✅ 8.60789 —
CVC3-SMT-COMP-2011 default sat ✅ 7.65160 —
CVC3-SMT-COMP-2012 default sat ✅ 7.85713 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 0.14831 —
CVC4-SMT-EVAL-2013 default sat ✅ 17.45820 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.11169 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 0.59943 —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.10512 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.10850 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 0.09236 —
SONOLAR-SMT-COMP-2010 default sat ✅ 1.19007 —
SONOLAR-SMT-COMP-2011 default sat ✅ 0.12214 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.10482 —
STP STP2-SMT-COMP-2011 default sat ✅ 0.06535 —
STP2-SMT-COMP-2012 default sat ✅ 0.16822 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 0.23753 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.17742 —
Z3-SMT-COMP-2011 default sat ✅ 0.15049 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 5.13715 5.13622
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 0.39286 0.75888
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 0.46211 0.89886
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.30666 0.30595
SMT-RAT SMT-RAT-final default sat ✅ 145.68600 145.72800
STP stp-cryptominisat4 default sat ✅ 0.13751 0.13698
stp-cmsat4-v15 default sat ✅ 0.12750 0.12598
stp-cmsat4-mt-v15 default unknown ❌ 0.09760 0.09598
stp-minisat-v15 default sat ✅ 0.10867 0.10798
Yices2 Yices default sat ✅ 0.01286 0.01200
Z3 z3 4.4.0 default sat ✅ 0.16963 0.16997
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 4.72111 4.72366
ABC_glucose glucose sat ✅ 1.81045 1.81168
Boolector Boolector boolector sat ✅ 7.51748 7.52177
Boolector preprop boolector sat ✅ 7.33593 7.34015
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 0.24856 0.47388
MapleSTP MapleSTP default sat ✅ 0.23891 0.23902
MapleSTP-mt default sat ✅ 0.27079 0.71495
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.26152 0.26252
MinkeyRink Minkeyrink 2016 default sat ✅ 0.35790 0.56604
Q3B Q3B default unknown ❌ 2400.03000 7203.47000
STP stp-cms-exp-2016 default sat ✅ 0.27499 0.27418
stp-cms-mt-2016 default sat ✅ 0.26268 0.69740
stp-cms-st-2016 default sat ✅ 0.23739 0.23751
stp-minisat-st-2016 default sat ✅ 0.52134 0.52163
Yices2 Yices-2.4.2 default sat ✅ 0.01413 0.01408
Z3 z3-4.4.1 default sat ✅ 0.17219 0.17349
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 1.27999 1.27845
Boolector SMT17 final boolector sat ✅ 5.08799 5.08722
CVC4 CVC4-smtcomp2017-main default sat ✅ 0.30539 0.58493
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.58249 0.57976
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.17379 0.15918
Q3B Q3B default unknown ❌ 600.02700 1799.61000
STP stp_st default sat ✅ 1.12215 1.12268
stp_mt default sat ✅ 2.50188 3.51324
Yices2 Yices2-Main default sat ✅ 0.01368 0.01289
Z3 z3-4.5.0 default sat ✅ 0.49416 0.49436
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.56575 0.56572
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.51058 0.51063
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 0.25294 0.25399
MinkeyRink Minkeyrink MT_mt sat ✅ 0.08004 0.10965
Minkeyrink ST_st sat ✅ 0.07507 0.07524
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.25848 0.25839
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.28839 0.57216
STP-Riss-st-2018_riss-no-stderr sat ✅ 1.73551 1.73533
Yices2 Yices 2.6.0_default sat ✅ 0.01957 0.01498
Z3 z3-4.7.1_default sat ✅ 0.38468 0.38456
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 0.97045 0.97047
Poolector-wrapped-sq_default sat ✅ 0.58949 0.53296
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 1.37706 1.37702
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 0.18256 0.18282
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.07173 0.08703
MinkeyRink ST-wrapped-sq_default sat ✅ 0.06344 0.06351
Par4 Par4-wrapped-sq_default sat ✅ 0.02378 0.00685
STP STP-2019-wrapped-sq_default sat ✅ 0.24232 0.24268
stp-mergesat-fixed-wrapped-sq_default sat ✅ 5.22925 5.22914
stp-minisat-wrapped-sq_default sat ✅ 0.27528 0.27547
stp-mt-wrapped-sq_default sat ✅ 0.27067 0.47307
stp-portfolio-fixed-wrapped-sq_default sat ✅ 5.29583 5.52219
stp-riss-wrapped-sq_default unknown ❌ 0.19602 0.19620
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.01609 0.01608
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.03044 0.03043
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 0.07254 0.07256
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 0.19386 0.19387
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.03187 0.03189
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 0.29152 0.29153
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 0.12532 0.12380
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 0.17879 0.17932
STP STP 2022.4_default sat ✅ 0.08072 0.08076
STP 2022.4_default sat ✅ 0.08024 0.08031
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.12000 1248.86000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.01442 0.01436
Z3-Owl z3-Owl-Final_default sat ✅ 10.53310 10.53080
z3-Owl-Final_default sat ✅ 10.40850 10.40800