Benchmark

non-incremental/QF_BV/sage/app1/bench_1244.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size24237
Compressed Size3276
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 24229
Compressed Size3287
Max. Term Depth53
Asserts 1
Declared Functions0
Declared Constants120
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite23 not37 and1
=66 let43 bvor72 bvadd104
bvsub57 bvult100 bvule152 bvshl73
bvashr3 zero_extend122

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 0.28339 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 0.10563 —
abziz_portfolio_2011_solvers_2 default sat ✅ 0.11542 —
abziz_portfolio_2012_minfeatures default sat ✅ 0.11518 —
abziz_portfolio_2012_solvers default sat ✅ 0.10866 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 0.11271 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 0.03074 —
Boolector-SMT-COMP-2011 default sat ✅ 0.96189 —
Boolector-SMT-COMP-2012 default sat ✅ 0.03394 —
CVC3 CVC3-SMT-COMP-2010 default sat ✅ 2.64976 —
CVC3-SMT-COMP-2011 default sat ✅ 2.55890 —
CVC3-SMT-COMP-2012 default sat ✅ 2.56899 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 0.13588 —
CVC4-SMT-EVAL-2013 default sat ✅ 0.17450 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.11285 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 0.38659 —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.12164 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.11700 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 0.10497 —
SONOLAR-SMT-COMP-2010 default sat ✅ 0.42643 —
SONOLAR-SMT-COMP-2011 default sat ✅ 0.19778 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.10294 —
STP STP2-SMT-COMP-2011 default sat ✅ 0.17050 —
STP2-SMT-COMP-2012 default sat ✅ 0.30791 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 0.24313 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.10892 —
Z3-SMT-COMP-2011 default sat ✅ 0.10039 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 0.19879 0.19797
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 0.37093 0.71489
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 0.39754 0.76888
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.21199 0.21097
SMT-RAT SMT-RAT-final default sat ✅ 32.45490 32.46110
STP stp-cryptominisat4 default sat ✅ 0.48827 0.48692
stp-cmsat4-v15 default sat ✅ 0.40879 0.40794
stp-cmsat4-mt-v15 default unknown ❌ 0.16022 0.15898
stp-minisat-v15 default sat ✅ 0.23209 0.23096
Yices2 Yices default sat ✅ 0.01352 0.01300
Z3 z3 4.4.0 default sat ✅ 0.29028 0.28996
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 0.24129 0.24092
ABC_glucose glucose sat ✅ 2.34025 2.34097
Boolector Boolector boolector sat ✅ 0.32506 0.32512
Boolector preprop boolector sat ✅ 0.33325 0.33337
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 0.43385 0.83973
MapleSTP MapleSTP default sat ✅ 0.22335 0.22332
MapleSTP-mt default sat ✅ 0.26228 0.59327
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.26315 0.26430
MinkeyRink Minkeyrink 2016 default sat ✅ 0.63824 0.83305
Q3B Q3B default unknown ❌ 2400.03000 7202.64000
STP stp-cms-exp-2016 default sat ✅ 0.28720 0.28734
stp-cms-mt-2016 default sat ✅ 0.28529 0.68221
stp-cms-st-2016 default sat ✅ 0.24612 0.24621
stp-minisat-st-2016 default sat ✅ 1.04460 1.04515
Yices2 Yices-2.4.2 default sat ✅ 0.01509 0.01504
Z3 z3-4.4.1 default sat ✅ 0.28340 0.28495
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.10571 0.10524
Boolector SMT17 final boolector sat ✅ 0.37496 0.36871
CVC4 CVC4-smtcomp2017-main default sat ✅ 0.35778 0.68720
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.19885 0.19922
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.21661 0.18962
Q3B Q3B default unknown ❌ 600.02700 1799.53000
STP stp_st default sat ✅ 0.30020 0.29916
stp_mt default sat ✅ 0.40036 0.69673
Yices2 Yices2-Main default sat ✅ 0.01659 0.01524
Z3 z3-4.5.0 default sat ✅ 0.29031 0.28879
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.09012 0.09003
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.47966 0.47969
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 0.20567 0.20655
MinkeyRink Minkeyrink MT_mt sat ✅ 0.12991 0.17943
Minkeyrink ST_st sat ✅ 0.12252 0.12255
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.25229 0.25231
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.27984 0.60118
STP-Riss-st-2018_riss-no-stderr sat ✅ 4.58190 4.58162
Yices2 Yices 2.6.0_default sat ✅ 0.01708 0.01705
Z3 z3-4.7.1_default sat ✅ 0.24550 0.24546
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 0.12121 0.12120
Poolector-wrapped-sq_default sat ✅ 0.18001 0.14860
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 0.33025 0.33022
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 0.27176 0.27200
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.12895 0.17778
MinkeyRink ST-wrapped-sq_default sat ✅ 0.11742 0.11751
Par4 Par4-wrapped-sq_default sat ✅ 0.02589 0.00600
STP STP-2019-wrapped-sq_default sat ✅ 0.21062 0.21097
stp-mergesat-fixed-wrapped-sq_default sat ✅ 4.95773 4.95790
stp-minisat-wrapped-sq_default sat ✅ 0.23572 0.23591
stp-mt-wrapped-sq_default sat ✅ 0.23174 0.35731
stp-portfolio-fixed-wrapped-sq_default sat ✅ 3.52034 3.66052
stp-riss-wrapped-sq_default unknown ❌ 0.18297 0.18302
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.02036 0.02036
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.02845 0.02847
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 0.05629 0.05631
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 0.09382 0.09378
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.04090 0.04090
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 0.26581 0.26575
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 0.14367 0.14358
Boolector Boolector-wrapped-sq_default sat ✅ 0.12929 0.12932
Poolector-wrapped-sq_default sat ✅ 0.18374 0.15668
CVC4 CVC4-sq-final_default sat ✅ 0.24534 0.24570
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.06000 1199.94000
MathSAT MathSAT5_default.sh sat ✅ 0.09190 0.09187
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.12047 0.12069
MinkeyRink Solver 2020.3_default sat ✅ 0.13023 0.16116
STP STP_default sat ✅ 0.10413 0.14531
STP ++ Mergsat v1_default sat ✅ 0.08403 0.08562
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.02786 0.02782
Z3 z3-4.8.8_default sat ✅ 0.24228 0.24218
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 0.16775 0.16772
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 0.32706 0.32748
STP STP 2022.4_default sat ✅ 0.09892 0.09896
STP 2022.4_default sat ✅ 0.09871 0.09875
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.02000 1248.27000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.01719 0.01621
Z3-Owl z3-Owl-Final_default sat ✅ 3.14117 3.14115
z3-Owl-Final_default sat ✅ 3.14038 3.14055