Benchmark

non-incremental/QF_BV/sage/app1/bench_681.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size85109
Compressed Size12111
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 85101
Compressed Size12119
Max. Term Depth215
Asserts 1
Declared Functions0
Declared Constants320
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite91 not78 and1
=216 let205 extract1 bvand50
bvor192 bvadd407 bvmul5 bvsub290
bvult292 bvule635 bvslt1 bvsle72
bvshl193 bvashr5 zero_extend347

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 1.69372 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 10.73430 —
abziz_portfolio_2011_solvers_2 default sat ✅ 7.49044 —
abziz_portfolio_2012_minfeatures default sat ✅ 7.45506 —
abziz_portfolio_2012_solvers default sat ✅ 6.22470 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 7.08503 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 9.68500 —
Boolector-SMT-COMP-2011 default sat ✅ 3.61181 —
Boolector-SMT-COMP-2012 default unknown ❌ — —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 2.50431 —
CVC4-SMT-EVAL-2013 default sat ✅ 9.10714 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 2.64510 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 3.06250 —
MathSAT5-SMT-COMP-2011 default unknown ❌ — —
MathSAT5-SMT-COMP-2012 default sat ✅ 2.37778 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 1.82684 —
SONOLAR-SMT-COMP-2010 default sat ✅ 2.57713 —
SONOLAR-SMT-COMP-2011 default sat ✅ 2.01316 —
SONOLAR-SMT-COMP-2012 default unknown ❌ — —
STP STP2-SMT-COMP-2011 default sat ✅ 9.59318 —
STP2-SMT-COMP-2012 default sat ✅ 9.87198 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 16.51030 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 5.70210 —
Z3-SMT-COMP-2011 default sat ✅ 5.77845 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 4.44365 4.44332
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 6.04380 12.05620
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 10.33310 20.66090
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 3.58754 3.58745
SMT-RAT SMT-RAT-final default sat ✅ 1411.50000 1412.05000
STP stp-cryptominisat4 default sat ✅ 11.57070 11.57220
stp-cmsat4-v15 default sat ✅ 37.80520 37.82030
stp-cmsat4-mt-v15 default unknown ❌ 0.43941 0.43793
stp-minisat-v15 default sat ✅ 5.74524 5.74613
Yices2 Yices default sat ✅ 2.18080 2.18067
Z3 z3 4.4.0 default sat ✅ 7.01289 7.01493
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 74.36680 74.39120
ABC_glucose glucose sat ✅ 15.26950 15.27710
Boolector Boolector boolector sat ✅ 3.40822 3.41010
Boolector preprop boolector sat ✅ 3.41589 3.41786
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 11.91240 23.84470
MapleSTP MapleSTP default unknown ❌ 2400.02000 2401.37000
MapleSTP-mt default sat ✅ 70.68720 280.22500
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 3.76500 3.76571
MinkeyRink Minkeyrink 2016 default sat ✅ 4.20217 12.01580
Q3B Q3B default unknown ❌ 2400.03000 7203.89000
STP stp-cms-exp-2016 default sat ✅ 195.30900 195.37000
stp-cms-mt-2016 default sat ✅ 27.41250 107.47700
stp-cms-st-2016 default sat ✅ 31.08630 31.10430
stp-minisat-st-2016 default sat ✅ 34.55370 34.57350
Yices2 Yices-2.4.2 default sat ✅ 3.21080 3.21286
Z3 z3-4.4.1 default sat ✅ 11.26530 11.27130
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 1.35060 1.34970
Boolector SMT17 final boolector sat ✅ 4.93871 4.93781
CVC4 CVC4-smtcomp2017-main default sat ✅ 15.56830 31.25290
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 3.21683 3.21635
MinkeyRink MinkeyRink 2017.3a default sat ✅ 1.31895 1.32609
Q3B Q3B default unknown ❌ 600.04600 1799.88000
STP stp_st default sat ✅ 14.01550 14.01410
stp_mt default sat ✅ 10.52650 38.53010
Yices2 Yices2-Main default sat ✅ 5.63573 5.63427
Z3 z3-4.5.0 default sat ✅ 6.80603 6.80471
SMT-COMP 2018 Boolector Boolector_default sat ✅ 1.17969 1.17957
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 6.62258 6.62225
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 3.33542 3.33638
MinkeyRink Minkeyrink MT_mt sat ✅ 2.64487 9.64043
Minkeyrink ST_st sat ✅ 2.38995 2.39001
STP STP-CMS-st-2018_default-no-stderr sat ✅ 15.01210 15.00840
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 13.77090 51.89740
STP-Riss-st-2018_riss-no-stderr sat ✅ 10.46460 10.46370
Yices2 Yices 2.6.0_default sat ✅ 2.27331 2.27330
Z3 z3-4.7.1_default sat ✅ 10.20380 10.20380
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 1.32795 1.32780
Boolector Boolector-wrapped-sq_default sat ✅ 0.49846 0.49845
Poolector-wrapped-sq_default sat ✅ 0.67999 2.21000
CVC4 CVC4-sq-final_default sat ✅ 7.76971 7.76991
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.03000 1199.89000
MathSAT MathSAT5_default.sh sat ✅ 2.97236 2.97242
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.30166 0.30191
MinkeyRink Solver 2020.3_default sat ✅ 0.97464 2.96056
STP STP_default sat ✅ 0.82539 2.39215
STP ++ Mergsat v1_default sat ✅ 0.71405 0.71568
Yices2 Yices 2.6.2 bug fix_default sat ✅ 1.06874 2.10867
Z3 z3-4.8.8_default sat ✅ 4.33243 4.33231
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 2.19780 2.19772
MathSAT mathsat-5.6.6_default sat ✅ 2.24217 2.24197
STP STP 2021.0_default sat ✅ 1.20513 2.48143
Z3 z3-4.8.11_default sat ✅ 10.05200 10.05080
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 4.10940 4.10850
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 16.25010 16.25070
STP STP 2022.4_default sat ✅ 0.86343 0.86343
STP 2022.4_default sat ✅ 0.86323 0.86322
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1257.62000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 3.17783 3.17747
Z3-Owl z3-Owl-Final_default sat ✅ 20.61810 20.61530
z3-Owl-Final_default sat ✅ 21.23080 21.22620
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 0.62117 0.52120
cvc5 cvc5 sat ✅ 8.60392 8.50327
SMTInterpol SMTInterpol unknown ❌ 1201.71773 1237.07780
STP STP sat ✅ 1.01825 0.91850
Yices2 Yices2 sat ✅ 0.79828 0.69899
Z3alpha Z3-alpha sat ✅ 6.18276 6.08278