Benchmark

non-incremental/QF_BV/Sage2/bench_3131.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size21943
Compressed Size1812
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 21935
Compressed Size1805
Max. Term Depth57
Asserts 112
Declared Functions0
Declared Constants18
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not91 =93 let443
bvadd87 bvmul87 bvult18 zero_extend178

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 53.24380 53.23540
Boolector SMT17 final boolector sat ✅ 80.82750 80.82350
CVC4 CVC4-smtcomp2017-main default sat ✅ 12.49180 25.01190
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 37.11160 37.10560
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.34747 0.33288
Q3B Q3B default unknown ❌ 600.01700 1799.52000
STP stp_st default sat ✅ 3.62025 3.62028
stp_mt default sat ✅ 1.68920 6.13285
Yices2 Yices2-Main default sat ✅ 54.73700 54.73410
Z3 z3-4.5.0 default sat ✅ 558.97900 558.94100
SMT-COMP 2018 Boolector Boolector_default sat ✅ 57.71200 57.70900
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 51.76080 51.74910
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 18.35500 18.35470
MinkeyRink Minkeyrink MT_mt sat ✅ 0.47268 1.59737
Minkeyrink ST_st sat ✅ 4.68566 4.68317
STP STP-CMS-st-2018_default-no-stderr sat ✅ 1.96334 1.96333
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 2.90836 11.00180
STP-Riss-st-2018_riss-no-stderr sat ✅ 3.23657 3.23473
Yices2 Yices 2.6.0_default sat ✅ 131.40000 131.38800
Z3 z3-4.7.1_default sat ✅ 364.83500 364.82100
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 11.24310 11.24310
Poolector-wrapped-sq_default sat ✅ 12.67490 49.56490
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 46.60660 46.60380
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 122.83400 122.81800
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 6.65153 26.16660
MinkeyRink ST-wrapped-sq_default sat ✅ 3.62319 3.62332
Par4 Par4-wrapped-sq_default sat ✅ 15.24360 45.50560
STP STP-2019-wrapped-sq_default sat ✅ 6.42550 6.42497
stp-mergesat-fixed-wrapped-sq_default sat ✅ 10.94930 10.94860
stp-minisat-wrapped-sq_default sat ✅ 2.46100 2.46097
stp-mt-wrapped-sq_default sat ✅ 1.06524 3.65446
stp-portfolio-fixed-wrapped-sq_default sat ✅ 11.41900 20.30600
stp-riss-wrapped-sq_default unknown ❌ 0.17567 0.17591
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 112.05100 112.04400
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 41.09120 41.09330
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 29.85810 29.85350
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2400.07000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 20.87770 20.87790
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 99.21050 99.18680
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 11.62400 11.62230
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 76.43070 76.42940
STP STP 2022.4_default sat ✅ 2.12990 2.12989
STP 2022.4_default sat ✅ 2.12978 2.12965
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1235.47000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.48171 0.48162
Z3-Owl z3-Owl-Final_default sat ✅ 561.23000 561.22100
z3-Owl-Final_default sat ✅ 221.71400 221.63000