Benchmark

non-incremental/QF_BV/Sage2/bench_1145.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size22675
Compressed Size1850
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 22667
Compressed Size1844
Max. Term Depth60
Asserts 110
Declared Functions0
Declared Constants19
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not87 =90 let459
bvadd96 bvmul96 bvult19 zero_extend180

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 103.58300 103.56000
Boolector SMT17 final boolector sat ✅ 77.47580 77.47790
CVC4 CVC4-smtcomp2017-main default sat ✅ 379.79300 762.45600
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 21.15050 21.14970
MinkeyRink MinkeyRink 2017.3a default sat ✅ 3.30267 3.35462
Q3B Q3B default unknown ❌ 600.03200 1799.40000
STP stp_st default sat ✅ 2.30238 2.30276
stp_mt default sat ✅ 3.02169 11.40610
Yices2 Yices2-Main default sat ✅ 7.62172 7.62126
Z3 z3-4.5.0 default sat ✅ 288.41400 288.36400
SMT-COMP 2018 Boolector Boolector_default sat ✅ 127.47600 127.46800
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 12.30240 12.29780
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 35.54590 35.54300
MinkeyRink Minkeyrink MT_mt sat ✅ 0.90529 3.28928
Minkeyrink ST_st sat ✅ 2.81556 2.81520
STP STP-CMS-st-2018_default-no-stderr sat ✅ 4.13493 4.13459
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 3.50121 13.32160
STP-Riss-st-2018_riss-no-stderr sat ✅ 4.05758 4.05707
Yices2 Yices 2.6.0_default sat ✅ 17.95340 17.95330
Z3 z3-4.7.1_default sat ✅ 188.76600 188.75700
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 16.31390 16.31450
Poolector-wrapped-sq_default sat ✅ 17.86570 70.42130
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 66.89290 66.88520
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 19.90280 19.90180
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.75168 2.70101
MinkeyRink ST-wrapped-sq_default sat ✅ 0.74329 0.74334
Par4 Par4-wrapped-sq_default sat ✅ 11.94310 35.71000
STP STP-2019-wrapped-sq_default sat ✅ 5.92092 5.92108
stp-mergesat-fixed-wrapped-sq_default sat ✅ 8.47119 8.46660
stp-minisat-wrapped-sq_default sat ✅ 12.95720 12.95620
stp-mt-wrapped-sq_default sat ✅ 7.30677 28.39700
stp-portfolio-fixed-wrapped-sq_default sat ✅ 12.91620 27.29790
stp-riss-wrapped-sq_default unknown ❌ 0.18555 0.18578
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 12.23460 12.23450
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 50.13530 50.13770
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 29.65200 29.65110
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2399.88000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 9.58371 9.58386
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 606.60200 606.53600
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 3.53234 3.53231
Bitwuzla-wrapped_default sat ✅ 15.62580 15.62440
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 16.85040 16.84800
MathSAT MathSAT-5.6.8_default sat ✅ 79.01460 78.98310
STP STP 2022.4_default sat ✅ 3.63324 3.63300
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 5.09109 5.09072
Z3++BV z3++bv_0702_default sat ✅ 38.26610 38.26180
Z3 z3-4.8.17_default sat ✅ 175.09300 175.06700
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 15.09130 15.09010
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 86.78890 86.78110
STP STP 2022.4_default sat ✅ 3.57017 3.57000
STP 2022.4_default sat ✅ 3.58050 3.58051
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.02000 1238.02000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 826.64500 826.66600
Z3-Owl z3-Owl-Final_default sat ✅ 48.71110 48.65430
z3-Owl-Final_default sat ✅ 63.93300 63.92160
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 11.69813 11.59770
cvc5 cvc5 sat ✅ 10.57160 10.46597
SMTInterpol SMTInterpol unknown ❌ 1201.71803 1226.66947
STP STP sat ✅ 35.00502 34.90438
Yices2 Yices2 sat ✅ 20.02038 19.91697
Z3alpha Z3-alpha sat ✅ 23.46519 23.36532