Benchmark

non-incremental/QF_BV/Sage2/bench_5146.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size20508
Compressed Size2174
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 20500
Compressed Size2187
Max. Term Depth60
Asserts 121
Declared Functions0
Declared Constants19
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not93 =101 let384
bvadd68 bvmul68 bvult19 zero_extend155

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 30.27780 30.27420
Boolector SMT17 final boolector sat ✅ 30.67560 30.67140
CVC4 CVC4-smtcomp2017-main default sat ✅ 13.65190 27.39890
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 33.45140 33.44860
MinkeyRink MinkeyRink 2017.3a default sat ✅ 6.05942 6.95000
Q3B Q3B default unknown ❌ 600.03900 1799.28000
STP stp_st default sat ✅ 13.18260 13.18080
stp_mt default sat ✅ 3.96987 15.36260
Yices2 Yices2-Main default sat ✅ 19.26900 19.26770
Z3 z3-4.5.0 default sat ✅ 79.82620 79.81690
SMT-COMP 2018 Boolector Boolector_default sat ✅ 21.05170 21.05180
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 20.46970 20.46730
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 20.11070 20.11020
MinkeyRink Minkeyrink MT_mt sat ✅ 1.02970 3.80769
Minkeyrink ST_st sat ✅ 8.38250 8.38247
STP STP-CMS-st-2018_default-no-stderr sat ✅ 3.32387 3.32335
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.83136 2.95648
STP-Riss-st-2018_riss-no-stderr sat ✅ 4.16000 4.15974
Yices2 Yices 2.6.0_default sat ✅ 39.31720 39.31740
Z3 z3-4.7.1_default sat ✅ 99.84720 99.84360
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 42.45740 42.45420
Poolector-wrapped-sq_default sat ✅ 21.84130 85.96660
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 73.84630 73.83990
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 11.52750 11.52610
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 2.80240 10.87020
MinkeyRink ST-wrapped-sq_default sat ✅ 2.30875 2.30870
Par4 Par4-wrapped-sq_default sat ✅ 35.67860 106.90000
STP STP-2019-wrapped-sq_default sat ✅ 3.36326 3.36330
stp-mergesat-fixed-wrapped-sq_default sat ✅ 6.45372 6.45316
stp-minisat-wrapped-sq_default sat ✅ 5.95146 5.95163
stp-mt-wrapped-sq_default sat ✅ 1.98609 7.48238
stp-portfolio-fixed-wrapped-sq_default sat ✅ 6.72633 16.19330
stp-riss-wrapped-sq_default unknown ❌ 0.12058 0.12078
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 451.20700 451.14000
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 9.79871 9.79844
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 8.23379 8.23255
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.08000 2399.48000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 42.19110 42.18810
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 137.85400 137.81700
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 19.88260 19.88180
MathSAT mathsat-5.6.6_default sat ✅ 45.45050 45.44090
STP STP 2021.0_default sat ✅ 6.81045 26.76820
Z3 z3-4.8.11_default sat ✅ 254.23000 254.09800
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 15.53280 15.53190
Bitwuzla-wrapped_default sat ✅ 6.32840 6.32854
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 6.04440 6.04302
MathSAT MathSAT-5.6.8_default sat ✅ 47.06950 47.06430
STP STP 2022.4_default sat ✅ 4.71584 4.71536
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 3.45234 3.45091
Z3++BV z3++bv_0702_default sat ✅ 6.37266 6.37256
Z3 z3-4.8.17_default sat ✅ 24.62680 49.21670
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 13.45300 13.45160
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 12.27790 12.27700
STP STP 2022.4_default sat ✅ 3.70348 3.70339
STP 2022.4_default sat ✅ 3.71326 3.71319
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.13000 1234.48000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 5.12182 5.12204
Z3-Owl z3-Owl-Final_default sat ✅ 94.90290 94.90120
z3-Owl-Final_default sat ✅ 84.93580 84.94010
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 9.05335 8.95221
cvc5 cvc5 sat ✅ 4.08184 3.98058
SMTInterpol SMTInterpol unknown ❌ 1201.72496 1218.75960
STP STP sat ✅ 27.52446 27.41400
Yices2 Yices2 sat ✅ 7.66703 7.56722
Z3alpha Z3-alpha sat ✅ 210.54165 210.34411
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 8.77330 8.64530
Bitwuzla-MachBV-base sat ✅ 9.23207 9.09945
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 21.49909 21.37216
BVDecide bv_decide sat ✅ 25.58618 25.43492
bv_decide-nokernel sat ✅ 25.58751 25.46631
cvc5 cvc5 sat ✅ 18.46480 18.33059
SMTInterpol SMTInterpol unknown ❌ 1201.38639 1235.52481
Yices2 Yices2 sat ✅ 3.80922 3.69015
Z3alpha Z3-alpha sat ✅ 23.88554 94.15650
Z3 Z3-alpha-base sat ✅ 10.59031 10.46666
Z3-Owl-base sat ✅ 43.67537 43.55276
z3siri-base sat ✅ 10.71776 10.59708
Z3-Owl Z3-Owl sat ✅ 8.35140 8.22034