Benchmark

non-incremental/QF_BV/Sage2/bench_13974.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size2506144
Compressed Size27486
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 2506136
Compressed Size27474
Max. Term Depth582
Asserts 650
Declared Functions0
Declared Constants157
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite36 not152 =260
let54389 extract35 bvand2 bvor57
bvadd40133 bvmul5029 bvult117 bvule114
bvugt4 bvuge174 bvsgt16 bvshl57
bvlshr17 zero_extend8835

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.86168 0.86115
Boolector SMT17 final boolector unsat ✅ 1.17753 1.17668
CVC4 CVC4-smtcomp2017-main default unsat ✅ 21.11350 41.35820
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 289.05600 289.04600
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.51217 0.46844
Q3B Q3B default unsat ✅ 274.38800 822.72000
STP stp_st default unsat ✅ 0.50296 0.50332
stp_mt default unsat ✅ 0.54658 0.57238
Yices2 Yices2-Main default unsat ✅ 5.55863 5.55894
Z3 z3-4.5.0 default unsat ✅ 139.41600 139.38100
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.70408 0.70395
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 14.42990 14.42900
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 28.07450 28.07400
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.40902 0.43118
Minkeyrink ST_st unsat ✅ 0.40208 0.40226
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.47208 0.47210
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.48275 0.53963
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.89330 0.89332
Yices2 Yices 2.6.0_default unsat ✅ 5.23547 5.23512
Z3 z3-4.7.1_default unsat ✅ 13.45260 13.45100
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.90747 0.90730
Boolector Boolector-wrapped-sq_default unsat ✅ 0.71933 0.71928
Poolector-wrapped-sq_default unsat ✅ 0.78407 2.64946
CVC4 CVC4-sq-final_default unsat ✅ 11.65970 11.65800
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.06000 1199.88000
MathSAT MathSAT5_default.sh unsat ✅ 210.69800 210.64700
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.32784 0.32807
MinkeyRink Solver 2020.3_default unsat ✅ 0.33782 0.35331
STP STP_default unsat ✅ 0.42017 0.43120
STP ++ Mergsat v1_default unsat ✅ 0.41802 0.41968
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 1.15152 1.15149
Z3 z3-4.8.8_default unsat ✅ 28.79180 28.77690
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.82209 0.82201
Bitwuzla-wrapped_default unsat ✅ 0.80651 0.80641
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 44.31070 44.31170
MathSAT MathSAT-5.6.8_default unsat ✅ 96.79240 96.78200
STP STP 2022.4_default unsat ✅ 0.33671 0.33670
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.76265 0.76254
Z3++BV z3++bv_0702_default unsat ✅ 10.59740 10.59620
Z3 z3-4.8.17_default unsat ✅ 151.28300 151.25500
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.89228 0.89216
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 8.92299 8.92277
STP STP 2022.4_default unsat ✅ 0.34772 0.34778
STP 2022.4_default unsat ✅ 0.34814 0.34818
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1246.18000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 2.94338 2.94308
Z3-Owl z3-Owl-Final_default unsat ✅ 14.62660 14.62150
z3-Owl-Final_default unsat ✅ 9.37349 9.37336
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.71388 0.58775
Bitwuzla-MachBV-base unsat ✅ 0.51731 0.39479
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.59356 0.47933
BVDecide bv_decide unsat ✅ 226.45652 226.25467
bv_decide-nokernel unsat ✅ 48.88093 48.74358
cvc5 cvc5 unsat ✅ 21.11833 20.99263
SMTInterpol SMTInterpol unknown ❌ 1201.48748 1229.24137
Yices2 Yices2 unsat ✅ 1.20240 1.08022
Z3alpha Z3-alpha unsat ✅ 7.71013 28.52954
Z3 Z3-alpha-base unsat ✅ 55.31688 55.19680
Z3-Owl-base unsat ✅ 259.52501 259.35750
z3siri-base unsat ✅ 56.25637 56.12875
Z3-Owl Z3-Owl unsat ✅ 5.54947 5.42699