Benchmark

non-incremental/QF_BV/Sage2/bench_17790.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size83982
Compressed Size6823
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 83974
Compressed Size6834
Max. Term Depth60
Asserts 281
Declared Functions0
Declared Constants76
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite4 not26 =61
let1630 extract15 bvand10 bvor32
bvadd642 bvmul355 bvult71 bvule99
bvugt17 bvuge36 bvshl37 bvlshr20
zero_extend485

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.12885 0.12882
Boolector SMT17 final boolector unsat ✅ 0.56556 0.56443
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.75723 1.45076
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 1.45677 1.45656
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.22451 0.20982
Q3B Q3B default unknown ❌ 600.05800 1786.72000
STP stp_st default unsat ✅ 2.74984 2.68695
stp_mt default unsat ✅ 2.27590 8.32694
Yices2 Yices2-Main default unsat ✅ 0.02426 0.02416
Z3 z3-4.5.0 default unsat ✅ 0.89378 0.89329
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.13220 0.13215
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.72224 3.72254
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.82098 0.82166
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.13224 0.18345
Minkeyrink ST_st unsat ✅ 0.12370 0.12387
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 1.13559 1.13574
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 1.23306 4.25804
STP-Riss-st-2018_riss-no-stderr unknown ❌ 1200.02000 1200.08000
Yices2 Yices 2.6.0_default unsat ✅ 0.02446 0.02440
Z3 z3-4.7.1_default unsat ✅ 16.98720 16.98630
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.18273 0.18261
Boolector Boolector-wrapped-sq_default unsat ✅ 0.15883 0.15884
Poolector-wrapped-sq_default unsat ✅ 0.17930 0.17141
CVC4 CVC4-sq-final_default unsat ✅ 0.41043 0.41077
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 30.77210 30.77240
MathSAT MathSAT5_default.sh unsat ✅ 0.61013 0.60990
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.10217 0.10240
MinkeyRink Solver 2020.3_default unsat ✅ 0.11779 0.16284
STP STP_default unsat ✅ 0.09842 0.13279
STP ++ Mergsat v1_default unsat ✅ 0.08449 0.08614
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.02837 0.02833
Z3 z3-4.8.8_default unsat ✅ 26.79880 26.79470
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.18234 0.18230
MathSAT mathsat-5.6.6_default unsat ✅ 0.51533 0.51522
STP STP 2021.0_default unsat ✅ 0.10179 0.13375
Z3 z3-4.8.11_default unsat ✅ 6.08554 6.08502
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.30842 0.30838
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 2.26941 2.26384
STP STP 2022.4_default unsat ✅ 0.09989 0.09995
STP 2022.4_default unsat ✅ 0.10030 0.10036
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 37.37310 67.96560
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.02401 0.02394
Z3-Owl z3-Owl-Final_default unsat ✅ 314.34700 314.30500
z3-Owl-Final_default unsat ✅ 152.13400 152.11300
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.29801 0.19844
cvc5 cvc5 unsat ✅ 0.44803 0.34859
SMTInterpol SMTInterpol unsat ✅ 12.77035 29.27770
STP STP unsat ✅ 0.33842 0.23873
Yices2 Yices2 unsat ✅ 0.24308 0.14363
Z3alpha Z3-alpha unsat ✅ 6.22353 6.11867
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.35256 0.23032
Bitwuzla-MachBV-base unsat ✅ 0.31277 0.19698
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.46799 0.34389
BVDecide bv_decide unsat ✅ 3.83732 3.69889
bv_decide-nokernel unsat ✅ 2.18197 2.05091
cvc5 cvc5 unsat ✅ 0.48644 0.36914
SMTInterpol SMTInterpol unsat ✅ 18.42360 29.58291
Yices2 Yices2 unsat ✅ 0.34645 0.22504
Z3alpha Z3-alpha unsat ✅ 119.04985 474.66865
Z3 Z3-alpha-base unknown ❌ 1201.25389 1200.97043
Z3-Owl-base unknown ❌ 1201.25296 1200.99238
z3siri-base unknown ❌ 1201.28752 1200.95754
Z3-Owl Z3-Owl unsat ✅ 167.37971 167.23076