Benchmark

non-incremental/QF_BV/Sage2/bench_9914.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size71305
Compressed Size7439
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 71297
Compressed Size7443
Max. Term Depth14
Asserts 307
Declared Functions0
Declared Constants150
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not31 =96 let1198
extract1 bvand18 bvor95 bvadd414
bvmul254 bvudiv9 bvult34 bvule68
bvugt23 bvuge54 bvsle10 bvsgt19
bvsge2 bvshl128 bvlshr22 zero_extend226

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 3.44741 3.44648
Boolector SMT17 final boolector unsat ✅ 3.56465 3.56285
CVC4 CVC4-smtcomp2017-main default unsat ✅ 196.72200 394.73100
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 263.21100 263.13900
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 13.74820 22.59000
Q3B Q3B default unknown ❌ 600.02500 1200.10000
STP stp_st default unsat ✅ 75.29450 75.28560
stp_mt default unsat ✅ 46.74390 147.92200
Yices2 Yices2-Main default unsat ✅ 2.95423 2.94998
Z3 z3-4.5.0 default unsat ✅ 25.96130 25.95970
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 1.81006 1.80999
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 7.69901 7.69929
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 98.25730 98.25120
MinkeyRink Minkeyrink MT_mt unsat ✅ 13.92980 55.01110
Minkeyrink ST_st unsat ✅ 12.71070 12.70960
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 16.62490 16.62470
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 20.15660 79.85510
STP-Riss-st-2018_riss-no-stderr unsat ✅ 13.11330 13.11210
Yices2 Yices 2.6.0_default unsat ✅ 1.81062 1.81051
Z3 z3-4.7.1_default unsat ✅ 168.82500 168.80600
SMT-COMP 2021 0.25 (3/4) Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.58631 2.58600
MathSAT mathsat-5.6.6_default unknown ❌ 1200.10000 1199.80000
STP STP 2021.0_default unsat ✅ 32.91790 130.27900
Z3 z3-4.8.11_default unsat ✅ 256.01200 255.94500
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.54309 2.54263
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 12.82280 12.82040
STP STP 2022.4_default unsat ✅ 2.07238 2.07222
STP 2022.4_default unsat ✅ 2.07690 2.07474
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1242.16000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 7.92079 7.92075
Z3-Owl z3-Owl-Final_default unsat ✅ 106.43500 106.42100
z3-Owl-Final_default unsat ✅ 20.46450 20.46380
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 14.29002 14.18979
cvc5 cvc5 unsat ✅ 5.57587 5.47604
SMTInterpol SMTInterpol unknown ❌ 1201.71275 1233.00644
STP STP unsat ✅ 1.74066 1.64019
Yices2 Yices2 unsat ✅ 1.95051 1.85079
Z3alpha Z3-alpha unsat ✅ 462.32184 462.11590
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 1.67110 1.55037
Bitwuzla-MachBV-base unsat ✅ 1.65245 1.53325
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.67698 1.55646
BVDecide bv_decide unsat ✅ 8.22129 8.07958
bv_decide-nokernel unsat ✅ 5.37656 5.23313
cvc5 cvc5 unsat ✅ 4.96215 4.84383
SMTInterpol SMTInterpol unsat ✅ 942.41226 965.81500
Yices2 Yices2 unsat ✅ 1.03653 0.91811
Z3alpha Z3-alpha unsat ✅ 409.31153 1635.42561
Z3 Z3-alpha-base unsat ✅ 149.91129 149.76198
Z3-Owl-base unsat ✅ 698.38589 698.15764
z3siri-base unsat ✅ 152.81745 152.68554
Z3-Owl Z3-Owl unsat ✅ 1180.86602 1180.63378