Benchmark

non-incremental/QF_BV/Sage2/bench_9988.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1055766
Compressed Size32245
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 1055758
Compressed Size32234
Max. Term Depth590
Asserts 946
Declared Functions0
Declared Constants581
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite16 not183 =424
let22630 extract18 bvand29 bvor224
bvadd12207 bvmul2594 bvult127 bvule185
bvugt65 bvuge160 bvshl229 bvlshr48
zero_extend7066

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.38 (5/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 54.03570 54.03210
Boolector SMT17 final boolector sat ✅ 149.55100 149.54100
CVC4 CVC4-smtcomp2017-main default sat ✅ 18.53170 36.71130
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.05500 599.79000
MinkeyRink MinkeyRink 2017.3a default sat ✅ 4.72567 4.76168
Q3B Q3B default unknown ❌ 600.10100 1799.88000
STP stp_st default sat ✅ 239.84700 239.82500
stp_mt default unknown ❌ 600.04400 1869.92000
Yices2 Yices2-Main default sat ✅ 9.75885 9.75851
Z3 z3-4.5.0 default unknown ❌ 600.10400 599.96900
SMT-COMP 2018 0.14 (6/7) Boolector Boolector_default sat ✅ 36.83890 36.83670
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 79.49050 79.47920
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 334.84300 334.79200
MinkeyRink Minkeyrink MT_mt sat ✅ 3.96604 13.61220
Minkeyrink ST_st sat ✅ 25.34450 25.34100
STP STP-CMS-st-2018_default-no-stderr sat ✅ 117.60100 117.59000
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 55.30060 188.93200
STP-Riss-st-2018_riss-no-stderr sat ✅ 80.97640 80.97250
Yices2 Yices 2.6.0_default sat ✅ 10.91350 10.91310
Z3 z3-4.7.1_default unknown ❌ 1200.10000 1199.93000
SMT-COMP 2019 0.12 (7/8) Boolector Boolector-wrapped-sq_default sat ✅ 24.10500 24.10300
Poolector-wrapped-sq_default sat ✅ 27.09660 106.67000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 103.53400 103.52300
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 136.85900 136.84500
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 91.79730 362.02200
MinkeyRink ST-wrapped-sq_default sat ✅ 92.06410 92.05570
Par4 Par4-wrapped-sq_default sat ✅ 13.77660 41.25000
STP STP-2019-wrapped-sq_default sat ✅ 734.51500 734.40600
stp-mergesat-fixed-wrapped-sq_default sat ✅ 137.73200 137.69000
stp-minisat-wrapped-sq_default sat ✅ 147.25800 147.24600
stp-mt-wrapped-sq_default sat ✅ 202.72000 791.32000
stp-portfolio-fixed-wrapped-sq_default sat ✅ 764.36800 1096.70000
stp-riss-wrapped-sq_default unknown ❌ 4.41840 4.08173
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 12.22160 12.22160
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 2.62278 2.62265
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 5.83812 5.83759
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2399.79000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 2.15091 2.15059
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.05000 2399.79000
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 27.51730 27.51400
Boolector Boolector-wrapped-sq_default sat ✅ 17.32190 17.32010
Poolector-wrapped-sq_default sat ✅ 8.19767 31.92000
CVC4 CVC4-sq-final_default sat ✅ 50.97820 50.97710
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.03000 1199.92000
MathSAT MathSAT5_default.sh sat ✅ 465.62000 465.59400
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.67410 0.67432
MinkeyRink Solver 2020.3_default sat ✅ 27.61390 107.66800
STP STP_default sat ✅ 17.05710 65.36560
STP ++ Mergsat v1_default sat ✅ 33.48250 33.47900
Yices2 Yices 2.6.2 bug fix_default sat ✅ 2.12097 2.12060
Z3 z3-4.8.8_default sat ✅ 239.25400 239.24900
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 16.11050 16.10410
MathSAT mathsat-5.6.6_default sat ✅ 3.60265 3.60235
STP STP 2021.0_default sat ✅ 44.36650 173.38800
Z3 z3-4.8.11_default sat ✅ 363.68700 363.45000
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 42.50640 42.49300
Bitwuzla-wrapped_default sat ✅ 19.65970 19.65770
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 86.51420 86.49830
MathSAT MathSAT-5.6.8_default sat ✅ 746.10100 746.04900
STP STP 2022.4_default sat ✅ 43.27000 43.26720
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 3.11781 3.11770
Z3++BV z3++bv_0702_default sat ✅ 79.29530 79.29320
Z3 z3-4.8.17_default sat ✅ 113.09800 113.08900
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 119.70300 119.67900
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 40.65070 40.64710
STP STP 2022.4_default sat ✅ 11.89570 11.89440
STP 2022.4_default sat ✅ 11.83070 11.82900
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.05000 1253.75000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 16.30110 16.30230
Z3-Owl z3-Owl-Final_default sat ✅ 578.20400 578.06500
z3-Owl-Final_default sat ✅ 456.32500 456.33200
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 60.34790 60.24563
cvc5 cvc5 sat ✅ 30.98801 30.88753
SMTInterpol SMTInterpol unknown ❌ 1201.74521 1235.50850
STP STP sat ✅ 11.05908 10.95868
Yices2 Yices2 sat ✅ 1.82095 1.72058
Z3alpha Z3-alpha sat ✅ 700.65106 700.53718
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla sat ✅ 25.49615 25.37197
Bitwuzla-MachBV-base sat ✅ 28.61888 28.49500
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 28.43607 28.31341
BVDecide bv_decide sat ✅ 34.34001 34.20206
bv_decide-nokernel sat ✅ 32.62543 32.48176
cvc5 cvc5 sat ✅ 105.39018 105.25193
SMTInterpol SMTInterpol unknown ❌ 1201.78367 1229.66945
Yices2 Yices2 sat ✅ 1.40235 1.27456
Z3alpha Z3-alpha unknown ❌ 1201.00503 4801.30542
Z3 Z3-alpha-base sat ✅ 147.95612 147.80860
Z3-Owl-base sat ✅ 566.64820 566.47303
z3siri-base sat ✅ 158.65872 158.52914
Z3-Owl Z3-Owl sat ✅ 206.81449 206.64578