Benchmark

non-incremental/QF_BV/Sage2/bench_17551.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size43866
Compressed Size3507
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 43858
Compressed Size3520
Max. Term Depth40
Asserts 115
Declared Functions0
Declared Constants34
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not37 =42 let898
bvor3 bvadd326 bvmul140 bvult14
bvule24 bvuge19 bvsgt2 bvsge13
bvshl60 zero_extend332

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.57709 0.57685
Boolector SMT17 final boolector unsat ✅ 1.40390 1.40319
CVC4 CVC4-smtcomp2017-main default unsat ✅ 94.60130 190.09900
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 97.81480 97.80460
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 2.63249 2.64311
Q3B Q3B default unknown ❌ 600.04500 1786.48000
STP stp_st default unsat ✅ 267.42700 267.39200
stp_mt default unsat ✅ 281.35000 891.68800
Yices2 Yices2-Main default unsat ✅ 1.05053 1.04966
Z3 z3-4.5.0 default unsat ✅ 70.10390 70.09750
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 5.37085 5.37080
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 4.71375 4.71347
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 116.35600 116.36100
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.70989 2.58704
Minkeyrink ST_st unsat ✅ 2.09789 2.09723
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 102.96500 102.96400
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 109.03000 433.40400
STP-Riss-st-2018_riss-no-stderr unsat ✅ 144.31300 144.31000
Yices2 Yices 2.6.0_default unsat ✅ 0.28451 0.28445
Z3 z3-4.7.1_default unsat ✅ 23.51060 23.51150
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 13.19960 13.20020
Poolector-wrapped-sq_default unsat ✅ 13.20890 51.90000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 14.89970 14.90000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 7.54373 7.54301
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.67334 2.46002
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.67055 0.67064
Par4 Par4-wrapped-sq_default unsat ✅ 0.67941 1.79000
STP STP-2019-wrapped-sq_default unsat ✅ 358.82400 358.81500
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 819.37400 819.27200
stp-minisat-wrapped-sq_default unknown ❌ 2400.01000 2399.77000
stp-mt-wrapped-sq_default unsat ✅ 263.74700 1047.53000
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 2400.03000 3636.32000
stp-riss-wrapped-sq_default unknown ❌ 0.13993 0.14016
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.71966 0.71961
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.21633 0.21636
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.29120 0.29123
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.08000 2400.18000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.18668 0.18668
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 31.02320 31.02450
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 15.22340 15.22150
Boolector Boolector-wrapped-sq_default unsat ✅ 16.72840 16.72660
Poolector-wrapped-sq_default unsat ✅ 12.40830 48.67750
CVC4 CVC4-sq-final_default unsat ✅ 41.24620 41.24550
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.10000 1200.16000
MathSAT MathSAT5_default.sh unsat ✅ 738.52300 738.32400
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.06032 0.06056
MinkeyRink Solver 2020.3_default unsat ✅ 1.34947 5.12617
STP STP_default unsat ✅ 0.47854 1.70796
STP ++ Mergsat v1_default unsat ✅ 0.78623 0.78787
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.33087 0.33080
Z3 z3-4.8.8_default unsat ✅ 8.06175 8.06214
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 13.11580 13.11510
MathSAT mathsat-5.6.6_default unsat ✅ 502.62700 502.59900
STP STP 2021.0_default unsat ✅ 0.49315 1.75142
Z3 z3-4.8.11_default unsat ✅ 3.50795 3.50771
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 13.66100 13.65890
Bitwuzla-wrapped_default unsat ✅ 18.81970 18.81980
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 12.54660 12.54770
MathSAT MathSAT-5.6.8_default unsat ✅ 467.85200 467.77500
STP STP 2022.4_default unsat ✅ 0.67544 0.67541
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.30901 0.30897
Z3++BV z3++bv_0702_default unsat ✅ 7.91883 7.91842
Z3 z3-4.8.17_default unsat ✅ 5.46656 5.46836
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 3.32922 3.32854
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.62952 0.63006
STP STP 2022.4_default unsat ✅ 0.52048 0.52054
STP 2022.4_default unsat ✅ 0.52579 0.52568
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 178.13300 214.34100
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.25307 0.25301
Z3-Owl z3-Owl-Final_default unknown ❌ 1200.11000 1199.88000
z3-Owl-Final_default unsat ✅ 64.12860 64.10310
SMT-COMP 2025 0.33 (6/9) Bitwuzla Bitwuzla unsat ✅ 1.98167 1.86270
Bitwuzla-MachBV-base unsat ✅ 0.94226 0.82871
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.27358 1.14610
BVDecide bv_decide unsat ✅ 11.94346 11.80124
bv_decide-nokernel unsat ✅ 10.54924 10.40000
cvc5 cvc5 unsat ✅ 6.11824 5.99861
SMTInterpol SMTInterpol unsat ✅ 5.14299 15.01101
Yices2 Yices2 unsat ✅ 0.51732 0.39810
Z3alpha Z3-alpha unknown ❌ 1201.00545 4802.28356
Z3 Z3-alpha-base unknown ❌ 1201.26517 1200.90208
Z3-Owl-base unknown ❌ 1201.25546 1200.97590
z3siri-base unknown ❌ 1201.25443 1200.97196
Z3-Owl Z3-Owl unknown ❌ 1201.75541 1201.00326