Benchmark

non-incremental/QF_BV/Sage2/bench_3595.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size26365
Compressed Size2202
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 26357
Compressed Size2215
Max. Term Depth75
Asserts 145
Declared Functions0
Declared Constants24
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not122 =124 let522
bvadd94 bvmul94 bvult20 zero_extend212

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 27.69740 27.69530
Boolector SMT17 final boolector sat ✅ 54.92230 54.91940
CVC4 CVC4-smtcomp2017-main default sat ✅ 59.22190 118.84800
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 3.33816 3.33784
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.82684 0.83939
Q3B Q3B default unknown ❌ 600.07100 1799.54000
STP stp_st default sat ✅ 2.69318 2.68245
stp_mt default sat ✅ 3.06574 11.51500
Yices2 Yices2-Main default sat ✅ 195.65200 195.62400
Z3 z3-4.5.0 default sat ✅ 131.46900 131.45400
SMT-COMP 2018 Boolector Boolector_default sat ✅ 39.85940 39.85340
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 5.71910 5.71877
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 10.84300 10.84350
MinkeyRink Minkeyrink MT_mt sat ✅ 0.25456 0.65452
Minkeyrink ST_st sat ✅ 0.45785 0.45758
STP STP-CMS-st-2018_default-no-stderr sat ✅ 8.16362 8.16356
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 3.08337 11.62280
STP-Riss-st-2018_riss-no-stderr sat ✅ 2.28889 2.28845
Yices2 Yices 2.6.0_default sat ✅ 92.64230 92.64370
Z3 z3-4.7.1_default sat ✅ 700.93600 700.89600
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 2.71836 2.71849
Poolector-wrapped-sq_default sat ✅ 3.31615 12.63000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 30.77660 30.77220
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 4.43783 4.43830
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.79107 2.78539
MinkeyRink ST-wrapped-sq_default sat ✅ 0.75882 0.75884
Par4 Par4-wrapped-sq_default sat ✅ 4.73648 14.04000
STP STP-2019-wrapped-sq_default sat ✅ 8.82833 8.82699
stp-mergesat-fixed-wrapped-sq_default sat ✅ 11.79950 11.79900
stp-minisat-wrapped-sq_default sat ✅ 9.24771 9.24695
stp-mt-wrapped-sq_default sat ✅ 0.97220 3.13046
stp-portfolio-fixed-wrapped-sq_default sat ✅ 12.53850 31.04380
stp-riss-wrapped-sq_default unknown ❌ 0.21357 0.21367
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 4.74215 4.74182
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 5.67175 5.67207
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 23.70300 23.69980
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.10000 2400.00000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 5.58734 5.58735
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 979.54600 979.36300
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 17.29000 17.28370
Boolector Boolector-wrapped-sq_default sat ✅ 12.06900 12.06640
Poolector-wrapped-sq_default sat ✅ 13.62020 53.28000
CVC4 CVC4-sq-final_default sat ✅ 8.28418 8.28233
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.01000 1199.98000
MathSAT MathSAT5_default.sh sat ✅ 13.30400 13.30170
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.11597 0.11621
MinkeyRink Solver 2020.3_default sat ✅ 0.92042 3.29539
STP STP_default sat ✅ 0.43146 1.42872
STP ++ Mergsat v1_default sat ✅ 0.39577 0.39743
Yices2 Yices 2.6.2 bug fix_default sat ✅ 9.26567 9.26556
Z3 z3-4.8.8_default sat ✅ 162.48500 162.46800
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 10.66420 10.66460
MathSAT mathsat-5.6.6_default sat ✅ 9.36781 9.36660
STP STP 2021.0_default sat ✅ 0.46299 1.53782
Z3 z3-4.8.11_default sat ✅ 457.05000 456.97300
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 10.84450 10.84380
Bitwuzla-wrapped_default sat ✅ 4.72732 4.72750
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 4.38469 4.38521
MathSAT MathSAT-5.6.8_default sat ✅ 10.36620 10.36610
STP STP 2022.4_default sat ✅ 1.27777 1.27756
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 14.96190 14.96080
Z3++BV z3++bv_0702_default sat ✅ 260.88600 260.82600
Z3 z3-4.8.17_default sat ✅ 206.82600 206.77600
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default sat ✅ 12.08360 12.08200
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 6.37348 6.37360
STP STP 2022.4_default sat ✅ 1.86669 1.86654
STP 2022.4_default sat ✅ 1.86852 1.86819
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default sat ✅ 442.05000 475.65500
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 190.95600 190.94900
Z3-Owl z3-Owl-Final_default sat ✅ 45.10510 45.10390
z3-Owl-Final_default sat ✅ 35.24790 35.24550
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 4.04911 3.92741
Bitwuzla-MachBV-base sat ✅ 8.65278 8.52027
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 12.08708 11.96045
BVDecide bv_decide sat ✅ 25.96832 25.82400
bv_decide-nokernel sat ✅ 25.84773 25.72483
cvc5 cvc5 sat ✅ 152.44952 152.29645
SMTInterpol SMTInterpol unknown ❌ 1201.38666 1227.38171
Yices2 Yices2 sat ✅ 18.90207 18.77885
Z3alpha Z3-alpha sat ✅ 4.56410 16.87020
Z3 Z3-alpha-base sat ✅ 112.44202 112.30987
Z3-Owl-base sat ✅ 463.45417 463.29493
z3siri-base sat ✅ 114.34086 114.20855
Z3-Owl Z3-Owl sat ✅ 35.10106 34.97867