Benchmark

non-incremental/QF_BV/Sage2/bench_2508.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size16935
Compressed Size1683
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 16927
Compressed Size1675
Max. Term Depth60
Asserts 99
Declared Functions0
Declared Constants19
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not76 =79 let325
bvadd58 bvmul58 bvult19 zero_extend133

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 58.80300 58.79760
Boolector SMT17 final boolector sat ✅ 55.47790 55.46850
CVC4 CVC4-smtcomp2017-main default sat ✅ 28.02840 56.16960
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 12.08840 12.08390
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.80361 0.81378
Q3B Q3B default unknown ❌ 600.04900 1786.66000
STP stp_st default sat ✅ 578.68100 578.63900
stp_mt default sat ✅ 27.47380 108.79500
Yices2 Yices2-Main default sat ✅ 27.35310 27.34380
Z3 z3-4.5.0 default sat ✅ 567.87500 567.87500
SMT-COMP 2018 Boolector Boolector_default sat ✅ 44.70670 44.70680
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 197.82500 197.80500
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 3.95146 3.95075
MinkeyRink Minkeyrink MT_mt sat ✅ 0.85273 3.11356
Minkeyrink ST_st sat ✅ 13.79570 13.79410
STP STP-CMS-st-2018_default-no-stderr sat ✅ 45.09680 45.09310
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 34.94360 138.42300
STP-Riss-st-2018_riss-no-stderr sat ✅ 5.10200 5.10157
Yices2 Yices 2.6.0_default sat ✅ 158.75500 158.73400
Z3 z3-4.7.1_default sat ✅ 104.18500 104.17600
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 17.93800 17.93780
Poolector-wrapped-sq_default sat ✅ 19.31960 76.16000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 67.09350 67.09430
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 105.44200 105.44200
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 3.33261 12.93040
MinkeyRink ST-wrapped-sq_default sat ✅ 14.22330 14.22250
Par4 Par4-wrapped-sq_default sat ✅ 38.48290 115.08600
STP STP-2019-wrapped-sq_default sat ✅ 9.03946 9.03965
stp-mergesat-fixed-wrapped-sq_default sat ✅ 84.64370 84.64680
stp-minisat-wrapped-sq_default sat ✅ 28.19180 28.19220
stp-mt-wrapped-sq_default sat ✅ 44.80150 177.49700
stp-portfolio-fixed-wrapped-sq_default sat ✅ 85.76400 123.78300
stp-riss-wrapped-sq_default unknown ❌ 0.14108 0.14126
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 36.90040 36.89950
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 30.30820 30.30630
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 30.46970 30.46910
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.01000 2399.64000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 114.13600 114.12900
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 123.65500 123.64600
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 3.50069 3.49995
Boolector Boolector-wrapped-sq_default sat ✅ 6.10675 6.10620
Poolector-wrapped-sq_default sat ✅ 6.60297 25.69000
CVC4 CVC4-sq-final_default sat ✅ 25.78590 25.78410
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.04000 1199.96000
MathSAT MathSAT5_default.sh sat ✅ 53.28340 53.27700
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.08644 0.08668
MinkeyRink Solver 2020.3_default sat ✅ 11.22280 44.18470
STP STP_default sat ✅ 5.67291 22.27280
STP ++ Mergsat v1_default sat ✅ 8.23955 8.24160
Yices2 Yices 2.6.2 bug fix_default sat ✅ 18.96990 18.96810
Z3 z3-4.8.8_default sat ✅ 152.70200 152.69600
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 88.53963 88.43713
cvc5 cvc5 sat ✅ 25.50865 25.40834
SMTInterpol SMTInterpol unknown ❌ 1201.73508 1234.84310
STP STP sat ✅ 7.08435 6.98429
Yices2 Yices2 sat ✅ 114.77717 114.67592
Z3alpha Z3-alpha sat ✅ 11.06872 10.96720
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 78.58382 78.44864
Bitwuzla-MachBV-base sat ✅ 8.08537 7.95888
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 7.56038 7.43567
BVDecide bv_decide sat ✅ 21.25004 21.10946
bv_decide-nokernel sat ✅ 21.30752 21.15974
cvc5 cvc5 sat ✅ 94.17168 94.04278
SMTInterpol SMTInterpol unknown ❌ 1201.77058 1218.23600
Yices2 Yices2 sat ✅ 125.87478 125.73713
Z3alpha Z3-alpha sat ✅ 96.21133 383.32030
Z3 Z3-alpha-base sat ✅ 228.05374 227.91548
Z3-Owl-base sat ✅ 39.09802 38.96175
z3siri-base sat ✅ 230.45907 230.32164
Z3-Owl Z3-Owl sat ✅ 209.97809 209.83250