Benchmark

non-incremental/QF_BV/Sage2/bench_10016.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size560378
Compressed Size34166
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 560370
Compressed Size34155
Max. Term Depth748
Asserts 143
Declared Functions0
Declared Constants200
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true3 ite114 not49 =197
let12563 extract99 bvand7 bvadd4442
bvmul1218 bvult4 bvule3 bvugt2
bvuge4 bvslt8 bvsle20 bvsgt9
bvsge11 bvshl2590 bvlshr683 bvashr687
zero_extend2558

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.50 (4/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 47.42240 47.41980
Boolector SMT17 final boolector sat ✅ 265.74700 265.70000
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.16300 1205.11000
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.02000 599.88000
MinkeyRink MinkeyRink 2017.3a default sat ✅ 19.41100 31.02000
Q3B Q3B default unknown ❌ 0.81470 1.76507
STP stp_st default unknown ❌ 600.01600 599.93800
stp_mt default sat ✅ 523.96700 2067.22000
Yices2 Yices2-Main default sat ✅ 0.27342 0.27299
Z3 z3-4.5.0 default unknown ❌ 600.02100 599.84500
SMT-COMP 2018 0.29 (5/7) Boolector Boolector_default sat ✅ 33.40040 33.39800
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 37.93070 37.92560
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 1200.06000 1199.84000
MinkeyRink Minkeyrink MT_mt sat ✅ 318.66000 1258.86000
Minkeyrink ST_st sat ✅ 479.32300 479.31100
STP STP-CMS-st-2018_default-no-stderr sat ✅ 1117.57000 1117.45000
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 699.50700 2690.17000
STP-Riss-st-2018_riss-no-stderr unknown ❌ 1200.02000 1199.99000
Yices2 Yices 2.6.0_default sat ✅ 0.25206 0.25197
Z3 z3-4.7.1_default unknown ❌ 1200.01000 1199.86000
SMT-COMP 2021 0.25 (3/4) Bitwuzla Bitwuzla-fixed_default sat ✅ 98.65580 98.62090
MathSAT mathsat-5.6.6_default sat ✅ 43.20180 43.18920
STP STP 2021.0_default sat ✅ 2.95512 3.93191
Z3 z3-4.8.11_default unknown ❌ 1200.02000 1199.83000
SMT-COMP 2022 0.29 (5/7) Bitwuzla Bitwuzla-fixed_default sat ✅ 1.54100 1.54033
Bitwuzla-wrapped_default sat ✅ 100.64200 100.59700
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.03000 1199.77000
MathSAT MathSAT-5.6.8_default sat ✅ 8.08120 8.08078
STP STP 2022.4_default sat ✅ 65.96030 65.96020
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 39.64590 39.64270
Z3++BV z3++bv_0702_default sat ✅ 454.79300 454.58000
Z3 z3-4.8.17_default unknown ❌ 1200.02000 1199.93000
SMT-COMP 2024 0.33 (4/6) Bitwuzla Bitwuzla sat ✅ 66.63281 66.49745
cvc5 cvc5 sat ✅ 352.30283 352.03458
SMTInterpol SMTInterpol unknown ❌ 1201.71791 1237.46359
STP STP sat ✅ 128.38346 128.21800
Yices2 Yices2 sat ✅ 53.16926 53.04254
Z3alpha Z3-alpha unknown ❌ 1201.71513 1201.08730
SMT-COMP 2025 0.33 (6/9) Bitwuzla Bitwuzla sat ✅ 104.35740 104.21065
Bitwuzla-MachBV-base sat ✅ 10.88748 10.75671
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 10.90626 10.76819
BVDecide bv_decide sat ✅ 101.04731 100.95991
bv_decide-nokernel sat ✅ 100.66424 100.58240
cvc5 cvc5 sat ✅ 127.86458 127.72022
SMTInterpol SMTInterpol unknown ❌ 1201.74838 1231.56211
Yices2 Yices2 sat ✅ 24.87236 24.73629
Z3alpha Z3-alpha unknown ❌ 1201.00526 4801.40257
Z3 Z3-alpha-base unknown ❌ 1201.38014 1201.12505
Z3-Owl-base unknown ❌ 1201.32750 1201.06986
z3siri-base unknown ❌ 1201.36978 1201.13534
Z3-Owl Z3-Owl sat ✅ 622.83413 622.57839