Benchmark

non-incremental/QF_BV/Sage2/bench_13449.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size586142
Compressed Size17885
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 586134
Compressed Size17875
Max. Term Depth1121
Asserts 322
Declared Functions0
Declared Constants540
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false1 not46 =52
let13027 extract9 bvand4 bvor6
bvadd4596 bvmul223 bvudiv9 bvult54
bvule99 bvugt11 bvuge102 bvsle1
bvsge3 bvshl3468 bvlshr29 zero_extend4636

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 1.39118 1.39037
Boolector SMT17 final boolector sat ✅ 3.25300 3.24547
CVC4 CVC4-smtcomp2017-main default sat ✅ 6.74024 13.24180
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 171.01800 170.98200
MinkeyRink MinkeyRink 2017.3a default sat ✅ 1.45214 1.44007
Q3B Q3B default unknown ❌ 600.05800 1793.20000
STP stp_st default sat ✅ 2.25370 2.25296
stp_mt default sat ✅ 2.52766 8.28750
Yices2 Yices2-Main default sat ✅ 1.29999 1.29897
Z3 z3-4.5.0 default sat ✅ 9.36304 9.36258
SMT-COMP 2018 Boolector Boolector_default sat ✅ 1.48150 1.48127
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 6.95404 6.95363
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 186.63100 186.61300
MinkeyRink Minkeyrink MT_mt sat ✅ 1.10855 2.41690
Minkeyrink ST_st sat ✅ 1.00759 1.00721
STP STP-CMS-st-2018_default-no-stderr sat ✅ 2.27398 2.27369
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 1.20658 3.26399
STP-Riss-st-2018_riss-no-stderr sat ✅ 4.41269 4.41246
Yices2 Yices 2.6.0_default sat ✅ 0.56304 0.56295
Z3 z3-4.7.1_default sat ✅ 9.33146 9.33097
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 2.51062 2.51033
Poolector-wrapped-sq_default sat ✅ 1.08724 3.86000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 6.04144 6.04125
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 11.74580 11.74530
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.93559 2.02812
MinkeyRink ST-wrapped-sq_default sat ✅ 1.04352 1.04357
Par4 Par4-wrapped-sq_default sat ✅ 1.02092 2.82000
STP STP-2019-wrapped-sq_default sat ✅ 1.52213 1.52245
stp-mergesat-fixed-wrapped-sq_default sat ✅ 6.26741 6.26753
stp-minisat-wrapped-sq_default sat ✅ 1.75529 1.75541
stp-mt-wrapped-sq_default sat ✅ 1.73193 5.15929
stp-portfolio-fixed-wrapped-sq_default sat ✅ 6.40278 8.98758
stp-riss-wrapped-sq_default unknown ❌ 0.54752 0.54743
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.48446 0.48444
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 2.39171 2.39165
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 2.17271 2.17259
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.10000 2399.98000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.68290 0.68285
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 18.87130 18.86840
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 2.40042 2.40009
MathSAT mathsat-5.6.6_default sat ✅ 678.59200 678.56200
STP STP 2021.0_default sat ✅ 0.89703 2.36377
Z3 z3-4.8.11_default sat ✅ 27.72990 27.72860
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 2.71664 2.71646
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 15.76090 15.75530
STP STP 2022.4_default sat ✅ 1.35169 1.35158
STP 2022.4_default sat ✅ 1.34883 1.34867
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 4.73219 13.65990
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.96034 0.96036
Z3-Owl z3-Owl-Final_default sat ✅ 28.33250 28.33040
z3-Owl-Final_default sat ✅ 30.41430 30.41540
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 1.95898 1.85907
cvc5 cvc5 sat ✅ 12.66115 12.56128
SMTInterpol SMTInterpol unknown ❌ 14.23860 34.41362
STP STP sat ✅ 1.84520 1.74530
Yices2 Yices2 sat ✅ 0.80401 0.70423
Z3alpha Z3-alpha sat ✅ 125.43476 125.26736
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 1.41111 1.29430
Bitwuzla-MachBV-base sat ✅ 1.79896 1.67323
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 1.73523 1.61705
BVDecide bv_decide sat ✅ 9.12186 8.95647
bv_decide-nokernel sat ✅ 8.35495 8.23560
cvc5 cvc5 sat ✅ 10.51968 10.39593
SMTInterpol SMTInterpol unknown ❌ 10.62331 22.06116
Yices2 Yices2 sat ✅ 1.08975 0.95944
Z3alpha Z3-alpha sat ✅ 19.58137 73.64222
Z3 Z3-alpha-base sat ✅ 16.42289 16.29657
Z3-Owl-base sat ✅ 75.91191 75.77983
z3siri-base sat ✅ 17.62916 17.50198
Z3-Owl Z3-Owl sat ✅ 12.63001 12.50333