Benchmark

non-incremental/QF_BV/Sage2/bench_12052.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size104122
Compressed Size5550
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 104114
Compressed Size5555
Max. Term Depth26
Asserts 244
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite52 not29 =38
let2216 bvor27 bvadd1745 bvmul190
bvult109 bvule76 bvugt12 bvuge60
bvshl27 bvlshr3 zero_extend91

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.25 (6/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 20.50690 20.49270
Boolector SMT17 final boolector unsat ✅ 41.01210 41.00580
CVC4 CVC4-smtcomp2017-main default unsat ✅ 16.38580 32.79510
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.10300 600.00200
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.39698 0.39048
Q3B Q3B default unknown ❌ 600.04900 1433.59000
STP stp_st default unsat ✅ 148.39400 148.38800
stp_mt default unsat ✅ 144.90900 459.14300
Yices2 Yices2-Main default unsat ✅ 0.13132 0.13092
Z3 z3-4.5.0 default unsat ✅ 6.67392 6.66921
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.25016 0.25011
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 5.03559 5.03542
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 1069.51000 1069.42000
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.21735 0.34142
Minkeyrink ST_st unsat ✅ 0.20188 0.20206
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 98.63430 98.61800
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 80.03560 317.74100
STP-Riss-st-2018_riss-no-stderr unsat ✅ 80.95110 80.94470
Yices2 Yices 2.6.0_default unsat ✅ 0.12248 0.12241
Z3 z3-4.7.1_default unsat ✅ 17.15860 17.15740
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 8.68238 8.68222
Poolector-wrapped-sq_default unsat ✅ 9.17166 35.92000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 15.48950 15.48970
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 12.28670 12.28720
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.19195 0.28823
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.17551 0.17561
Par4 Par4-wrapped-sq_default unsat ✅ 0.07174 0.00621
STP STP-2019-wrapped-sq_default unsat ✅ 205.43700 205.42900
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 194.31100 194.28700
stp-minisat-wrapped-sq_default unsat ✅ 1025.87000 1025.63000
stp-mt-wrapped-sq_default unsat ✅ 190.38600 755.73100
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 1059.59000 1529.74000
stp-riss-wrapped-sq_default unknown ❌ 0.21044 0.21067
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.06612 0.06610
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.09040 0.09039
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.06213 0.06212
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.04251 0.04246
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.07849 0.07852
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 8.47909 8.47710
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 12.29450 12.29300
Boolector Boolector-wrapped-sq_default unsat ✅ 5.93317 5.93321
Poolector-wrapped-sq_default unsat ✅ 6.40148 24.84000
CVC4 CVC4-sq-final_default unsat ✅ 3.35877 3.35900
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.02000 1199.90000
MathSAT MathSAT5_default.sh unsat ✅ 681.98400 681.90700
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.14751 0.14777
MinkeyRink Solver 2020.3_default unsat ✅ 0.18724 0.29952
STP STP_default unsat ✅ 0.15131 0.27607
STP ++ Mergsat v1_default unsat ✅ 0.13432 0.13597
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.05630 0.05626
Z3 z3-4.8.8_default unsat ✅ 7.59015 7.58935
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 1.55629 1.45618
cvc5 cvc5 unsat ✅ 13.54105 13.43288
SMTInterpol SMTInterpol unsat ✅ 14.41020 32.58909
STP STP unsat ✅ 0.34243 0.24228
Yices2 Yices2 unsat ✅ 0.32662 0.22685
Z3alpha Z3-alpha unsat ✅ 11.61990 11.51995
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 2.70361 2.58164
Bitwuzla-MachBV-base unsat ✅ 1.51081 1.39750
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.39079 0.26990
BVDecide bv_decide unsat ✅ 3.87225 3.71097
bv_decide-nokernel unsat ✅ 2.43947 2.27870
cvc5 cvc5 unsat ✅ 7.86300 7.74571
SMTInterpol SMTInterpol unsat ✅ 36.38054 51.32729
Yices2 Yices2 unsat ✅ 0.36422 0.24539
Z3alpha Z3-alpha unsat ✅ 8.65740 33.21129
Z3 Z3-alpha-base unsat ✅ 324.22388 324.08473
Z3-Owl-base unknown ❌ 1201.29360 1201.11756
z3siri-base unsat ✅ 327.17094 326.96837
Z3-Owl Z3-Owl unsat ✅ 794.04657 793.79986