Benchmark

non-incremental/QF_BV/Sage2/bench_16935.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size22330
Compressed Size1659
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 22322
Compressed Size1652
Max. Term Depth24
Asserts 68
Declared Functions0
Declared Constants7
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not15 =16 let492
bvadd277 bvmul4 bvult11 bvule23
bvugt2 bvuge15 bvlshr7 zero_extend189

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.06058 0.06033
Boolector SMT17 final boolector unsat ✅ 0.22511 0.22540
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.59442 1.16513
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.06859 0.06935
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.09747 0.06211
Q3B Q3B default unsat ✅ 0.15304 0.18617
STP stp_st default unsat ✅ 0.29138 0.29179
stp_mt default unsat ✅ 0.23655 0.78397
Yices2 Yices2-Main default unsat ✅ 0.00758 0.00555
Z3 z3-4.5.0 default unsat ✅ 175.84700 175.82100
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.03963 0.03960
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.12989 0.13004
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.06722 0.06823
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.04684 0.05154
Minkeyrink ST_st unsat ✅ 0.04425 0.04441
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.32850 0.32872
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.33289 1.18326
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.48284 0.48179
Yices2 Yices 2.6.0_default unsat ✅ 0.00839 0.00837
Z3 z3-4.7.1_default unsat ✅ 0.53901 0.53891
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.05878 0.05879
Poolector-wrapped-sq_default unsat ✅ 0.18075 0.18502
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.11562 0.11562
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.07500 0.07526
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.05092 0.05451
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.04661 0.04671
Par4 Par4-wrapped-sq_default unsat ✅ 0.02066 0.00759
STP STP-2019-wrapped-sq_default unsat ✅ 0.41776 0.41809
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 4.67080 4.67088
stp-minisat-wrapped-sq_default unsat ✅ 0.14699 0.14722
stp-mt-wrapped-sq_default unsat ✅ 0.28772 0.96795
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 4.86283 5.35188
stp-riss-wrapped-sq_default unknown ❌ 0.04543 0.04566
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.01202 0.00960
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.01053 0.01052
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.01073 0.01073
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.03000 2399.88000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.01224 0.01225
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 14.18210 14.18100
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.08951 0.08939
Boolector Boolector-wrapped-sq_default unsat ✅ 0.06463 0.06462
Poolector-wrapped-sq_default unsat ✅ 0.18262 0.18936
CVC4 CVC4-sq-final_default unsat ✅ 3.73395 3.73385
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.08592 0.08587
MathSAT MathSAT5_default.sh unsat ✅ 0.03915 0.03911
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.04527 0.04551
MinkeyRink Solver 2020.3_default unsat ✅ 0.04831 0.05143
STP STP_default unsat ✅ 0.03023 0.03565
STP ++ Mergsat v1_default unsat ✅ 0.02100 0.02268
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.01261 0.00822
Z3 z3-4.8.8_default unsat ✅ 35.06820 35.06680
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.08524 0.08517
MathSAT mathsat-5.6.6_default unsat ✅ 0.03928 0.03925
STP STP 2021.0_default unsat ✅ 0.02904 0.03292
Z3 z3-4.8.11_default unsat ✅ 223.16300 223.13600
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.23277 0.13266
cvc5 cvc5 unsat ✅ 0.51053 0.41035
SMTInterpol SMTInterpol unsat ✅ 0.80091 1.71775
STP STP unsat ✅ 0.22931 0.12927
Yices2 Yices2 unsat ✅ 0.21443 0.11437
Z3alpha Z3-alpha unsat ✅ 3.13194 3.03221
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.29075 0.16223
Bitwuzla-MachBV-base unsat ✅ 0.29185 0.16572
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.38801 0.25971
BVDecide bv_decide unsat ✅ 1.34134 1.16331
bv_decide-nokernel unsat ✅ 0.92424 0.75467
cvc5 cvc5 unsat ✅ 0.52875 0.40224
SMTInterpol SMTInterpol unsat ✅ 0.71558 1.41571
Yices2 Yices2 unsat ✅ 0.28626 0.16521
Z3alpha Z3-alpha unsat ✅ 2.58314 9.15890
Z3 Z3-alpha-base unsat ✅ 11.42012 11.29538
Z3-Owl-base unsat ✅ 50.25401 50.12056
z3siri-base unsat ✅ 11.53862 11.40424
Z3-Owl Z3-Owl unsat ✅ 4.36749 4.24962