Benchmark

non-incremental/QF_BV/Sage2/bench_17471.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size43866
Compressed Size3504
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 43858
Compressed Size3518
Max. Term Depth40
Asserts 115
Declared Functions0
Declared Constants34
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not37 =42 let898
bvor3 bvadd326 bvmul140 bvult14
bvule24 bvuge19 bvsgt2 bvsge13
bvshl60 zero_extend332

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.57007 0.56894
Boolector SMT17 final boolector unsat ✅ 1.57049 1.53883
CVC4 CVC4-smtcomp2017-main default unsat ✅ 90.21630 181.00500
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 95.77390 95.74690
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 2.62118 2.61920
Q3B Q3B default unknown ❌ 600.04600 1799.55000
STP stp_st default unsat ✅ 238.95300 238.96400
stp_mt default unsat ✅ 272.45500 1083.20000
Yices2 Yices2-Main default unsat ✅ 1.05400 1.05375
Z3 z3-4.5.0 default unsat ✅ 68.74050 68.72180
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 7.51291 7.51303
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 4.74031 4.74006
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 116.56200 116.55000
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.71859 2.60066
Minkeyrink ST_st unsat ✅ 2.08018 2.07997
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 102.86100 102.84500
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 116.42300 462.70200
STP-Riss-st-2018_riss-no-stderr unsat ✅ 145.53200 145.52900
Yices2 Yices 2.6.0_default unsat ✅ 0.28714 0.28707
Z3 z3-4.7.1_default unsat ✅ 23.60040 23.59930
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 12.36310 12.36150
Poolector-wrapped-sq_default unsat ✅ 12.71020 49.98000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 10.67200 10.67270
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 7.54710 7.54674
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.66773 2.45306
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.67256 0.67257
Par4 Par4-wrapped-sq_default unsat ✅ 0.67583 1.86000
STP STP-2019-wrapped-sq_default unsat ✅ 358.56400 358.51800
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 825.45400 825.40400
stp-minisat-wrapped-sq_default unknown ❌ 2400.03000 2399.87000
stp-mt-wrapped-sq_default unsat ✅ 356.96500 1418.22000
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 2400.02000 3610.65000
stp-riss-wrapped-sq_default unknown ❌ 0.13548 0.13567
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.71968 0.71961
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.21598 0.21581
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.29209 0.29207
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.05000 2399.97000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.18530 0.18531
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 31.11370 31.11200
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 16.47500 16.47410
MathSAT mathsat-5.6.6_default unsat ✅ 471.15600 471.06900
STP STP 2021.0_default unsat ✅ 0.98741 3.72990
Z3 z3-4.8.11_default unsat ✅ 6.63172 6.63199
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 1.03384 0.93397
cvc5 cvc5 unsat ✅ 15.43515 15.33493
SMTInterpol SMTInterpol unsat ✅ 8.65685 25.78395
STP STP unsat ✅ 1.24415 1.14412
Yices2 Yices2 unsat ✅ 0.38049 0.27967
Z3alpha Z3-alpha unsat ✅ 6.25225 6.14445
SMT-COMP 2025 0.33 (6/9) Bitwuzla Bitwuzla unsat ✅ 1.97979 1.85845
Bitwuzla-MachBV-base unsat ✅ 0.95900 0.83925
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.26732 1.14289
BVDecide bv_decide unsat ✅ 11.72136 11.56661
bv_decide-nokernel unsat ✅ 10.28099 10.13800
cvc5 cvc5 unsat ✅ 6.10147 5.98265
SMTInterpol SMTInterpol unsat ✅ 5.76663 16.96256
Yices2 Yices2 unsat ✅ 0.53850 0.41179
Z3alpha Z3-alpha unknown ❌ 1201.00733 4802.13232
Z3 Z3-alpha-base unknown ❌ 1201.25472 1200.93641
Z3-Owl-base unknown ❌ 1201.29001 1201.07052
z3siri-base unknown ❌ 1201.25692 1201.01285
Z3-Owl Z3-Owl unknown ❌ 1201.75853 1200.99625