Benchmark

non-incremental/QF_BV/Sage2/bench_2142.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size615374
Compressed Size29410
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 615366
Compressed Size29417
Max. Term Depth556
Asserts 91
Declared Functions0
Declared Constants108
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite76 not25 =119
let14011 bvadd6457 bvmul1928 bvule4
bvslt8 bvsle1 bvsgt4 bvsge30
bvshl1587 bvlshr277 bvashr1765 zero_extend1820

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 6.19329 6.19254
Boolector SMT17 final boolector unsat ✅ 2.12896 2.10935
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.91721 9.53686
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 18.79160 18.78290
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.19273 0.19252
Q3B Q3B default unknown ❌ 1.10747 2.32903
STP stp_st default unsat ✅ 52.39900 52.39600
stp_mt default unsat ✅ 49.97730 184.85400
Yices2 Yices2-Main default unsat ✅ 0.39695 0.39685
Z3 z3-4.5.0 default unsat ✅ 442.23900 442.18900
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 1.26729 1.26694
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 10.17250 10.17220
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 18.85160 18.85310
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.22329 0.22316
Minkeyrink ST_st unsat ✅ 0.22378 0.22386
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 236.75700 236.73100
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 69.91720 262.04500
STP-Riss-st-2018_riss-no-stderr unsat ✅ 12.83360 12.82320
Yices2 Yices 2.6.0_default unsat ✅ 0.32995 0.32981
Z3 z3-4.7.1_default unsat ✅ 22.26890 22.26810
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 6.42327 6.42316
Poolector-wrapped-sq_default unsat ✅ 2.12874 7.92000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.72907 1.72893
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 3.58140 3.58144
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 2.05270 2.65397
MinkeyRink ST-wrapped-sq_default unsat ✅ 1.90224 1.90215
Par4 Par4-wrapped-sq_default unsat ✅ 0.32155 0.00587
STP STP-2019-wrapped-sq_default unsat ✅ 298.27600 298.18500
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 44.15230 44.14680
stp-minisat-wrapped-sq_default unsat ✅ 8.13070 8.13040
stp-mt-wrapped-sq_default unsat ✅ 20.81210 71.03910
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 298.88200 349.92300
stp-riss-wrapped-sq_default unknown ❌ 3.67258 3.67274
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.34929 0.34928
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.82919 0.82918
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 4.96164 4.96161
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.10000 2400.05000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.40766 0.40766
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 2360.15000 2359.95000
SMT-COMP 2020 0.22 (7/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.46709 1.46685
Boolector Boolector-wrapped-sq_default unsat ✅ 1.45881 1.45870
Poolector-wrapped-sq_default unsat ✅ 1.78546 6.56000
CVC4 CVC4-sq-final_default unsat ✅ 12.57130 12.56860
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.08000 1199.97000
MathSAT MathSAT5_default.sh unsat ✅ 7.00316 7.00326
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 1.90887 1.90892
MinkeyRink Solver 2020.3_default unsat ✅ 1.99115 2.39927
STP STP_default unsat ✅ 4.08893 10.47510
STP ++ Mergsat v1_default unsat ✅ 3.45064 3.45233
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.56467 0.56460
Z3 z3-4.8.8_default unknown ❌ 1200.08000 1199.88000
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.45839 1.45820
Bitwuzla-wrapped_default unsat ✅ 1.66895 1.66871
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 12.21980 12.21870
MathSAT MathSAT-5.6.8_default unsat ✅ 7.92374 7.92328
STP STP 2022.4_default unsat ✅ 3.66991 7.23950
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.49440 0.49435
Z3++BV z3++bv_0702_default unsat ✅ 8.17120 8.16994
Z3 z3-4.8.17_default unsat ✅ 29.02940 29.02390
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.83597 1.73629
cvc5 cvc5 unsat ✅ 8.89624 8.79660
SMTInterpol SMTInterpol unknown ❌ 1201.72076 1241.00376
STP STP unsat ✅ 1.97751 1.87651
Yices2 Yices2 unsat ✅ 0.94339 0.84312
Z3alpha Z3-alpha unsat ✅ 74.04324 73.93992
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 1.37186 1.23326
Bitwuzla-MachBV-base unsat ✅ 19.50089 19.37948
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 3.11328 2.99304
BVDecide bv_decide unsat ✅ 70.80055 70.65224
bv_decide-nokernel unsat ✅ 20.78472 20.62817
cvc5 cvc5 unsat ✅ 6.77438 6.65339
SMTInterpol SMTInterpol unsat ✅ 573.71841 590.47933
Yices2 Yices2 unsat ✅ 0.73956 0.61195
Z3alpha Z3-alpha unsat ✅ 12.56197 47.49282
Z3 Z3-alpha-base unsat ✅ 6.54554 6.42584
Z3-Owl-base unsat ✅ 23.85907 23.72247
z3siri-base unsat ✅ 6.89909 6.77780
Z3-Owl Z3-Owl unsat ✅ 158.56986 158.42277