Benchmark

non-incremental/QF_BV/Sage2/bench_14991.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1504840
Compressed Size14552
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1504832
Compressed Size14541
Max. Term Depth190
Asserts 402
Declared Functions0
Declared Constants9
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite1892 not71 =99
let38055 bvand9 bvadd14066 bvmul6506
bvudiv1 bvult20 bvule29 bvugt36
bvuge32 bvslt9 bvsle89 bvsgt1947
bvsge32 bvshl2164 bvlshr43 bvashr4957
zero_extend6454

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.60117 0.60051
Boolector SMT17 final boolector unsat ✅ 0.56242 0.56115
CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.79963 4.92799
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 2.89306 2.88781
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.22825 0.22733
Q3B Q3B default unknown ❌ 600.04600 1466.75000
STP stp_st default unsat ✅ 1.46857 1.46752
stp_mt default unsat ✅ 2.09923 4.20018
Yices2 Yices2-Main default unsat ✅ 0.11187 0.11047
Z3 z3-4.5.0 default unsat ✅ 1.97805 1.97677
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.55266 0.55234
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.02158 3.02137
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 2.84421 2.84509
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.22379 0.22363
Minkeyrink ST_st unsat ✅ 0.22363 0.22369
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.66291 0.66206
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.70997 1.00631
STP-Riss-st-2018_riss-no-stderr unsat ✅ 1.96716 1.96695
Yices2 Yices 2.6.0_default unsat ✅ 0.11141 0.11135
Z3 z3-4.7.1_default unsat ✅ 2.26826 2.26559
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.80944 0.80935
Poolector-wrapped-sq_default unsat ✅ 0.57805 1.87000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.41263 0.41262
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.98961 3.93990
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.22906 0.22922
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.22828 0.22834
Par4 Par4-wrapped-sq_default unsat ✅ 0.15016 0.00617
STP STP-2019-wrapped-sq_default unsat ✅ 0.73372 0.73406
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 2.39875 2.39897
stp-minisat-wrapped-sq_default unsat ✅ 0.78747 0.77652
stp-mt-wrapped-sq_default unsat ✅ 0.76116 1.08402
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 2.45201 2.89061
stp-riss-wrapped-sq_default unknown ❌ 0.62701 0.62718
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.11236 0.11235
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.11295 0.11297
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.11291 0.11292
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 5.54417 5.54384
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.11331 0.11331
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 1.93487 1.93476
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.85713 0.85708
Boolector Boolector-wrapped-sq_default unsat ✅ 0.86017 0.86007
Poolector-wrapped-sq_default unsat ✅ 0.58228 1.03191
CVC4 CVC4-sq-final_default unsat ✅ 21.77520 21.77110
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 47.47610 47.47450
MathSAT MathSAT5_default.sh unsat ✅ 2.37308 2.37288
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.18442 0.18452
MinkeyRink Solver 2020.3_default unsat ✅ 0.19211 0.19215
STP STP_default unsat ✅ 0.67274 0.85777
STP ++ Mergsat v1_default unsat ✅ 0.59019 0.59181
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.12596 0.12588
Z3 z3-4.8.8_default unsat ✅ 1.87248 1.87211
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.22431 1.22400
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 29.12470 29.12220
STP STP 2022.4_default unsat ✅ 0.50992 0.50996
STP 2022.4_default unsat ✅ 0.51008 0.51006
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 4.46181 11.54200
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.13191 0.13182
Z3-Owl z3-Owl-Final_default unsat ✅ 74.40030 74.37910
z3-Owl-Final_default unsat ✅ 75.18320 75.15930
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.69135 0.59155
cvc5 cvc5 unsat ✅ 18.76674 18.66646
SMTInterpol SMTInterpol unsat ✅ 45.51479 69.06826
STP STP unsat ✅ 0.82560 0.72528
Yices2 Yices2 unsat ✅ 0.32362 0.22361
Z3alpha Z3-alpha unsat ✅ 0.51922 0.41956
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.40456 0.28473
Bitwuzla-MachBV-base unsat ✅ 0.54711 0.42467
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.64796 0.52215
BVDecide bv_decide unsat ✅ 100.65576 100.48749
bv_decide-nokernel unsat ✅ 30.86272 30.73084
cvc5 cvc5 unsat ✅ 12.34401 12.22035
SMTInterpol SMTInterpol unsat ✅ 35.80646 49.19077
Yices2 Yices2 unsat ✅ 0.35258 0.22311
Z3alpha Z3-alpha unsat ✅ 0.97688 2.15216
Z3 Z3-alpha-base unsat ✅ 4.38107 4.24879
Z3-Owl-base unsat ✅ 13.22745 13.10603
z3siri-base unsat ✅ 4.38449 4.25945
Z3-Owl Z3-Owl unsat ✅ 35.95609 35.82938