Benchmark

non-incremental/QF_BV/Sage2/bench_9835.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size28582
Compressed Size2575
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 28574
Compressed Size2587
Max. Term Depth27
Asserts 88
Declared Functions0
Declared Constants6
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not23 =24 let631
bvand5 bvadd335 bvmul22 bvult8
bvule16 bvugt6 bvuge33 bvlshr7
zero_extend239

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.10898 0.10893
Boolector SMT17 final boolector unsat ✅ 0.24924 0.24924
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.29630 0.56630
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.14787 0.14842
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.10266 0.07258
Q3B Q3B default unsat ✅ 0.21554 0.21767
STP stp_st default unsat ✅ 0.96701 0.96197
stp_mt default unsat ✅ 0.89463 3.33884
Yices2 Yices2-Main default unsat ✅ 0.00870 0.00724
Z3 z3-4.5.0 default unsat ✅ 14.09080 14.08940
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.07517 0.07514
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.15334 0.15354
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.14963 0.15059
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.05187 0.05898
Minkeyrink ST_st unsat ✅ 0.04893 0.04907
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 3.55679 3.55660
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 3.11579 12.19720
STP-Riss-st-2018_riss-no-stderr unsat ✅ 2.23502 2.23518
Yices2 Yices 2.6.0_default unsat ✅ 0.00988 0.00981
Z3 z3-4.7.1_default unsat ✅ 6.34543 6.34513
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.12553 0.12555
Poolector-wrapped-sq_default unsat ✅ 0.17828 0.11896
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.15133 0.15136
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.08940 0.08962
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.04469 0.04963
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.03983 0.03995
Par4 Par4-wrapped-sq_default unsat ✅ 0.01695 0.00572
STP STP-2019-wrapped-sq_default unsat ✅ 1.67160 1.67190
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 6.19161 6.19188
stp-minisat-wrapped-sq_default unsat ✅ 0.85618 0.85645
stp-mt-wrapped-sq_default unsat ✅ 1.63652 6.28450
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 6.28393 8.71540
stp-riss-wrapped-sq_default unknown ❌ 0.05848 0.05852
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.00997 0.00999
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.01214 0.01218
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.01304 0.01307
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 1447.63000 1447.55000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.01558 0.01556
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 7.72695 7.72698
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.18021 0.17956
Boolector Boolector-wrapped-sq_default unsat ✅ 0.13370 0.13370
Poolector-wrapped-sq_default unsat ✅ 0.17755 0.11821
CVC4 CVC4-sq-final_default unsat ✅ 0.11396 0.11426
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.10516 0.10513
MathSAT MathSAT5_default.sh unsat ✅ 0.07481 0.07477
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.04161 0.04186
MinkeyRink Solver 2020.3_default unsat ✅ 0.04463 0.04976
STP STP_default unsat ✅ 0.03420 0.04071
STP ++ Mergsat v1_default unsat ✅ 0.02526 0.02683
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.01308 0.01207
Z3 z3-4.8.8_default unsat ✅ 15.49100 15.49060
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.16943 0.16936
MathSAT mathsat-5.6.6_default unsat ✅ 0.07790 0.07743
STP STP 2021.0_default unsat ✅ 0.03544 0.04265
Z3 z3-4.8.11_default unsat ✅ 17.69750 17.69600
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.04612 0.04608
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.48200 0.48167
STP STP 2022.4_default unsat ✅ 0.03340 0.03346
STP 2022.4_default unsat ✅ 0.03342 0.03344
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 4.99315 14.47270
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.01037 0.00919
Z3-Owl z3-Owl-Final_default unsat ✅ 15.86980 15.86760
z3-Owl-Final_default unsat ✅ 7.34593 7.34529
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.41525 0.31548
cvc5 cvc5 unsat ✅ 0.61997 0.52046
SMTInterpol SMTInterpol unsat ✅ 0.87119 2.02529
STP STP unsat ✅ 0.23489 0.13548
Yices2 Yices2 unsat ✅ 0.21675 0.11689
Z3alpha Z3-alpha unsat ✅ 61.79338 61.66381
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.29907 0.17014
Bitwuzla-MachBV-base unsat ✅ 0.47345 0.34722
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.38059 0.25794
BVDecide bv_decide unsat ✅ 1.50465 1.33275
bv_decide-nokernel unsat ✅ 1.03885 0.86734
cvc5 cvc5 unsat ✅ 0.63376 0.51638
SMTInterpol SMTInterpol unsat ✅ 0.94588 2.13022
Yices2 Yices2 unsat ✅ 0.29633 0.17075
Z3alpha Z3-alpha unsat ✅ 57.66695 229.29226
Z3 Z3-alpha-base unsat ✅ 17.99805 17.87211
Z3-Owl-base unsat ✅ 81.04094 80.90458
z3siri-base unsat ✅ 18.09911 17.98081
Z3-Owl Z3-Owl unsat ✅ 15.28354 15.15807