Benchmark

non-incremental/QF_BV/sage/app7/bench_8587.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3336378
Compressed Size212218
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3336370
Compressed Size212224
Max. Term Depth12814
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not2243 and1
=2949 let12709 extract1617 bvand34146
bvor22407 bvxor2082 bvadd36788 bvmul7
bvsub11949 bvsdiv19 bvult553 bvule600
bvslt217 bvsle123 bvshl11740 bvashr22019
zero_extend1398

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.49642 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.49811 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.50741 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.51059 —
abziz_portfolio_2012_solvers default unsat ✅ 0.49810 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.49806 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.66622 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.80384 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.70155 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 173.66700 —
CVC3-SMT-COMP-2011 default unsat ✅ 146.82700 —
CVC3-SMT-COMP-2012 default unsat ✅ 153.52400 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.85300 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.52859 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.99464 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.96753 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.24866 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.20707 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.87183 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.05714 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.17359 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.35779 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.52963 —
STP2-SMT-COMP-2012 default unsat ✅ 0.49860 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.52829 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.53492 —
Z3-SMT-COMP-2011 default unsat ✅ 0.51337 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.91084 0.90472
Boolector SMT17 final boolector unsat ✅ 0.90780 0.90698
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.28597 6.88101
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.65617 0.65592
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.27852 1.27769
Q3B Q3B default unsat ✅ 0.87048 2.23000
STP stp_st default unsat ✅ 0.59527 0.59417
stp_mt default unsat ✅ 0.58346 0.58263
Yices2 Yices2-Main default unsat ✅ 0.37648 0.37101
Z3 z3-4.5.0 default unsat ✅ 0.55576 0.55501
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.78483 0.78474
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.98393 3.98395
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.63297 0.63403
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.27072 1.27079
Minkeyrink ST_st unsat ✅ 1.27284 1.27277
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.57661 0.57659
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.63856 0.63866
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.58241 0.58242
Yices2 Yices 2.6.0_default unsat ✅ 0.36893 0.36880
Z3 z3-4.7.1_default unsat ✅ 0.80429 0.80378
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.26365 1.26227
Boolector Boolector-wrapped-sq_default unsat ✅ 1.50694 1.50677
Poolector-wrapped-sq_default unsat ✅ 1.77996 6.44000
CVC4 CVC4-sq-final_default unsat ✅ 5.43422 5.43369
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.80316 0.80300
MathSAT MathSAT5_default.sh unsat ✅ 0.66261 0.66256
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.73955 0.73972
MinkeyRink Solver 2020.3_default unsat ✅ 0.77182 0.77187
STP STP_default unsat ✅ 0.54692 0.54696
STP ++ Mergsat v1_default unsat ✅ 0.54162 0.54322
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.38153 0.38147
Z3 z3-4.8.8_default unsat ✅ 0.40648 0.40640
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.24163 1.24160
MathSAT mathsat-5.6.6_default unsat ✅ 0.66862 0.66832
STP STP 2021.0_default unsat ✅ 0.56877 0.56887
Z3 z3-4.8.11_default unsat ✅ 0.54728 0.54723
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.24859 1.24844
Bitwuzla-wrapped_default unsat ✅ 1.37232 1.37207
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.21688 4.21727
MathSAT MathSAT-5.6.8_default unsat ✅ 0.67359 0.67109
STP STP 2022.4_default unsat ✅ 0.61042 0.61043
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.37473 0.37441
Z3++BV z3++bv_0702_default unsat ✅ 0.69775 0.69759
Z3 z3-4.8.17_default unsat ✅ 0.63756 0.63943
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.30411 1.20401
cvc5 cvc5 unsat ✅ 1.66989 1.57030
SMTInterpol SMTInterpol unknown ❌ 1202.71984 1422.17952
STP STP unsat ✅ 47.72733 47.61002
Yices2 Yices2 unsat ✅ 0.52278 0.42310
Z3alpha Z3-alpha unsat ✅ 0.65456 0.55501
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.99043 0.86108
Bitwuzla-MachBV-base unsat ✅ 1.20775 1.09023
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.41408 1.28054
BVDecide bv_decide unknown ❌ 1201.38708 1201.11813
bv_decide-nokernel unknown ❌ 1201.38552 1201.00924
cvc5 cvc5 unsat ✅ 0.78641 0.66344
SMTInterpol SMTInterpol unknown ❌ 1201.88770 1648.05066
Yices2 Yices2 unsat ✅ 0.51144 0.37668
Z3alpha Z3-alpha unsat ✅ 0.93391 0.91990
Z3 Z3-alpha-base unsat ✅ 0.52789 0.40907
Z3-Owl-base unsat ✅ 1.50837 1.38700
z3siri-base unsat ✅ 0.54440 0.41885
Z3-Owl Z3-Owl unsat ✅ 1.07317 0.94717