Benchmark

non-incremental/QF_BV/sage/app7/bench_792.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size4422647
Compressed Size275577
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 4422639
Compressed Size275582
Max. Term Depth16968
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2719 and1
=3501 let16754 extract1712 bvand45729
bvor30132 bvxor2276 bvadd49158 bvmul9
bvsub16109 bvsdiv27 bvult621 bvule644
bvslt220 bvsle125 bvshl15791 bvashr29849
zero_extend1515

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.71332 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.65996 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.65195 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.64243 —
abziz_portfolio_2012_solvers default unsat ✅ 0.65550 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.64345 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.94411 —
Boolector-SMT-COMP-2011 default unsat ✅ 1.06015 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.99839 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 241.77100 —
CVC3-SMT-COMP-2011 default unsat ✅ 204.37500 —
CVC3-SMT-COMP-2012 default unsat ✅ 213.82200 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.64510 —
CVC4-SMT-EVAL-2013 default unsat ✅ 5.52329 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.30599 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.26913 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.63512 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.61709 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 1.14213 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 5.55422 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 8.18606 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.87226 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.72818 —
STP2-SMT-COMP-2012 default unsat ✅ 0.70615 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.77133 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.68925 —
Z3-SMT-COMP-2011 default unsat ✅ 0.63587 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 1.16554 1.16497
Boolector SMT17 final boolector unsat ✅ 1.16687 1.16666
CVC4 CVC4-smtcomp2017-main default unsat ✅ 5.79092 9.20683
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.86350 0.86359
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.66694 1.66623
Q3B Q3B default unsat ✅ 1.15792 3.04345
STP stp_st default unsat ✅ 0.79727 0.79639
stp_mt default unsat ✅ 0.79837 0.79708
Yices2 Yices2-Main default unsat ✅ 0.47606 0.47526
Z3 z3-4.5.0 default unsat ✅ 0.63001 0.62904
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 1.04194 1.04157
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 5.32672 5.32652
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.83350 0.83452
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.69311 1.69301
Minkeyrink ST_st unsat ✅ 1.70473 1.70485
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.94069 0.94079
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.82913 0.82909
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.82439 0.82437
Yices2 Yices 2.6.0_default unsat ✅ 0.47420 0.47406
Z3 z3-4.7.1_default unsat ✅ 0.72862 0.72849
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.67001 1.66968
Boolector Boolector-wrapped-sq_default unsat ✅ 1.99985 1.99992
Poolector-wrapped-sq_default unsat ✅ 2.38121 8.99699
CVC4 CVC4-sq-final_default unsat ✅ 7.24181 7.24179
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 1.04958 1.04945
MathSAT MathSAT5_default.sh unsat ✅ 0.86091 0.86086
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.94525 0.94540
MinkeyRink Solver 2020.3_default unsat ✅ 0.98343 0.98326
STP STP_default unsat ✅ 0.77681 0.77688
STP ++ Mergsat v1_default unsat ✅ 0.77256 0.77416
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.50314 0.50302
Z3 z3-4.8.8_default unsat ✅ 0.68882 0.68871
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.66032 1.66019
MathSAT mathsat-5.6.6_default unsat ✅ 0.87057 0.87058
STP STP 2021.0_default unsat ✅ 0.79672 0.79685
Z3 z3-4.8.11_default unsat ✅ 0.57352 0.57349
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.65669 1.65641
Bitwuzla-wrapped_default unsat ✅ 1.83218 1.83059
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 5.68750 11.28800
MathSAT MathSAT-5.6.8_default unsat ✅ 0.87723 0.87706
STP STP 2022.4_default unsat ✅ 0.84141 0.84140
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.49044 0.49037
Z3++BV z3++bv_0702_default unsat ✅ 0.52123 0.52109
Z3 z3-4.8.17_default unsat ✅ 0.52192 0.52372
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.56307 1.46266
cvc5 cvc5 unsat ✅ 2.33417 2.23136
SMTInterpol SMTInterpol unknown ❌ 1202.71989 1418.59992
STP STP unsat ✅ 73.57940 73.43472
Yices2 Yices2 unsat ✅ 0.54495 0.44521
Z3alpha Z3-alpha unsat ✅ 0.62112 0.52149
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 1.19500 1.06519
Bitwuzla-MachBV-base unsat ✅ 1.46354 1.33092
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.70396 1.58046
BVDecide bv_decide unknown ❌ 1201.36865 1201.03213
bv_decide-nokernel unknown ❌ 1201.38764 1200.98788
cvc5 cvc5 unsat ✅ 0.91450 0.78379
SMTInterpol SMTInterpol unknown ❌ 1201.88571 1642.72853
Yices2 Yices2 unsat ✅ 0.56762 0.44334
Z3alpha Z3-alpha unsat ✅ 1.06017 1.07462
Z3 Z3-alpha-base unsat ✅ 0.58738 0.45979
Z3-Owl-base unsat ✅ 1.58000 1.45901
z3siri-base unsat ✅ 0.58790 0.45642
Z3-Owl Z3-Owl unsat ✅ 1.12461 0.99619