Benchmark

non-incremental/QF_BV/sage/app7/bench_6491.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3464163
Compressed Size221038
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3464155
Compressed Size221044
Max. Term Depth13287
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not2408 and1
=3128 let13182 extract1677 bvand35348
bvor23187 bvxor2195 bvadd38201 bvmul7
bvsub12368 bvsdiv19 bvult584 bvule625
bvslt219 bvsle124 bvshl12181 bvashr22821
zero_extend1479

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.51345 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.56258 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.56399 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.56321 —
abziz_portfolio_2012_solvers default unsat ✅ 0.55956 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.56627 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.69269 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.82807 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.72218 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 175.09200 —
CVC3-SMT-COMP-2011 default unsat ✅ 147.77600 —
CVC3-SMT-COMP-2012 default unsat ✅ 154.44600 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.05009 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.68667 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.03622 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.99412 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.29956 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.26229 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.90217 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.26766 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.38194 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.39829 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.54816 —
STP2-SMT-COMP-2012 default unsat ✅ 0.51385 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.54697 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.61085 —
Z3-SMT-COMP-2011 default unsat ✅ 0.55390 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.95230 0.95228
Boolector SMT17 final boolector unsat ✅ 0.95236 0.95111
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.60578 7.41510
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.67027 0.66950
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.33698 1.33584
Q3B Q3B default unsat ✅ 0.86485 2.11000
STP stp_st default unsat ✅ 0.58593 0.58523
stp_mt default unsat ✅ 0.61096 0.61095
Yices2 Yices2-Main default unsat ✅ 0.38863 0.38218
Z3 z3-4.5.0 default unsat ✅ 0.68293 0.67675
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.81666 0.81650
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 4.75758 4.75790
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.66160 0.66270
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.32908 1.32894
Minkeyrink ST_st unsat ✅ 1.32980 1.32985
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.59778 0.59777
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.60101 0.60103
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.60049 0.60054
Yices2 Yices 2.6.0_default unsat ✅ 0.38139 0.38132
Z3 z3-4.7.1_default unsat ✅ 0.58193 0.58180
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.29266 1.29257
MathSAT mathsat-5.6.6_default unsat ✅ 0.70346 0.70342
STP STP 2021.0_default unsat ✅ 0.58969 0.58970
Z3 z3-4.8.11_default unsat ✅ 0.44179 0.44171
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.28079 1.28059
Bitwuzla-wrapped_default unsat ✅ 1.39595 1.39467
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.44123 4.43958
MathSAT MathSAT-5.6.8_default unsat ✅ 0.73369 0.73337
STP STP 2022.4_default unsat ✅ 0.62828 0.62838
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.39186 0.39066
Z3++BV z3++bv_0702_default unsat ✅ 0.73200 0.73130
Z3 z3-4.8.17_default unsat ✅ 0.64841 0.65023
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.03192 2.03174
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 3.20438 3.20490
STP STP 2022.4_default unsat ✅ 0.62933 0.62937
STP 2022.4_default unsat ✅ 0.63956 0.63954
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.11000 1314.47000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.39079 0.38970
Z3-Owl z3-Owl-Final_default unsat ✅ 1.08804 2.08806
z3-Owl-Final_default unsat ✅ 1.08583 2.12620
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.21452 1.11329
cvc5 cvc5 unsat ✅ 1.97074 1.87037
SMTInterpol SMTInterpol unknown ❌ 1202.71861 1408.67187
STP STP unsat ✅ 49.96955 49.84112
Yices2 Yices2 unsat ✅ 0.47832 0.37829
Z3alpha Z3-alpha unsat ✅ 0.56480 0.46509
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 1.29459 1.15635
Bitwuzla-MachBV-base unsat ✅ 1.24078 1.11572
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.39279 1.27031
BVDecide bv_decide unknown ❌ 1201.39073 1201.00959
bv_decide-nokernel unknown ❌ 1201.34802 1200.99391
cvc5 cvc5 unsat ✅ 1.42603 1.30089
SMTInterpol SMTInterpol unknown ❌ 1201.88882 1538.14637
Yices2 Yices2 unsat ✅ 0.48305 0.36581
Z3alpha Z3-alpha unsat ✅ 0.97158 0.95627
Z3 Z3-alpha-base unsat ✅ 0.66213 0.53488
Z3-Owl-base unsat ✅ 2.09259 1.96328
z3siri-base unsat ✅ 0.66497 0.53747
Z3-Owl Z3-Owl unsat ✅ 1.25357 1.12587