Benchmark

non-incremental/QF_BV/sage/app11/bench_611.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1536233
Compressed Size151830
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1536225
Compressed Size151836
Max. Term Depth4219
Asserts 1
Declared Functions0
Declared Constants8425
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true2 false1 ite92 not1316
and1 =2120 let2886 extract1506
bvand993 bvor282 bvxor2297 bvadd14670
bvmul1186 bvsdiv16 bvult1100 bvule1515
bvslt123 bvsle162 bvshl8919 bvashr13285
zero_extend10191

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.16088 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.40961 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.40781 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.41088 —
abziz_portfolio_2012_solvers default unsat ✅ 0.40844 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.41192 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.21952 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.30752 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.23803 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 30.85650 —
CVC3-SMT-COMP-2011 default unsat ✅ 26.27470 —
CVC3-SMT-COMP-2012 default unsat ✅ 27.25440 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.70125 —
CVC4-SMT-EVAL-2013 default unsat ✅ 13.54410 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.45971 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.45601 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 23.44430 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.54926 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.47125 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 7.96225 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.81307 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.54505 —
STP STP2-SMT-COMP-2011 default unsat ✅ 1.09945 —
STP2-SMT-COMP-2012 default unsat ✅ 0.16641 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.25508 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.44650 —
Z3-SMT-COMP-2011 default unsat ✅ 0.40415 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.32873 0.32792
Boolector SMT17 final boolector unsat ✅ 0.32577 0.32271
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.61591 6.45560
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.31850 0.31798
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.70608 0.70540
Q3B Q3B default unsat ✅ 53.90650 161.31000
STP stp_st default unsat ✅ 19.54300 19.53360
stp_mt default unsat ✅ 19.52880 19.52480
Yices2 Yices2-Main default unsat ✅ 0.14324 0.13902
Z3 z3-4.5.0 default unsat ✅ 0.35521 0.35366
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.29168 0.29163
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.32062 3.32093
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.32613 0.32720
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.68382 0.68381
Minkeyrink ST_st unsat ✅ 0.68154 0.68158
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 12.42910 12.42740
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 12.37060 12.37080
STP-Riss-st-2018_riss-no-stderr unsat ✅ 12.35380 12.35170
Yices2 Yices 2.6.0_default unsat ✅ 0.12137 0.12131
Z3 z3-4.7.1_default unsat ✅ 0.30465 0.30453
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.42747 0.42739
MathSAT mathsat-5.6.6_default unsat ✅ 35.18760 35.18530
STP STP 2021.0_default unsat ✅ 11.62790 11.62760
Z3 z3-4.8.11_default unsat ✅ 0.35171 0.34870
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.41854 0.41848
Bitwuzla-wrapped_default unsat ✅ 0.47129 0.47116
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.13284 4.13312
MathSAT MathSAT-5.6.8_default unsat ✅ 0.31092 0.31085
STP STP 2022.4_default unsat ✅ 0.19752 0.19749
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.14640 0.14634
Z3++BV z3++bv_0702_default unsat ✅ 0.32938 0.32932
Z3 z3-4.8.17_default unsat ✅ 0.27967 0.28137
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.58073 0.58069
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 3.37197 3.37245
STP STP 2022.4_default unsat ✅ 0.19165 0.19166
STP 2022.4_default unsat ✅ 0.19051 0.19049
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.02000 1235.90000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.13556 0.13548
Z3-Owl z3-Owl-Final_default unsat ✅ 0.89531 0.89530
z3-Owl-Final_default unsat ✅ 0.90142 0.90173
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 0.62205 0.52223
cvc5 cvc5 unsat ✅ 1.57177 1.47252
SMTInterpol SMTInterpol unknown ❌ 1202.74480 1971.16717
STP STP unsat ✅ 11.03104 10.93112
Yices2 Yices2 unsat ✅ 0.33016 0.22987
Z3alpha Z3-alpha unsat ✅ 0.46854 0.36876
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.59268 0.47517
Bitwuzla-MachBV-base unsat ✅ 0.67290 0.54463
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.73819 0.61001
BVDecide bv_decide unknown ❌ 1201.34393 1200.96272
bv_decide-nokernel unknown ❌ 1201.38412 1201.01317
cvc5 cvc5 unsat ✅ 0.82928 0.71326
SMTInterpol SMTInterpol unknown ❌ 1201.86935 2692.13652
Yices2 Yices2 unsat ✅ 0.34505 0.22414
Z3alpha Z3-alpha unsat ✅ 0.64187 0.56299
Z3 Z3-alpha-base unsat ✅ 0.40736 0.29204
Z3-Owl-base unsat ✅ 0.92718 0.80849
z3siri-base unsat ✅ 0.43920 0.30620
Z3-Owl Z3-Owl unsat ✅ 1.00687 0.87731