Benchmark

non-incremental/QF_BV/sage/app11/bench_375.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1530926
Compressed Size151084
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1530918
Compressed Size151091
Max. Term Depth4211
Asserts 1
Declared Functions0
Declared Constants8425
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true2 false1 ite92 not1287
and1 =2079 let2878 extract1486
bvand968 bvor273 bvxor2281 bvadd14629
bvmul1183 bvsdiv16 bvult1096 bvule1501
bvslt122 bvsle163 bvshl8908 bvashr13274
zero_extend10174

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.15927 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.40536 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.40696 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.40852 —
abziz_portfolio_2012_solvers default unsat ✅ 0.41462 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.40829 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.21959 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.30427 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.23778 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 30.89760 —
CVC3-SMT-COMP-2011 default unsat ✅ 26.24140 —
CVC3-SMT-COMP-2012 default unsat ✅ 27.24190 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.69417 —
CVC4-SMT-EVAL-2013 default unsat ✅ 13.56590 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.45541 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.45327 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 23.32030 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.55773 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.46520 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 7.90186 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.80877 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.54476 —
STP STP2-SMT-COMP-2011 default unsat ✅ 1.08006 —
STP2-SMT-COMP-2012 default unsat ✅ 0.16482 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.25327 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.44277 —
Z3-SMT-COMP-2011 default unsat ✅ 0.40326 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.35084 0.34991
Boolector SMT17 final boolector unsat ✅ 0.34290 0.34348
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.00490 7.03911
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.29852 0.29670
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.70834 0.70781
Q3B Q3B default unsat ✅ 27.90570 82.61000
STP stp_st default unsat ✅ 6.92246 6.91928
stp_mt default unsat ✅ 6.83934 6.83877
Yices2 Yices2-Main default unsat ✅ 0.12856 0.12757
Z3 z3-4.5.0 default unsat ✅ 0.31633 0.31534
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.29099 0.29086
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.31378 3.31389
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.31326 0.31434
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.68051 0.68055
Minkeyrink ST_st unsat ✅ 0.68152 0.68157
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 12.17180 12.17140
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 12.17790 12.17730
STP-Riss-st-2018_riss-no-stderr unsat ✅ 12.18660 12.18600
Yices2 Yices 2.6.0_default unsat ✅ 0.12120 0.12113
Z3 z3-4.7.1_default unsat ✅ 0.26635 0.26623
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.41913 0.41910
Boolector Boolector-wrapped-sq_default unsat ✅ 0.57814 0.57801
Poolector-wrapped-sq_default unsat ✅ 0.78650 2.71000
CVC4 CVC4-sq-final_default unsat ✅ 3.82688 3.82647
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 88.04320 88.02870
MathSAT MathSAT5_default.sh unsat ✅ 0.32476 0.32472
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 1.05663 1.05651
MinkeyRink Solver 2020.3_default unsat ✅ 1.11811 1.11815
STP STP_default unsat ✅ 21.14350 21.14370
STP ++ Mergsat v1_default unsat ✅ 22.46690 22.46460
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.13915 0.13908
Z3 z3-4.8.8_default unsat ✅ 0.20482 0.20471
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.41345 0.41335
MathSAT mathsat-5.6.6_default unsat ✅ 33.92890 33.92420
STP STP 2021.0_default unsat ✅ 15.71420 15.71480
Z3 z3-4.8.11_default unsat ✅ 0.22875 0.22872
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.43089 0.42864
Bitwuzla-wrapped_default unsat ✅ 0.44157 0.44155
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.15152 4.15005
MathSAT MathSAT-5.6.8_default unsat ✅ 0.30934 0.30926
STP STP 2022.4_default unsat ✅ 0.19909 0.19906
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.14162 0.14156
Z3++BV z3++bv_0702_default unsat ✅ 0.29987 0.29980
Z3 z3-4.8.17_default unsat ✅ 0.27935 0.28066
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.59591 0.59578
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 3.37357 3.37194
STP STP 2022.4_default unsat ✅ 0.18899 0.18898
STP 2022.4_default unsat ✅ 0.18961 0.18963
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.02000 1228.43000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.13542 0.13538
Z3-Owl z3-Owl-Final_default unsat ✅ 0.92883 0.92875
z3-Owl-Final_default unsat ✅ 0.93674 0.93695
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 0.80925 0.70920
cvc5 cvc5 unsat ✅ 1.36307 1.26278
SMTInterpol SMTInterpol unknown ❌ 1202.72162 1913.89204
STP STP unsat ✅ 9.61570 9.51565
Yices2 Yices2 unsat ✅ 0.35125 0.25182
Z3alpha Z3-alpha unsat ✅ 0.45853 0.35814
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.76773 0.63018
Bitwuzla-MachBV-base unsat ✅ 0.83026 0.70233
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.86868 0.73722
BVDecide bv_decide unknown ❌ 1201.38847 1200.98716
bv_decide-nokernel unknown ❌ 1201.39150 1201.06301
cvc5 cvc5 unsat ✅ 0.93830 0.80864
SMTInterpol SMTInterpol unknown ❌ 1202.25092 2928.70835
Yices2 Yices2 unsat ✅ 0.37146 0.23497
Z3alpha Z3-alpha unsat ✅ 0.63882 0.56013
Z3 Z3-alpha-base unsat ✅ 0.46028 0.33337
Z3-Owl-base unsat ✅ 1.16598 1.04323
z3siri-base unsat ✅ 0.44967 0.32665
Z3-Owl Z3-Owl unsat ✅ 1.00321 0.87198