Benchmark

non-incremental/QF_BV/sage/app7/bench_379.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3275765
Compressed Size205564
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3275757
Compressed Size205569
Max. Term Depth12489
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not2039 and1
=2714 let12384 extract1435 bvand33998
bvor22382 bvxor1749 bvadd36257 bvmul2
bvsub11845 bvsdiv3 bvult483 bvule519
bvslt211 bvsle121 bvshl11571 bvashr21889
zero_extend1158

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.48630
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.54194
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.54054
abziz_portfolio_2012_minfeatures default unsat ✅ 0.53394
abziz_portfolio_2012_solvers default unsat ✅ 0.54554
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.53104
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌
Boolector-SMT-COMP-2011 default unsat ✅ 0.79913
Boolector-SMT-COMP-2012 default unsat ✅ 0.69411
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 173.24300
CVC3-SMT-COMP-2011 default unsat ✅ 146.45900
CVC3-SMT-COMP-2012 default unsat ✅ 153.30800
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.83541
CVC4-SMT-EVAL-2013 default unsat ✅ 4.45429
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.98784
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.94438
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.23035
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.18554
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.85245
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.97002
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.11234
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.33196
STP STP2-SMT-COMP-2011 default unsat ✅ 0.52437
STP2-SMT-COMP-2012 default unsat ✅ 0.49044
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.50179
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.57790
Z3-SMT-COMP-2011 default unsat ✅ 0.52407
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.87799 0.87640
Boolector SMT17 final boolector unsat ✅ 0.89539 0.89475
CVC4 CVC4-smtcomp2017-main default unsat ✅ 6.26750 7.37632
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.66420 0.66326
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.24784 1.24502
Q3B Q3B default unsat ✅ 0.82798 2.01000
STP stp_st default unsat ✅ 0.63015 0.62934
stp_mt default unsat ✅ 0.64392 0.63524
Yices2 Yices2-Main default unsat ✅ 0.36455 0.36453
Z3 z3-4.5.0 default unsat ✅ 0.55334 0.55122
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.77177 0.77164
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.86672 3.86662
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.62743 0.62845
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.24989 1.24902
Minkeyrink ST_st unsat ✅ 1.25051 1.25057
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.56695 0.56695
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.56822 0.56827
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.56807 0.56810
Yices2 Yices 2.6.0_default unsat ✅ 0.36164 0.36155
Z3 z3-4.7.1_default unsat ✅ 0.57675 0.57656
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.20649 1.20640
Boolector Boolector-wrapped-sq_default unsat ✅ 1.48585 1.48386
Poolector-wrapped-sq_default unsat ✅ 1.78123 6.65231
CVC4 CVC4-sq-final_default unsat ✅ 5.33205 5.33199
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.78170 0.78164
MathSAT MathSAT5_default.sh unsat ✅ 0.64176 0.64165
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.72731 0.72739
MinkeyRink Solver 2020.3_default unsat ✅ 0.75054 0.75051
STP STP_default unsat ✅ 0.53387 0.53394
STP ++ Mergsat v1_default unsat ✅ 0.53286 0.53400
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.37381 0.37374
Z3 z3-4.8.8_default unsat ✅ 0.59946 0.59930
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.24085 1.24068
MathSAT mathsat-5.6.6_default unsat ✅ 0.65325 0.65310
STP STP 2021.0_default unsat ✅ 0.55837 0.55842
Z3 z3-4.8.11_default unsat ✅ 0.38255 0.38248
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.21031 1.21021
Bitwuzla-wrapped_default unsat ✅ 1.33069 1.33043
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.11700 4.11700
MathSAT MathSAT-5.6.8_default unsat ✅ 0.67124 0.67109
STP STP 2022.4_default unsat ✅ 0.59931 0.59928
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.37994 0.37850
Z3++BV z3++bv_0702_default unsat ✅ 0.43973 0.43962
Z3 z3-4.8.17_default unsat ✅ 0.43395 0.43572
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.88968 1.88949
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 2.98596 2.98109
STP STP 2022.4_default unsat ✅ 0.59244 0.59239
STP 2022.4_default unsat ✅ 0.59626 0.59626
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 873.27400 995.39200
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.36962 0.36956
Z3-Owl z3-Owl-Final_default unsat ✅ 1.28287 1.28278
z3-Owl-Final_default unsat ✅ 1.28957 1.28988
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.12988 1.02981
cvc5 cvc5 unsat ✅ 1.89996 1.79963
SMTInterpol SMTInterpol unknown ❌ 1202.72048 1417.96476
STP STP unsat ✅ 35.42282 35.31630
Yices2 Yices2 unsat ✅ 0.46218 0.36229
Z3alpha Z3-alpha unsat ✅ 0.54742 0.44755
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.98439 0.86097
Bitwuzla-MachBV-base unsat ✅ 1.18998 1.07119
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.40593 1.28180
BVDecide bv_decide unknown ❌ 1201.39344 1200.95476
bv_decide-nokernel unknown ❌ 1201.35336 1200.94495
cvc5 cvc5 unsat ✅ 1.24840 1.12948
SMTInterpol SMTInterpol unknown ❌ 1201.88636 2414.95677
Yices2 Yices2 unsat ✅ 0.47098 0.34855
Z3alpha Z3-alpha unsat ✅ 0.95498 0.92742
Z3 Z3-alpha-base unsat ✅ 0.67548 0.55007
Z3-Owl-base unsat ✅ 2.09788 1.97782
z3siri-base unsat ✅ 0.66339 0.53641
Z3-Owl Z3-Owl unsat ✅ 1.18732 1.05823