Benchmark

non-incremental/QF_BV/sage/app7/bench_352.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3279313
Compressed Size205888
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3279305
Compressed Size205876
Max. Term Depth12494
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not2060 and1
=2736 let12389 extract1435 bvand34028
bvor22393 bvxor1749 bvadd36312 bvmul2
bvsub11849 bvsdiv4 bvult484 bvule521
bvslt211 bvsle121 bvshl11574 bvashr21911
zero_extend1158

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.48583
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.52082
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.51336
abziz_portfolio_2012_minfeatures default unsat ✅ 0.50827
abziz_portfolio_2012_solvers default unsat ✅ 0.51891
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.51726
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.66107
Boolector-SMT-COMP-2011 default unsat ✅ 0.78925
Boolector-SMT-COMP-2012 default unsat ✅ 0.70229
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 337.30900
CVC3-SMT-COMP-2011 default unsat ✅ 282.09200
CVC3-SMT-COMP-2012 default unsat ✅ 294.08700
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.80780
CVC4-SMT-EVAL-2013 default unsat ✅ 4.45011
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.97904
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.94681
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.22232
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.18599
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.85779
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.99714
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.11620
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.33625
STP STP2-SMT-COMP-2011 default unsat ✅ 0.52048
STP2-SMT-COMP-2012 default unsat ✅ 0.48814
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.50108
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.55546
Z3-SMT-COMP-2011 default unsat ✅ 0.51069
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.93275 0.93021
Boolector SMT17 final boolector unsat ✅ 0.87746 0.87412
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.26776 6.85780
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.67981 0.67923
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.24236 1.24127
Q3B Q3B default unsat ✅ 0.80699 2.09000
STP stp_st default unsat ✅ 0.57913 0.56751
stp_mt default unsat ✅ 0.56222 0.56159
Yices2 Yices2-Main default unsat ✅ 0.23195 0.23041
Z3 z3-4.5.0 default unsat ✅ 0.51558 0.51450
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.78926 0.78918
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.88592 3.88589
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.62523 0.62598
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.26159 1.26155
Minkeyrink ST_st unsat ✅ 1.26281 1.26272
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.56901 0.56903
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.57403 0.57395
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.57027 0.57034
Yices2 Yices 2.6.0_default unsat ✅ 0.19922 0.19910
Z3 z3-4.7.1_default unsat ✅ 0.80214 0.80204
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.22523 1.22509
Boolector Boolector-wrapped-sq_default unsat ✅ 1.53030 1.53012
Poolector-wrapped-sq_default unsat ✅ 1.78734 6.52466
CVC4 CVC4-sq-final_default unsat ✅ 5.31182 5.31178
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.77665 0.77653
MathSAT MathSAT5_default.sh unsat ✅ 0.64713 0.64700
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.73606 0.73601
MinkeyRink Solver 2020.3_default unsat ✅ 0.75792 0.75811
STP STP_default unsat ✅ 0.53832 0.53839
STP ++ Mergsat v1_default unsat ✅ 0.53568 0.53754
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.24121 0.24116
Z3 z3-4.8.8_default unsat ✅ 0.61954 0.61949
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.21084 1.21062
MathSAT mathsat-5.6.6_default unsat ✅ 0.66007 0.65999
STP STP 2021.0_default unsat ✅ 0.55405 0.55413
Z3 z3-4.8.11_default unsat ✅ 0.39685 0.39680
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.21200 1.21188
Bitwuzla-wrapped_default unsat ✅ 1.30490 1.30487
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.08440 4.08441
MathSAT MathSAT-5.6.8_default unsat ✅ 0.66299 0.66291
STP STP 2022.4_default unsat ✅ 0.60593 0.60583
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.24514 0.24506
Z3++BV z3++bv_0702_default unsat ✅ 0.39460 0.39293
Z3 z3-4.8.17_default unsat ✅ 0.52218 0.52405