Benchmark

non-incremental/QF_BV/sage/app7/bench_182.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3326404
Compressed Size209479
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3326396
Compressed Size209482
Max. Term Depth12792
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not2176 and1
=2868 let12687 extract1617 bvand34146
bvor22407 bvxor2082 bvadd36703 bvmul2
bvsub11936 bvsdiv6 bvult493 bvule531
bvslt213 bvsle121 bvshl11740 bvashr22014
zero_extend1398

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.48944
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.50564
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.50838
abziz_portfolio_2012_minfeatures default unsat ✅ 0.51005
abziz_portfolio_2012_solvers default unsat ✅ 0.51686
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.49808
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.65948
Boolector-SMT-COMP-2011 default unsat ✅ 0.80102
Boolector-SMT-COMP-2012 default unsat ✅ 0.69878
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 174.22900
CVC3-SMT-COMP-2011 default unsat ✅ 147.18800
CVC3-SMT-COMP-2012 default unsat ✅ 154.04200
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.87045
CVC4-SMT-EVAL-2013 default unsat ✅ 4.54534
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.98882
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.96549
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.23787
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.20269
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.87878
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.00654
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.16368
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.34760
STP STP2-SMT-COMP-2011 default unsat ✅ 0.52410
STP2-SMT-COMP-2012 default unsat ✅ 0.49519
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.53306
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.54677
Z3-SMT-COMP-2011 default unsat ✅ 0.49614
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.90740 0.90237
Boolector SMT17 final boolector unsat ✅ 0.90496 0.90350
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.22303 6.77229
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.69365 0.68827
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.25107 1.24998
Q3B Q3B default unsat ✅ 0.82819 2.03000
STP stp_st default unsat ✅ 0.56577 0.56569
stp_mt default unsat ✅ 0.56627 0.56534
Yices2 Yices2-Main default unsat ✅ 0.36663 0.36661
Z3 z3-4.5.0 default unsat ✅ 0.64012 0.63930
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.79693 0.79691
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.95049 3.95064
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.63602 0.63709
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.27104 1.27114
Minkeyrink ST_st unsat ✅ 1.26830 1.26825
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.57642 0.57644
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.57839 0.57830
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.57625 0.57630
Yices2 Yices 2.6.0_default unsat ✅ 0.36929 0.36915
Z3 z3-4.7.1_default unsat ✅ 0.56883 0.56876
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.22964 1.22960
Boolector Boolector-wrapped-sq_default unsat ✅ 1.49404 1.49383
Poolector-wrapped-sq_default unsat ✅ 1.78456 6.46000
CVC4 CVC4-sq-final_default unsat ✅ 5.44611 5.44625
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.79513 0.79505
MathSAT MathSAT5_default.sh unsat ✅ 0.65017 0.64999
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.74177 0.74123
MinkeyRink Solver 2020.3_default unsat ✅ 0.77139 0.77136
STP STP_default unsat ✅ 0.61208 0.60905
STP ++ Mergsat v1_default unsat ✅ 0.54552 0.54727
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.37772 0.37762
Z3 z3-4.8.8_default unsat ✅ 0.63313 0.63300
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.23752 1.23748
MathSAT mathsat-5.6.6_default unsat ✅ 0.66663 0.66649
STP STP 2021.0_default unsat ✅ 0.56620 0.56632
Z3 z3-4.8.11_default unsat ✅ 0.40269 0.40263
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.25257 1.25244
Bitwuzla-wrapped_default unsat ✅ 1.32240 1.32234
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.20658 8.37431
MathSAT MathSAT-5.6.8_default unsat ✅ 0.68376 0.68366
STP STP 2022.4_default unsat ✅ 0.61230 0.61228
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.37685 0.37676
Z3++BV z3++bv_0702_default unsat ✅ 0.44383 0.44372
Z3 z3-4.8.17_default unsat ✅ 0.44512 0.44696