Benchmark

non-incremental/QF_BV/sage/app2/bench_487.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size357771
Compressed Size44601
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 357763
Compressed Size44611
Max. Term Depth872
Asserts 1
Declared Functions0
Declared Constants1366
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true39 ite1 not264 and1
=437 let843 extract167 bvand1825
bvor73 bvxor60 bvadd3760 bvmul22
bvsub2427 bvsdiv22 bvult131 bvule250
bvslt167 bvsle68 bvshl2244 bvashr1155
zero_extend1506

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.04680
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.06366
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.06314
abziz_portfolio_2012_minfeatures default unsat ✅ 0.06337
abziz_portfolio_2012_solvers default unsat ✅ 0.06411
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.06349
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.05291
Boolector-SMT-COMP-2011 default unsat ✅ 0.07039
Boolector-SMT-COMP-2012 default unsat ✅ 0.05107
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 0.26952
CVC3-SMT-COMP-2011 default unsat ✅ 0.25595
CVC3-SMT-COMP-2012 default unsat ✅ 0.23967
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ 221.57300
CVC4-SMT-EVAL-2013 default unknown ❌ 873.07100
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.11529
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.10404
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.13598
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.12937
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.09445
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.05255
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.32105
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.10927
STP STP2-SMT-COMP-2011 default unsat ✅ 0.05117
STP2-SMT-COMP-2012 default unsat ✅ 0.04709
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.04840
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.05410
Z3-SMT-COMP-2011 default unsat ✅ 0.06338
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.07223 0.07154
Boolector SMT17 final boolector unsat ✅ 0.08316 0.08172
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.08995 5.99049
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.08367 0.08361
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.19835 0.19740
Q3B Q3B default unsat ✅ 0.44122 1.04272
STP stp_st default unsat ✅ 0.06500 0.06295
stp_mt default unsat ✅ 0.05871 0.05826
Yices2 Yices2-Main default unsat ✅ 0.03117 0.03112
Z3 z3-4.5.0 default unsat ✅ 0.26082 0.25368
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.07763 0.07755
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.73869 1.73881
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.07644 0.07740
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.19881 0.19880
Minkeyrink ST_st unsat ✅ 0.19907 0.19908
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.05301 0.05307
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.05347 0.05347
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.05295 0.05298
Yices2 Yices 2.6.0_default unsat ✅ 0.03316 0.03311
Z3 z3-4.7.1_default unsat ✅ 0.24879 0.24874
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.11151 0.11148
Boolector Boolector-wrapped-sq_default unsat ✅ 0.13481 0.13483
Poolector-wrapped-sq_default unsat ✅ 0.27719 0.69616
CVC4 CVC4-sq-final_default unsat ✅ 1.64984 1.65011
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.11023 0.09445
MathSAT MathSAT5_default.sh unsat ✅ 0.08023 0.08019
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.23700 0.23710
MinkeyRink Solver 2020.3_default unsat ✅ 0.24876 0.24889
STP STP_default unsat ✅ 0.05677 0.05682
STP ++ Mergsat v1_default unsat ✅ 0.04923 0.05081
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.03567 0.03565
Z3 z3-4.8.8_default unsat ✅ 0.06046 0.06040
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.11752 0.11714
MathSAT mathsat-5.6.6_default unsat ✅ 0.08214 0.08212
STP STP 2021.0_default unsat ✅ 0.05850 0.05860
Z3 z3-4.8.11_default unsat ✅ 0.24436 0.24435
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.16716 0.16709
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.92704 1.92756
STP STP 2022.4_default unsat ✅ 0.05379 0.05385
STP 2022.4_default unsat ✅ 0.05346 0.05350
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 12.67440 38.28200
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.03660 0.03655
Z3-Owl z3-Owl-Final_default unsat ✅ 0.91766 0.91765
z3-Owl-Final_default unsat ✅ 0.93193 0.93220
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.29499 0.19514
cvc5 cvc5 unsat ✅ 1.31171 1.21209
SMTInterpol SMTInterpol unsat ✅ 34.75174 71.99679
STP STP unsat ✅ 0.77199 0.67249
Yices2 Yices2 unsat ✅ 0.25940 0.15997
Z3alpha Z3-alpha unsat ✅ 0.40931 0.30991
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.31772 0.20108
Bitwuzla-MachBV-base unsat ✅ 0.35249 0.22582
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.40375 0.28456
BVDecide bv_decide unsat ✅ 33.46610 33.33251
bv_decide-nokernel unsat ✅ 28.73450 28.59822
cvc5 cvc5 unsat ✅ 1.19202 1.06338
SMTInterpol SMTInterpol unsat ✅ 28.35833 54.68091
Yices2 Yices2 unsat ✅ 0.31803 0.20043
Z3alpha Z3-alpha unsat ✅ 0.49085 0.37275
Z3 Z3-alpha-base unsat ✅ 0.47785 0.35381
Z3-Owl-base unsat ✅ 1.58273 1.46349
z3siri-base unsat ✅ 0.47809 0.35984
Z3-Owl Z3-Owl unsat ✅ 0.92702 0.79217