Benchmark

non-incremental/QF_BV/sage/app2/bench_646.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size203312
Compressed Size25847
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 203304
Compressed Size25408
Max. Term Depth543
Asserts 1
Declared Functions0
Declared Constants699
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true29 ite1 not195 and1
=357 let532 extract163 bvand1017
bvor34 bvxor60 bvadd1981 bvmul22
bvsub1371 bvsdiv22 bvult118 bvule248
bvslt156 bvsle57 bvshl1177 bvashr655
zero_extend833

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.02977
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.14799
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.14836
abziz_portfolio_2012_minfeatures default unsat ✅ 0.14896
abziz_portfolio_2012_solvers default unsat ✅ 0.14827
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.14804
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.02961
Boolector-SMT-COMP-2011 default unsat ✅ 0.05300
Boolector-SMT-COMP-2012 default unsat ✅ 0.03059
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 1.80310
CVC3-SMT-COMP-2011 default unsat ✅ 1.56148
CVC3-SMT-COMP-2012 default unsat ✅ 1.59362
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ 82.95550
CVC4-SMT-EVAL-2013 default unsat ✅ 90.65710
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.07877
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.07169
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.97287
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.08780
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.23648
SONOLAR-SMT-COMP-2010 default unsat ✅ 2.43026
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.25647
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.21088
STP STP2-SMT-COMP-2011 default unsat ✅ 0.14652
STP2-SMT-COMP-2012 default unsat ✅ 0.02875
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.03059
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.12770
Z3-SMT-COMP-2011 default unsat ✅ 0.14322
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.04493 0.04436
Boolector SMT17 final boolector unsat ✅ 0.04830 0.04747
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.90266 3.61508
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.07869 0.06853
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.12839 0.12182
Q3B Q3B default unsat ✅ 0.24406 0.45622
STP stp_st default unsat ✅ 0.03620 0.03567
stp_mt default unsat ✅ 0.03539 0.03479
Yices2 Yices2-Main default unsat ✅ 0.02008 0.01887
Z3 z3-4.5.0 default unsat ✅ 0.14491 0.14338
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.04528 0.04523
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.03032 1.03019
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.05965 0.06078
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.12520 0.12524
Minkeyrink ST_st unsat ✅ 0.12458 0.12458
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.08306 0.08308
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.08258 0.08259
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.08311 0.08316
Yices2 Yices 2.6.0_default unsat ✅ 0.02228 0.02216
Z3 z3-4.7.1_default unsat ✅ 0.06230 0.06219
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.07067 0.07062
Bitwuzla-wrapped_default unsat ✅ 0.07050 0.07046
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.99948 0.99991
MathSAT MathSAT-5.6.8_default unsat ✅ 2.84887 2.84868
STP STP 2022.4_default unsat ✅ 0.03544 0.03547
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.02315 0.02313
Z3++BV z3++bv_0702_default unsat ✅ 0.03688 0.03678
Z3 z3-4.8.17_default unsat ✅ 0.03528 0.03707
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 4.39898 4.39805
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.97265 0.97088
STP STP 2022.4_default unsat ✅ 0.03592 0.03592
STP 2022.4_default unsat ✅ 0.03581 0.03583
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 9.24634 26.89270
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.02242 0.02235
Z3-Owl z3-Owl-Final_default unsat ✅ 0.77389 0.77387
z3-Owl-Final_default unsat ✅ 0.77583 0.77613
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.28409 0.18410
cvc5 cvc5 unsat ✅ 0.93348 0.83381
SMTInterpol SMTInterpol unsat ✅ 10.62504 30.60824
STP STP unsat ✅ 0.42263 0.32269
Yices2 Yices2 unsat ✅ 0.22545 0.12553
Z3alpha Z3-alpha unsat ✅ 0.33773 0.23756
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.31519 0.19456
Bitwuzla-MachBV-base unsat ✅ 0.29566 0.17435
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.38941 0.27068
BVDecide bv_decide unsat ✅ 195.19550 194.98567
bv_decide-nokernel unsat ✅ 132.82782 132.63557
cvc5 cvc5 unsat ✅ 0.88167 0.75889
SMTInterpol SMTInterpol unsat ✅ 9.16855 25.34282
Yices2 Yices2 unsat ✅ 0.27900 0.15178
Z3alpha Z3-alpha unsat ✅ 0.40745 0.29415
Z3 Z3-alpha-base unsat ✅ 0.38383 0.26092
Z3-Owl-base unsat ✅ 0.78538 0.65015
z3siri-base unsat ✅ 0.35945 0.24008
Z3-Owl Z3-Owl unsat ✅ 0.86820 0.74116