Benchmark

non-incremental/QF_BV/sage/app7/bench_3448.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size4270490
Compressed Size266449
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 4270482
Compressed Size266454
Max. Term Depth16270
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2545 and1
=3316 let16214 extract1709 bvand44304
bvor29228 bvxor2276 bvadd47522 bvmul7
bvsub15691 bvsdiv19 bvult604 bvule626
bvslt219 bvsle124 bvshl15382 bvashr28920
zero_extend1513

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.69007
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.95822
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.95506
abziz_portfolio_2012_minfeatures default unsat ✅ 0.95917
abziz_portfolio_2012_solvers default unsat ✅ 0.95535
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.96630
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.91318
Boolector-SMT-COMP-2011 default unsat ✅ 1.04103
Boolector-SMT-COMP-2012 default unsat ✅ 0.96199
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 589.48500
CVC3-SMT-COMP-2011 default unsat ✅ 489.04300
CVC3-SMT-COMP-2012 default unsat ✅ 509.59500
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.52298
CVC4-SMT-EVAL-2013 default unsat ✅ 5.42271
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.25818
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.20997
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.58207
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.54964
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 1.10507
SONOLAR-SMT-COMP-2010 default unsat ✅ 5.43855
SONOLAR-SMT-COMP-2011 default unsat ✅ 7.92258
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.80617
STP STP2-SMT-COMP-2011 default unsat ✅ 0.71694
STP2-SMT-COMP-2012 default unsat ✅ 0.68413
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.66258
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.98158
Z3-SMT-COMP-2011 default unsat ✅ 0.95032
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 1.20394 1.20309
Boolector SMT17 final boolector unsat ✅ 1.15584 1.15499
CVC4 CVC4-smtcomp2017-main default unsat ✅ 5.81281 9.30233
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.90280 0.90368
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.62751 3.14666
Q3B Q3B default unsat ✅ 1.06613 2.72000
STP stp_st default unsat ✅ 0.76023 0.75938
stp_mt default unsat ✅ 0.83883 0.83000
Yices2 Yices2-Main default unsat ✅ 0.28664 0.28558
Z3 z3-4.5.0 default unsat ✅ 0.91646 0.90666
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 1.02963 1.02950
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 5.18142 5.18094
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.79919 0.80025
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.66411 3.23399
Minkeyrink ST_st unsat ✅ 1.65769 1.65771
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.83377 0.83383
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.74794 0.74782
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.75265 0.75266
Yices2 Yices 2.6.0_default unsat ✅ 0.26915 0.26886
Z3 z3-4.7.1_default unsat ✅ 0.71996 0.71981
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.60618 1.60609
MathSAT mathsat-5.6.6_default unsat ✅ 0.84230 0.84225
STP STP 2021.0_default unsat ✅ 0.75845 0.75856
Z3 z3-4.8.11_default unsat ✅ 0.47193 0.47190
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.60712 1.60675
Bitwuzla-wrapped_default unsat ✅ 1.78654 1.78653
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 5.52281 5.52298
MathSAT MathSAT-5.6.8_default unsat ✅ 0.87134 0.87116
STP STP 2022.4_default unsat ✅ 0.82370 0.82366
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.31517 0.31506
Z3++BV z3++bv_0702_default unsat ✅ 0.49134 0.49126
Z3 z3-4.8.17_default unsat ✅ 0.49408 0.49590
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.57769 1.47612
cvc5 cvc5 unsat ✅ 2.34242 2.24292
SMTInterpol SMTInterpol unknown ❌ 1202.75443 1426.77974
STP STP unsat ✅ 67.59449 67.49355
Yices2 Yices2 unsat ✅ 0.45458 0.35471
Z3alpha Z3-alpha unsat ✅ 0.66181 0.56191
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 1.16252 1.04055
Bitwuzla-MachBV-base unsat ✅ 1.42235 1.30787
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.62938 1.50162
BVDecide bv_decide unknown ❌ 1201.38604 1200.99509
bv_decide-nokernel unknown ❌ 1201.38823 1201.04042
cvc5 cvc5 unsat ✅ 1.51662 1.38817
SMTInterpol SMTInterpol unknown ❌ 1201.86743 1790.55979
Yices2 Yices2 unsat ✅ 0.45183 0.32505
Z3alpha Z3-alpha unsat ✅ 1.06216 1.07481
Z3 Z3-alpha-base unsat ✅ 0.75661 0.62553
Z3-Owl-base unsat ✅ 2.23905 2.12046
z3siri-base unsat ✅ 0.72940 0.60736
Z3-Owl Z3-Owl unsat ✅ 1.30690 1.17553