Benchmark

non-incremental/QF_BV/sage/app7/bench_5002.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size4511628
Compressed Size276891
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 4511620
Compressed Size276897
Max. Term Depth16990
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2775 and1
=3578 let16839 extract1722 bvand46148
bvor30442 bvxor2330 bvadd49687 bvmul9
bvsub16270 bvsdiv28 bvult645 bvule655
bvslt221 bvsle126 bvshl15945 bvashr30118
zero_extend1525

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.72288 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.68516 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.68675 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.68449 —
abziz_portfolio_2012_solvers default unsat ✅ 0.69435 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.68777 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.94788 —
Boolector-SMT-COMP-2011 default unsat ✅ 1.06570 —
Boolector-SMT-COMP-2012 default unsat ✅ 1.00422 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 576.71900 —
CVC3-SMT-COMP-2011 default unsat ✅ 478.35200 —
CVC3-SMT-COMP-2012 default unsat ✅ 499.19200 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.68471 —
CVC4-SMT-EVAL-2013 default unsat ✅ 5.62126 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.31623 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.26476 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.67132 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.61831 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 1.15850 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 5.59943 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 8.35144 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.88150 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.75574 —
STP2-SMT-COMP-2012 default unsat ✅ 0.73242 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.76299 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.74010 —
Z3-SMT-COMP-2011 default unsat ✅ 0.68056 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 1.17283 1.17145
Boolector SMT17 final boolector unsat ✅ 1.17195 1.17073
CVC4 CVC4-smtcomp2017-main default unsat ✅ 5.77103 9.17582
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.85776 0.85873
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.68138 1.67999
Q3B Q3B default unsat ✅ 1.10662 2.96000
STP stp_st default unsat ✅ 0.83522 0.83427
stp_mt default unsat ✅ 0.82127 0.81952
Yices2 Yices2-Main default unsat ✅ 0.28132 0.28008
Z3 z3-4.5.0 default unsat ✅ 0.86309 0.86200
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 1.05292 1.05280
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 5.40533 5.40496
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.84234 0.84322
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.72031 1.72047
Minkeyrink ST_st unsat ✅ 1.71125 1.71135
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.83496 0.83504
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.83281 0.83280
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.83460 0.83452
Yices2 Yices 2.6.0_default unsat ✅ 0.26289 0.26284
Z3 z3-4.7.1_default unsat ✅ 0.75176 0.75162
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.69437 1.69415
Boolector Boolector-wrapped-sq_default unsat ✅ 2.09952 2.09941
Poolector-wrapped-sq_default unsat ✅ 2.48802 9.27000
CVC4 CVC4-sq-final_default unsat ✅ 7.36597 7.36549
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 1.05555 1.05542
MathSAT MathSAT5_default.sh unsat ✅ 0.85523 0.85503
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.96508 0.96515
MinkeyRink Solver 2020.3_default unsat ✅ 1.00297 1.00302
STP STP_default unsat ✅ 0.78575 0.78584
STP ++ Mergsat v1_default unsat ✅ 0.78151 0.78299
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.31777 0.31768
Z3 z3-4.8.8_default unsat ✅ 0.67782 0.67768
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.67410 3.25376
MathSAT mathsat-5.6.6_default unsat ✅ 0.87930 0.87915
STP STP 2021.0_default unsat ✅ 0.79776 0.79777
Z3 z3-4.8.11_default unsat ✅ 0.81321 0.81308
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.69422 3.29309
Bitwuzla-wrapped_default unsat ✅ 1.85075 1.84948
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 5.65076 5.65102
MathSAT MathSAT-5.6.8_default unsat ✅ 0.91911 0.91861
STP STP 2022.4_default unsat ✅ 0.86370 0.86367
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.31589 0.31583
Z3++BV z3++bv_0702_default unsat ✅ 0.91499 0.91469
Z3 z3-4.8.17_default unsat ✅ 0.84615 0.84805
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.58519 2.58496
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 4.33728 4.33274
STP STP 2022.4_default unsat ✅ 0.83923 0.83917
STP 2022.4_default unsat ✅ 0.84355 0.84355
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.05000 1341.14000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.30848 0.30845
Z3-Owl z3-Owl-Final_default unsat ✅ 1.43783 1.43764
z3-Owl-Final_default unsat ✅ 1.45142 1.45171
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.48481 1.38428
cvc5 cvc5 unsat ✅ 1.95087 1.84956
SMTInterpol SMTInterpol unknown ❌ 1202.24231 1426.79334
STP STP unsat ✅ 65.14046 65.03920
Yices2 Yices2 unsat ✅ 0.44146 0.34164
Z3alpha Z3-alpha unsat ✅ 0.63307 0.53186
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 1.20091 1.07369
Bitwuzla-MachBV-base unsat ✅ 1.53141 1.40159
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.71564 1.58446
BVDecide bv_decide unknown ❌ 1201.38806 1200.98365
bv_decide-nokernel unknown ❌ 1201.39203 1200.99071
cvc5 cvc5 unsat ✅ 0.96891 0.84117
SMTInterpol SMTInterpol unknown ❌ 1201.88918 1828.99740
Yices2 Yices2 unsat ✅ 0.44596 0.32188
Z3alpha Z3-alpha unsat ✅ 1.10129 1.13477
Z3 Z3-alpha-base unsat ✅ 0.56262 0.44502
Z3-Owl-base unsat ✅ 1.72044 1.58736
z3siri-base unsat ✅ 0.59402 0.46954
Z3-Owl Z3-Owl unsat ✅ 1.14774 1.01390