Benchmark

non-incremental/QF_ABV/platania/bubble_sort/bubble_sort24.c.smt2 

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Bubble Sort algorithm for sorting an
array of N (the increasing parameter) elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size1293305
Compressed Size83046
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1293297
Compressed Size83055
Max. Term Depth4353
Asserts 2741
Declared Functions0
Declared Constants2747
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite2714 not25 and9641 =>2140
=2764 let2670 bvadd2668 bvsub8051
bvult9133 bvule1082 select4256 store1082

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 0.50 (1/2) Yices Yices 1.0.10 unknown ❌ 1801.00000 —
Z3 Z3 0.1 unsat ✅ 0.30000 —
Z3 0.1 (fixed BV) unsat ✅ 0.30000 —
SMT-COMP 2008 Boolector Boolector unsat ✅ 0.10000 —
CVC3 CVC3-1.5 unsat ✅ 21.00000 —
Z3 Z3 0.1 unsat ✅ 0.30000 —
Z3.2 unsat ✅ 0.30000 —
SMT-COMP 2010 Boolector Boolector 1.2 unsat ✅ 0.20000 —
CVC3 CVC3 2.3 unsat ✅ 69.80000 —
SMT-COMP 2011 0.40 (3/5) Boolector Boolector 1.5.23-833 unsat ✅ 0.20000 —
CVC3 CVC3 v2.4 unsat ✅ 4.40000 —
MathSAT MathSAT5 unknown ❌ 1200.10000 —
SONOLAR SONOLAR unsat ✅ 0.50000 —
Z3 Z3 unknown ❌ 1200.00000 —
SMT Evaluation 2013 0.71 (2/7) Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌ — —
Boolector-SMT-COMP-2011 default unknown ❌ — —
Boolector-SMT-COMP-2012 default unknown ❌ — —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unsat ✅ 3.42462 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unknown ❌ — —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌ — —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.93158 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.84256 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌ — —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unknown ❌ — —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unknown ❌ — —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌ — —
Z3-SMT-COMP-2011 default unknown ❌ — —
SMT-COMP 2014 0.14 (6/7) Boolector Boolector boolectord unsat ✅ 0.36673 0.35695
Boolector boolectorj unsat ✅ 0.36588 0.35594
CVC4 CVC4 f7118b2 default unsat ✅ 0.90325 0.89386
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.02483 0.01600
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.04196 0.03199
MathSAT MathSAT-5.2.12-Main default unsat ✅ 0.41125 0.40294
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 0.34746 0.33595
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.09504 0.08599
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.19335 0.18097
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 0.16494 0.16397
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.94494 0.94286
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.93135 0.92886
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.34873 0.34795
Yices2 Yices default unsat ✅ 0.08728 0.08599
Z3 z3 4.4.0 default unsat ✅ 0.18928 0.18897
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 0.15140 0.15146
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.91247 0.91322
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.32217 0.32336
Yices2 Yices-2.4.2 default unsat ✅ 0.08848 0.08852
Z3 z3-4.4.1 default unsat ✅ 0.18247 0.18416
SMT-COMP 2017 Boolector Boolector SMT17 final boolector unsat ✅ 0.13165 0.13084
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.96480 0.96427
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.32949 0.32996
Yices2 Yices2-Main default unsat ✅ 0.08487 0.08418
Z3 z3-4.5.0 default unsat ✅ 0.19239 0.19208
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 0.12147 0.12138
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.07488 1.07483
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.32369 0.32449
Yices2 Yices 2.6.0_default unsat ✅ 0.08321 0.08309
Z3 z3-4.7.1_default unsat ✅ 0.20402 0.20389
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.18417 0.18416
Poolector-wrapped-sq_default unsat ✅ 0.37872 0.92333
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.12042 1.12069
Par4 Par4-wrapped-sq_default unsat ✅ 0.08809 0.00654
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.08653 0.08654
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.19975 0.19975
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.17990 0.17985
Boolector Boolector-wrapped-sq_default unsat ✅ 0.18574 0.18577
CVC4 CVC4-sq-final_default unsat ✅ 1.52932 1.52965
MathSAT MathSAT5_default.sh unsat ✅ 0.35292 0.35290
Par4 Par4-wrapped-sq_default unsat ✅ 0.08985 0.00586
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.09560 0.09553
Z3 z3-4.8.8_default unsat ✅ 0.20123 0.20121
SMT-COMP 2023 0.20 (4/5) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.36181 0.36173
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.78347 0.78230
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.11000 1270.01000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.09725 0.09715
Z3-Owl z3-Owl-Final_default unsat ✅ 1.09494 1.09483
z3-Owl-Final_default unsat ✅ 1.06983 1.06978
SMT-COMP 2024 0.25 (3/4) Bitwuzla Bitwuzla unsat ✅ 0.38187 0.28187
cvc5 cvc5 unsat ✅ 0.81216 0.71234
SMTInterpol SMTInterpol unknown ❌ 1201.74240 1238.56522
Yices2 Yices2 unsat ✅ 0.27635 0.17655
SMT-COMP 2025 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 0.45145 0.32483
cvc5 cvc5 unsat ✅ 0.64942 0.52893
SMTInterpol SMTInterpol unknown ❌ 1201.48723 1235.65453
Yices2 Yices2 unsat ✅ 0.33638 0.21099
Z3 Z3-Owl-base unsat ✅ 0.90154 0.78147
Z3-Owl Z3-Owl unsat ✅ 1.02338 0.89355