Benchmark

non-incremental/QF_ABV/platania/bubble_sort/bubble_sort20.c.smt2 

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Bubble Sort algorithm for sorting an
array of N (the increasing parameter) elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size883259
Compressed Size55434
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 883251
Compressed Size55445
Max. Term Depth2989
Asserts 1885
Declared Functions0
Declared Constants1891
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite1862 not21 and6597 =>1464
=1904 let1826 bvadd1824 bvsub5511
bvult6253 bvule742 select2908 store742

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 Boolector Boolector unsat ✅ 0.10000 —
CVC3 CVC3-1.5 unsat ✅ 12.50000 —
Z3 Z3 0.1 unsat ✅ 0.20000 —
Z3.2 unsat ✅ 0.20000 —
SMT-COMP 2010 Boolector Boolector 1.2 unsat ✅ 0.10000 —
CVC3 CVC3 2.3 unsat ✅ 32.90000 —
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.07011 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.08770 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.07935 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 2.60433 —
CVC3-SMT-COMP-2011 default unsat ✅ 2.30932 —
CVC3-SMT-COMP-2012 default unsat ✅ 2.33317 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.48603 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.41510 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.26319 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.52938 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.46246 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.21755 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.24651 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.22993 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 0.11540 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.13312 —
Z3-SMT-COMP-2011 default unsat ✅ 0.13956 —
SMT-COMP 2014 0.14 (6/7) Boolector Boolector boolectord unsat ✅ 0.22353 0.20997
Boolector boolectorj unsat ✅ 0.22286 0.20897
CVC4 CVC4 f7118b2 default unsat ✅ 0.58365 0.57291
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.02477 0.01600
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.04434 0.03299
MathSAT MathSAT-5.2.12-Main default unsat ✅ 0.23656 0.23496
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 0.22765 0.21797
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.06882 0.05999
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.13348 0.12598
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 0.10936 0.10798
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.61083 0.60791
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.60597 0.60291
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.20071 0.19997
Yices2 Yices default unsat ✅ 0.06038 0.05899
Z3 z3 4.4.0 default unsat ✅ 0.13758 0.13598
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 0.10156 0.10161
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.59316 0.59370
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.18554 0.18678
Yices2 Yices-2.4.2 default unsat ✅ 0.06038 0.06036
Z3 z3-4.4.1 default unsat ✅ 0.13476 0.13653
SMT-COMP 2017 Boolector Boolector SMT17 final boolector unsat ✅ 0.08950 0.08943
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.63978 0.63925
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.18424 0.18543
Yices2 Yices2-Main default unsat ✅ 0.05901 0.05896
Z3 z3-4.5.0 default unsat ✅ 0.13822 0.13731
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 0.08243 0.08238
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.71199 0.71221
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.18330 0.18412
Yices2 Yices 2.6.0_default unsat ✅ 0.05918 0.05913
Z3 z3-4.7.1_default unsat ✅ 0.14820 0.14815
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.12863 0.12862
Poolector-wrapped-sq_default unsat ✅ 0.27582 0.63899
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.74330 0.74368
Par4 Par4-wrapped-sq_default unsat ✅ 0.06588 0.00647
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.06127 0.06127
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.14700 0.14700
SMT-COMP 2025 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 0.35043 0.22336
cvc5 cvc5 unsat ✅ 0.52880 0.40585
SMTInterpol SMTInterpol unknown ❌ 1201.35280 1239.58268
Yices2 Yices2 unsat ✅ 0.31964 0.19368
Z3 Z3-Owl-base unsat ✅ 0.68867 0.56810
Z3-Owl Z3-Owl unsat ✅ 0.96173 0.82306