Benchmark

non-incremental/QF_ABV/platania/bubble_sort/bubble_sort30.c.smt2 

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Bubble Sort algorithm for sorting an
array of N (the increasing parameter) elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size2057275
Compressed Size129200
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 2057267
Compressed Size129210
Max. Term Depth6879
Asserts 4325
Declared Functions0
Declared Constants4331
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite4292 not31 and15287 =>3394
=4354 let4236 bvadd4234 bvsub12761
bvult14473 bvule1712 select6758 store1712

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 Boolector Boolector unsat ✅ 0.20000 —
CVC3 CVC3-1.5 unsat ✅ 40.00000 —
Z3 Z3 0.1 unsat ✅ 0.50000 —
Z3.2 unsat ✅ 0.50000 —
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.16906 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.20775 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.17852 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 6.27701 —
CVC3-SMT-COMP-2011 default unsat ✅ 5.56058 —
CVC3-SMT-COMP-2012 default unsat ✅ 5.58538 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.47445 —
CVC4-SMT-EVAL-2013 default unsat ✅ 1.11328 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.88501 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 2.05872 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.83886 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.57934 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.62997 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.61238 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 0.26911 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.32096 —
Z3-SMT-COMP-2011 default unsat ✅ 0.29745 —
SMT-COMP 2014 0.14 (6/7) Boolector Boolector boolectord unsat ✅ 0.76533 0.76288
Boolector boolectorj unsat ✅ 0.76413 0.76188
CVC4 CVC4 f7118b2 default unsat ✅ 1.53996 1.52577
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.02481 0.01600
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.04296 0.03299
MathSAT MathSAT-5.2.12-Main default unsat ✅ 0.85492 0.84687
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 0.58578 0.57491
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.14607 0.13698
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.29375 0.28596
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 0.28433 0.28296
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.57976 1.57776
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.56988 1.56776
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.77728 0.77688
Yices2 Yices default unsat ✅ 0.13889 0.13798
Z3 z3 4.4.0 default unsat ✅ 0.28518 0.28496
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 0.24657 0.24668
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.55383 1.55496
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.70861 0.71003
Yices2 Yices-2.4.2 default unsat ✅ 0.14048 0.14044
Z3 z3-4.4.1 default unsat ✅ 0.27450 0.27600
SMT-COMP 2017 Boolector Boolector SMT17 final boolector unsat ✅ 0.21893 0.21802
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.64617 1.64461
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.71538 0.71289
Yices2 Yices2-Main default unsat ✅ 0.13251 0.13190
Z3 z3-4.5.0 default unsat ✅ 0.28513 0.28382
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 0.19795 0.19785
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.82347 1.82361
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.70154 0.70238
Yices2 Yices 2.6.0_default unsat ✅ 0.12966 0.12961
Z3 z3-4.7.1_default unsat ✅ 0.30771 0.30758
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.29326 0.29318
Boolector Boolector-wrapped-sq_default unsat ✅ 0.29981 0.29978
CVC4 CVC4-sq-final_default unsat ✅ 2.59998 2.60022
MathSAT MathSAT5_default.sh unsat ✅ 0.77965 0.77940
Par4 Par4-wrapped-sq_default unsat ✅ 0.13653 0.00747
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.15080 0.15075
Z3 z3-4.8.8_default unsat ✅ 0.31668 0.31654
SMT-COMP 2024 0.25 (3/4) Bitwuzla Bitwuzla unsat ✅ 0.56686 0.46677
cvc5 cvc5 unsat ✅ 1.23736 1.13637
SMTInterpol SMTInterpol unknown ❌ 1201.72412 1247.59635
Yices2 Yices2 unsat ✅ 0.32103 0.22126