Benchmark

non-incremental/QF_ABV/platania/bubble_sort/bubble_sort26.c.smt2 

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Bubble Sort algorithm for sorting an
array of N (the increasing parameter) elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size1528521
Compressed Size100572
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1528513
Compressed Size100583
Max. Term Depth5131
Asserts 3229
Declared Functions0
Declared Constants3235
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite3200 not27 and11379 =>2526
=3254 let3152 bvadd3150 bvsub9501
bvult10777 bvule1276 select5026 store1276

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 0.50 (1/2) Yices Yices 1.0.10 unknown ❌ 1800.90000 —
Z3 Z3 0.1 unsat ✅ 0.40000 —
Z3 0.1 (fixed BV) unsat ✅ 0.40000 —
SMT-COMP 2008 Boolector Boolector unsat ✅ 0.20000 —
CVC3 CVC3-1.5 unsat ✅ 26.70000 —
Z3 Z3 0.1 unsat ✅ 0.40000 —
Z3.2 unsat ✅ 0.40000 —
SMT-COMP 2009 0.25 (3/4) Boolector Boolector unsat ✅ 0.20000 —
Boolector 1.2 unsat ✅ 0.20000 —
CVC3 CVC3 2.0 unsat ✅ 6.80000 —
MathSAT MathSAT 4.3 unknown ❌ 183.80000 —
Yices2 Yices 2 proto unsat ✅ 0.10000 —
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.11557 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.15046 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.13047 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 4.59134 —
CVC3-SMT-COMP-2011 default unsat ✅ 4.07486 —
CVC3-SMT-COMP-2012 default unsat ✅ 4.11759 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.97862 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.76523 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.55886 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.24356 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.11476 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.40297 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.43421 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.42921 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 0.18736 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.22767 —
Z3-SMT-COMP-2011 default unsat ✅ 0.21743 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 0.19653 0.19597
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.13725 1.13583
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.12895 1.12683
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.45787 0.45693
Yices2 Yices default unsat ✅ 0.10340 0.10198
Z3 z3 4.4.0 default unsat ✅ 0.21806 0.21797
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 0.17813 0.17822
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.10633 1.10722
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.41546 0.41653
Yices2 Yices-2.4.2 default unsat ✅ 0.10444 0.10441
Z3 z3-4.4.1 default unsat ✅ 0.21266 0.21401
SMT-COMP 2017 Boolector Boolector SMT17 final boolector unsat ✅ 0.15643 0.15563
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.17908 1.17917
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.42552 0.42566
Yices2 Yices2-Main default unsat ✅ 0.10053 0.09934
Z3 z3-4.5.0 default unsat ✅ 0.21718 0.21641
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 0.14405 0.14395
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.28059 1.28079
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.41629 0.41729
Yices2 Yices 2.6.0_default unsat ✅ 0.09949 0.09921
Z3 z3-4.7.1_default unsat ✅ 0.23499 0.23486
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.22269 0.22263
Poolector-wrapped-sq_default unsat ✅ 0.37889 1.10250
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.33347 1.33384
Par4 Par4-wrapped-sq_default unsat ✅ 0.10375 0.00586
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.10167 0.10165
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.22931 0.22932
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.21412 0.21405
Boolector Boolector-wrapped-sq_default unsat ✅ 0.22233 0.22234
CVC4 CVC4-sq-final_default unsat ✅ 1.83976 1.83964
MathSAT MathSAT5_default.sh unsat ✅ 0.46357 0.46341
Par4 Par4-wrapped-sq_default unsat ✅ 0.10544 0.00671
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.11318 0.11311
Z3 z3-4.8.8_default unsat ✅ 0.23121 0.23117
SMT-COMP 2022 Bitwuzla Bitwuzla-wrapped_default unsat ✅ 0.20486 0.20468
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 1.72134 1.72049
MathSAT MathSAT-5.6.8_default unsat ✅ 0.46355 0.46344
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.11263 0.11254
Z3 z3-4.8.17_default unsat ✅ 0.23872 0.24054
SMT-COMP 2023 0.20 (4/5) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.46651 0.46633
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.00216 1.00264
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.12000 1259.14000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.11460 0.11457
Z3-Owl z3-Owl-Final_default unsat ✅ 1.18814 1.18819
z3-Owl-Final_default unsat ✅ 1.13830 1.13826