Benchmark

non-incremental/QF_ABV/platania/bubble_sort/bubble_sort28.c.smt2 

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Bubble Sort algorithm for sorting an
array of N (the increasing parameter) elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size1783151
Compressed Size114539
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1783143
Compressed Size114547
Max. Term Depth5973
Asserts 3757
Declared Functions0
Declared Constants3763
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite3726 not29 and13261 =>2944
=3784 let3674 bvadd3672 bvsub11071
bvult12557 bvule1486 select5860 store1486

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 0.50 (1/2) Yices Yices 1.0.10 unknown ❌ 1800.80000 —
Z3 Z3 0.1 unsat ✅ 0.40000 —
Z3 0.1 (fixed BV) unsat ✅ 0.40000 —
SMT-COMP 2008 Boolector Boolector unsat ✅ 0.20000 —
CVC3 CVC3-1.5 unsat ✅ 32.70000 —
Z3 Z3 0.1 unsat ✅ 0.40000 —
Z3.2 unsat ✅ 0.40000 —
SMT-COMP 2011 0.40 (3/5) Boolector Boolector 1.5.23-833 unsat ✅ 0.30000 —
CVC3 CVC3 v2.4 unsat ✅ 6.10000 —
MathSAT MathSAT5 unknown ❌ 1200.00000 —
SONOLAR SONOLAR unsat ✅ 0.70000 —
Z3 Z3 unknown ❌ 1200.00000 —
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.13765 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.17690 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.15479 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 5.42509 —
CVC3-SMT-COMP-2011 default unsat ✅ 4.78993 —
CVC3-SMT-COMP-2012 default unsat ✅ 4.81610 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.20609 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.94213 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.70251 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.60341 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.43165 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.48503 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.53160 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.51422 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 0.22257 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.26865 —
Z3-SMT-COMP-2011 default unsat ✅ 0.25183 —
SMT-COMP 2014 0.14 (6/7) Boolector Boolector boolectord unsat ✅ 0.60821 0.59791
Boolector boolectorj unsat ✅ 0.60462 0.60191
CVC4 CVC4 f7118b2 default unsat ✅ 1.30770 1.29780
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.02482 0.01600
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.04342 0.03099
MathSAT MathSAT-5.2.12-Main default unsat ✅ 0.67740 0.66890
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 0.50120 0.48992
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.12891 0.11998
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.25414 0.24496
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 0.23439 0.23296
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.34658 1.34479
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.34493 1.34280
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.58629 0.58491
Yices2 Yices default unsat ✅ 0.11988 0.11898
Z3 z3 4.4.0 default unsat ✅ 0.25358 0.25396
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 0.20822 0.20833
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.33398 1.33495
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.54241 0.54367
Yices2 Yices-2.4.2 default unsat ✅ 0.12285 0.12247
Z3 z3-4.4.1 default unsat ✅ 0.24186 0.24330
SMT-COMP 2017 Boolector Boolector SMT17 final boolector unsat ✅ 0.20949 0.20936
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.45217 1.45150
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.55357 0.55265
Yices2 Yices2-Main default unsat ✅ 0.12001 0.11854
Z3 z3-4.5.0 default unsat ✅ 0.25609 0.25480
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 0.17295 0.17285
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.53847 1.53853
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.53536 0.53631
Yices2 Yices 2.6.0_default unsat ✅ 0.11562 0.11550
Z3 z3-4.7.1_default unsat ✅ 0.26886 0.26859
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.25837 0.25838
Poolector-wrapped-sq_default unsat ✅ 0.37689 0.97841
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.59258 1.59277
Par4 Par4-wrapped-sq_default unsat ✅ 0.12677 0.00582
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.11892 0.11874
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.25880 0.25877
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.25494 0.25486
Boolector Boolector-wrapped-sq_default unsat ✅ 0.26013 0.26014
CVC4 CVC4-sq-final_default unsat ✅ 2.18102 2.18132
MathSAT MathSAT5_default.sh unsat ✅ 0.59981 0.59975
Par4 Par4-wrapped-sq_default unsat ✅ 0.11842 0.00662
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.13190 0.13185
Z3 z3-4.8.8_default unsat ✅ 0.26274 0.26270
SMT-COMP 2023 0.20 (4/5) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.48690 0.48682
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.25233 1.24738
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.10000 1265.77000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.13466 0.13463
Z3-Owl z3-Owl-Final_default unsat ✅ 1.27857 1.27849
z3-Owl-Final_default unsat ✅ 1.28475 1.23414