Benchmark
non-incremental/QF_ABV/platania/no_init_bubble_sort/no_init_bubble_sort_unsafe7.c.smt2
The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.
This family contains formulae modeling the Bubble Sort algorithm for sorting an
array of N (the increasing parameter) elements. Differently from the
bubble_sort benchmarks, here arrays are not instantiated, that results in
arrays with unconstrained elements.
Contributed by Lorenzo Platania (c1009@unige.it). Translated from CVC format
by Clark Barrett.
| Benchmark |
|---|
| Size | 99175 |
| Compressed Size | 7476 |
| License |
Creative Commons Attribution 4.0 International
(CC-BY-4.0)
|
| Category | industrial |
| First Occurrence | 2007-07-03 |
| Generated By | — |
| Generated On | — |
| Generator | — |
| Dolmen OK | 1 |
| strict Dolmen OK | 1 |
| check-sat calls | 1 |
| Status | sat |
| Inferred Status | sat |
| Size | 99167 |
| Compressed Size | 7499 |
| Max. Term Depth | 327 |
| Asserts | 201 |
| Declared Functions | 0 |
| Declared Constants | 207 |
| Declared Sorts | 0 |
| Defined Functions | 0 |
| Defined Recursive Functions | 0 |
| Defined Sorts | 0 |
| Constants | 0 |
| Declared Datatypes | 0 |
Symbols
ite | 198 |
not | 13 |
and | 679 |
=> | 161 |
= | 200 |
let | 198 |
bvadd | 186 |
bvsub | 571 |
bvult | 650 |
bvule | 85 |
select | 295 |
store | 72 |
Evaluations
| Evaluation |
Rating |
Solver |
Variant |
Result |
Wallclock |
CPU Time |
|
SMT-COMP 2007
|
|
Yices |
Yices 1.0.10 |
sat ✅
|
71.80000
|
—
|
| |
Z3 |
Z3 0.1 |
sat ✅
|
0.20000
|
—
|
| |
|
Z3 0.1 (fixed BV) |
sat ✅
|
0.20000
|
—
|
|
SMT-COMP 2008
|
|
Boolector |
Boolector |
sat ✅
|
0.20000
|
—
|
| |
CVC3 |
CVC3-1.5 |
sat ✅
|
1.60000
|
—
|
| |
Z3 |
Z3 0.1 |
sat ✅
|
0.20000
|
—
|
| |
|
Z3.2 |
sat ✅
|
2.20000
|
—
|
|
SMT-COMP 2012
|
|
Boolector |
Boolector |
sat ✅
|
0.20000
|
—
|
| |
|
Boolector 1.5.23-833 |
sat ✅
|
0.70000
|
—
|
| |
CVC3 |
CVC3 v2.4.2 |
sat ✅
|
0.50000
|
—
|
| |
|
CVC4 1.0rc.3931 |
sat ✅
|
205.20000
|
—
|
| |
|
CVC4 1.0rc.3970 |
sat ✅
|
205.00000
|
—
|
| |
SONOLAR |
SONOLAR |
sat ✅
|
2.50000
|
—
|
| |
Tiffany de Wintermonte |
Tiffany de Wintermonte & Sonolar |
sat ✅
|
0.20000
|
—
|
|
SMT Evaluation 2013
|
|
Boolector |
Boolector-1.5.118-SMT-EVAL-2013 default |
sat ✅
|
0.22997
|
—
|
| |
|
Boolector-SMT-COMP-2011 default |
sat ✅
|
0.47624
|
—
|
| |
|
Boolector-SMT-COMP-2012 default |
sat ✅
|
0.10941
|
—
|
| |
CVC3 |
CVC3-SMT-COMP-2010 default |
sat ✅
|
0.39461
|
—
|
| |
|
CVC3-SMT-COMP-2011 default |
sat ✅
|
0.36835
|
—
|
| |
|
CVC3-SMT-COMP-2012 default |
sat ✅
|
0.35684
|
—
|
| |
CVC4 |
CVC4-SMT-COMP-2012-Resubmission default |
sat ✅
|
0.20800
|
—
|
| |
|
CVC4-SMT-EVAL-2013 default |
sat ✅
|
0.17026
|
—
|
| |
MathSAT |
MathSAT5-5.2.6-SMT-EVAL-2013 default |
sat ✅
|
0.11869
|
—
|
| |
|
MathSAT5-SMT-COMP-2011 default |
sat ✅
|
7.44903
|
—
|
| |
|
MathSAT5-SMT-COMP-2012 default |
sat ✅
|
13.37440
|
—
|
| |
SONOLAR |
SONOLAR-2013-05-15-SMT-EVAL-2013 default |
sat ✅
|
1.27573
|
—
|
| |
|
SONOLAR-SMT-COMP-2011 default |
unknown ❌
|
—
|
—
|
| |
|
SONOLAR-SMT-COMP-2012 default |
sat ✅
|
1.29637
|
—
|
| |
Tiffany de Wintermonte |
TdW-SMT-COMP-2012 default |
sat ✅
|
0.12664
|
—
|
| |
Z3 |
Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default |
sat ✅
|
0.83304
|
—
|
| |
|
Z3-SMT-COMP-2011 default |
sat ✅
|
0.40256
|
—
|
|
SMT-COMP 2015
|
|
Boolector |
Boolector SMT15 QF_AUFBV final boolector_qf_aufbv |
sat ✅
|
0.41301
|
0.41194
|
| |
CVC4 |
CVC4-master-2015-06-15-9b32405-main default |
sat ✅
|
0.08577
|
0.08399
|
| |
|
CVC4-experimental-2015-06-15-ff5745a-main default |
sat ✅
|
0.10762
|
0.10498
|
| |
MathSAT |
MathSat 5.3.6 main smtcomp2015_main |
sat ✅
|
0.12008
|
0.11898
|
| |
Yices2 |
Yices default |
sat ✅
|
0.05748
|
0.05599
|
| |
Z3 |
z3 4.4.0 default |
sat ✅
|
9.44254
|
9.44456
|
|
SMT-COMP 2016
|
|
Boolector |
Boolector boolector |
sat ✅
|
1.20610
|
1.20676
|
| |
CVC4 |
CVC4-master-2016-05-27-cfef263-main default |
sat ✅
|
0.10607
|
0.10632
|
| |
MathSAT |
mathsat-5.3.11-linux-x86_64-Main default |
sat ✅
|
0.10087
|
0.10198
|
| |
Yices2 |
Yices-2.4.2 default |
sat ✅
|
0.01777
|
0.01774
|
| |
Z3 |
z3-4.4.1 default |
sat ✅
|
5.24571
|
5.24968
|
|
SMT-COMP 2017
|
|
Boolector |
Boolector SMT17 final boolector |
sat ✅
|
1.92067
|
1.91935
|
| |
CVC4 |
CVC4-smtcomp2017-main default |
sat ✅
|
0.11734
|
0.11322
|
| |
MathSAT |
mathsat-5.4.1-linux-x86_64-Main default |
sat ✅
|
0.10202
|
0.10208
|
| |
Yices2 |
Yices2-Main default |
sat ✅
|
0.01869
|
0.01803
|
| |
Z3 |
z3-4.5.0 default |
sat ✅
|
2.51491
|
2.51381
|
|
SMT-COMP 2018
|
0.20 (4/5) |
Boolector |
Boolector_default |
sat ✅
|
1.24828
|
1.24792
|
| |
CVC4 |
master-2018-06-10-b19c840-competition-default_default |
sat ✅
|
0.11822
|
0.11839
|
| |
MathSAT |
mathsat-5.5.2-linux-x86_64-Main_default |
unknown ❌
|
0.09793
|
0.09892
|
| |
Yices2 |
Yices 2.6.0_default |
sat ✅
|
0.05087
|
0.05081
|
| |
Z3 |
z3-4.7.1_default |
sat ✅
|
5.63031
|
5.62976
|
|
SMT-COMP 2020
|
|
Bitwuzla |
Bitwuzla-fixed_default |
sat ✅
|
0.10593
|
0.10584
|
| |
Boolector |
Boolector-wrapped-sq_default |
sat ✅
|
0.10846
|
0.10849
|
| |
CVC4 |
CVC4-sq-final_default |
sat ✅
|
0.15503
|
0.15534
|
| |
MathSAT |
MathSAT5_default.sh |
sat ✅
|
0.11527
|
0.11517
|
| |
Par4 |
Par4-wrapped-sq_default |
sat ✅
|
0.05076
|
0.00628
|
| |
Yices2 |
Yices 2.6.2 bug fix_default |
sat ✅
|
0.04586
|
0.04576
|
| |
Z3 |
z3-4.8.8_default |
sat ✅
|
0.11604
|
0.11595
|
|
SMT-COMP 2024
|
|
Bitwuzla |
Bitwuzla |
sat ✅
|
0.28029
|
0.18064
|
| |
cvc5 |
cvc5 |
sat ✅
|
0.32523
|
0.22579
|
| |
SMTInterpol |
SMTInterpol |
sat ✅
|
19.23760
|
44.81636
|
| |
Yices2 |
Yices2 |
sat ✅
|
0.24127
|
0.14179
|