Benchmark

non-incremental/QF_ABV/platania/bubble_sort/bubble_sort2.c.smt2

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Bubble Sort algorithm for sorting an
array of N (the increasing parameter) elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size4770
Compressed Size1099
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 4762
Compressed Size1093
Max. Term Depth19
Asserts 13
Declared Functions0
Declared Constants19
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite8 not3 and27 =>6
=14 let8 bvadd6 bvsub21
bvult25 bvule4 select10 store4

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 Yices Yices 1.0.10 unsat ✅ — —
Z3 Z3 0.1 unsat ✅ — —
Z3 0.1 (fixed BV) unsat ✅ — —
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.00917 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.00921 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.00934 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 0.01643 —
CVC3-SMT-COMP-2011 default unsat ✅ 0.01476 —
CVC3-SMT-COMP-2012 default unsat ✅ 0.01516 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.01452 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.00972 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.01683 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.01657 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.01127 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.00936 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.00935 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.00922 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 0.01040 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.00922 —
Z3-SMT-COMP-2011 default unsat ✅ 0.01574 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 0.00860 0.00200
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.01101 0.00900
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.01264 0.01000
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.02169 0.02100
Yices2 Yices default unsat ✅ 0.00816 0.00200
Z3 z3 4.4.0 default unsat ✅ 0.03001 0.02899
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 0.01576 0.00422
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.01254 0.01269
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.01679 0.01768
Yices2 Yices-2.4.2 default unsat ✅ 0.01111 0.00320
Z3 z3-4.4.1 default unsat ✅ 0.02872 0.02981
SMT-COMP 2017 Boolector Boolector SMT17 final boolector unsat ✅ 0.01443 0.00374
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.01792 0.01386
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.01619 0.01704
Yices2 Yices2-Main default unsat ✅ 0.01501 0.00335
Z3 z3-4.5.0 default unsat ✅ 0.03214 0.03082
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 0.00769 0.00307
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.01287 0.01303
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.01674 0.01769
Yices2 Yices 2.6.0_default unsat ✅ 0.00801 0.00607
Z3 z3-4.7.1_default unsat ✅ 0.03364 0.03356
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.01190 0.00696
Poolector-wrapped-sq_default unsat ✅ 0.17741 0.11645
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.01833 0.01871
Par4 Par4-wrapped-sq_default unsat ✅ 0.01203 0.00612
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.00948 0.00652
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.03638 0.03640
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.21513 0.11548
cvc5 cvc5 unsat ✅ 0.22106 0.12134
SMTInterpol SMTInterpol unsat ✅ 0.74542 1.39995
Yices2 Yices2 unsat ✅ 0.21394 0.11414