Benchmark

non-incremental/QF_ABV/platania/no_init_bubble_sort/no_init_bubble_sort_safe2.c.smt2

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Bubble Sort algorithm for sorting an
array of N (the increasing parameter) elements. Differently from the
bubble_sort benchmarks, here arrays are not instantiated, that results in
arrays with unconstrained elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size4953
Compressed Size1122
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 4945
Compressed Size1123
Max. Term Depth17
Asserts 11
Declared Functions0
Declared Constants17
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite8 not3 and24 =>6
=10 let8 bvadd6 bvsub21
bvult25 bvule5 select10 store2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 Yices Yices 1.0.10 unsat ✅
Z3 Z3 0.1 unsat ✅
Z3 0.1 (fixed BV) unsat ✅
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.01118
Boolector-SMT-COMP-2011 default unsat ✅ 0.02485
Boolector-SMT-COMP-2012 default unsat ✅ 0.01307
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 0.04439
CVC3-SMT-COMP-2011 default unsat ✅ 0.04024
CVC3-SMT-COMP-2012 default unsat ✅ 0.04052
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.01768
CVC4-SMT-EVAL-2013 default unsat ✅
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.02676
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.02253
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.01633
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.00947
SONOLAR-SMT-COMP-2011 default unknown ❌
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.00960
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 0.01831
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅
Z3-SMT-COMP-2011 default unsat ✅ 0.03162
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 0.03973 0.03899
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.01219 0.01000
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.01303 0.01000
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.03313 0.03200
Yices2 Yices default unsat ✅ 0.00809 0.00400
Z3 z3 4.4.0 default unsat ✅ 0.04527 0.04499
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 0.05386 0.05460
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.01404 0.01427
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.02692 0.02790
Yices2 Yices-2.4.2 default unsat ✅ 0.01399 0.00542
Z3 z3-4.4.1 default unsat ✅ 0.03980 0.04105
SMT-COMP 2017 Boolector Boolector SMT17 final boolector unsat ✅ 0.05317 0.05275
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.01428 0.01393
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.02734 0.02798
Yices2 Yices2-Main default unsat ✅ 0.00818 0.00628
Z3 z3-4.5.0 default unsat ✅ 0.05880 0.05750
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 0.05023 0.05019
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.01422 0.01439
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.02691 0.02792
Yices2 Yices 2.6.0_default unsat ✅ 0.00872 0.00814
Z3 z3-4.7.1_default unsat ✅ 0.05341 0.05330
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.01169 0.01172
Poolector-wrapped-sq_default unsat ✅ 0.17574 0.17937
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.01949 0.01984
Par4 Par4-wrapped-sq_default unsat ✅ 0.01925 0.00764
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.01272 0.00965
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.05809 0.05809
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.21585 0.11608
cvc5 cvc5 unsat ✅ 0.22633 0.12649
SMTInterpol SMTInterpol unsat ✅ 0.72931 1.33331
Yices2 Yices2 unsat ✅ 0.22069 0.12069
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.29066 0.16191
cvc5 cvc5 unsat ✅ 0.29990 0.17401
SMTInterpol SMTInterpol unsat ✅ 0.63940 0.95513
Yices2 Yices2 unsat ✅ 0.25720 0.13809
Z3 Z3-Owl-base unsat ✅ 0.39258 0.26594
Z3-Owl Z3-Owl unsat ✅ 0.80273 0.68056