Benchmark

non-incremental/QF_ABV/platania/no_init_bubble_sort/no_init_bubble_sort_unsafe17.c.smt2 

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Bubble Sort algorithm for sorting an
array of N (the increasing parameter) elements. Differently from the
bubble_sort benchmarks, here arrays are not instantiated, that results in
arrays with unconstrained elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size687718
Compressed Size39810
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 687710
Compressed Size39819
Max. Term Depth2147
Asserts 1331
Declared Functions0
Declared Constants1337
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite1328 not33 and4689 =>1071
=1330 let1328 bvadd1296 bvsub3921
bvult4450 bvule545 select2065 store512

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 0.50 (1/2) Yices Yices 1.0.10 unknown ❌ 1801.00000 —
Z3 Z3 0.1 sat ✅ 259.20000 —
Z3 0.1 (fixed BV) sat ✅ 259.60000 —
SMT-COMP 2008 Boolector Boolector sat ✅ 17.50000 —
CVC3 CVC3-1.5 sat ✅ 45.30000 —
Z3 Z3 0.1 sat ✅ 263.10000 —
Z3.2 unknown ❌ 1800.80000 —
SMT-COMP 2010 0.50 (1/2) Boolector Boolector 1.2 sat ✅ 18.20000 —
CVC3 CVC3 2.3 unknown ❌ 48.00000 —
SMT-COMP 2011 0.80 (1/5) Boolector Boolector 1.5.23-833 unknown ❌ 1200.00000 —
CVC3 CVC3 v2.4 sat ✅ 5.40000 —
MathSAT MathSAT5 unknown ❌ 1200.00000 —
SONOLAR SONOLAR unknown ❌ 1200.00000 —
Z3 Z3 unknown ❌ 1200.00000 —
SMT Evaluation 2013 0.29 (5/7) Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 3.88053 —
Boolector-SMT-COMP-2011 default sat ✅ 1429.68000 —
Boolector-SMT-COMP-2012 default sat ✅ 3.32882 —
CVC3 CVC3-SMT-COMP-2010 default sat ✅ 3.72760 —
CVC3-SMT-COMP-2011 default sat ✅ 3.49710 —
CVC3-SMT-COMP-2012 default sat ✅ 3.46244 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 44.67560 —
CVC4-SMT-EVAL-2013 default sat ✅ 39.61890 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 3.99138 —
MathSAT5-SMT-COMP-2011 default sat ✅ 48.86330 —
MathSAT5-SMT-COMP-2012 default sat ✅ 86.60280 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌ — —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unknown ❌ — —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default sat ✅ 0.79674 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌ — —
Z3-SMT-COMP-2011 default unknown ❌ — —
SMT-COMP 2014 0.43 (4/7) Boolector Boolector boolectord sat ✅ 0.34689 0.33195
Boolector boolectorj sat ✅ 0.28673 0.27296
CVC4 CVC4 f7118b2 default sat ✅ 21.29500 21.29580
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.01750 0.01500
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.04109 0.02999
MathSAT MathSAT-5.2.12-Main default sat ✅ 3.92813 3.92040
SONOLAR sonolar_smtcomp-2014 default unknown ❌ 2399.12000 2400.02000
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 0.64955 0.64090
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.21000 2400.06000
SMT-COMP 2015 0.20 (4/5) Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv sat ✅ 1.73403 1.73373
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 1.08781 1.08583
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 3.54810 3.54546
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 3.76653 3.76643
Yices2 Yices default sat ✅ 0.46447 0.46393
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.58000
SMT-COMP 2016 0.20 (4/5) Boolector Boolector boolector sat ✅ 2.86601 2.86757
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 3.57197 3.57421
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 3.35703 3.36003
Yices2 Yices-2.4.2 default sat ✅ 0.46065 0.46015
Z3 z3-4.4.1 default unknown ❌ 2400.02000 2401.24000
SMT-COMP 2017 0.20 (4/5) Boolector Boolector SMT17 final boolector sat ✅ 2.84527 2.84325
CVC4 CVC4-smtcomp2017-main default sat ✅ 3.88413 3.88274
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 3.45212 3.45211
Yices2 Yices2-Main default sat ✅ 0.64747 0.64738
Z3 z3-4.5.0 default unknown ❌ 600.01800 599.71000
SMT-COMP 2018 0.60 (2/5) Boolector Boolector_default unknown ❌ 1200.09000 1200.08000
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 3.74580 3.74207
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 3.50715 3.50785
Yices2 Yices 2.6.0_default sat ✅ 0.42613 0.42585
Z3 z3-4.7.1_default unknown ❌ 1200.06000 1199.95000
SMT-COMP 2021 MathSAT mathsat-5.6.6_default sat ✅ 3.43461 3.43431
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.46370 0.46366
Yices 2.6.2 for SMTCOMP2020_default sat ✅ 0.46821 0.46809
Z3 z3-4.8.11_default sat ✅ 3.30108 3.29730
SMT-COMP 2022 0.20 (4/5) Bitwuzla Bitwuzla-wrapped_default sat ✅ 0.58629 0.58619
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 5.14490 5.14565
MathSAT MathSAT-5.6.8_default sat ✅ 3.64996 3.65015
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.95154 0.95137
Z3 z3-4.8.17_default unknown ❌ 1200.05000 1199.79000
SMT-COMP 2025 0.50 (3/6) Bitwuzla Bitwuzla sat ✅ 0.47990 0.35395
cvc5 cvc5 sat ✅ 1.10983 0.99023
SMTInterpol SMTInterpol unknown ❌ 1201.37248 1236.17789
Yices2 Yices2 sat ✅ 0.33276 0.21248
Z3 Z3-Owl-base unknown ❌ 1201.32222 1201.06193
Z3-Owl Z3-Owl unknown ❌ 1201.76150 1201.07769