Benchmark

non-incremental/QF_ABV/platania/no_init_bubble_sort/no_init_bubble_sort_unsafe12.c.smt2 

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Bubble Sort algorithm for sorting an
array of N (the increasing parameter) elements. Differently from the
bubble_sort benchmarks, here arrays are not instantiated, that results in
arrays with unconstrained elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size325504
Compressed Size19742
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 325496
Compressed Size19753
Max. Term Depth1037
Asserts 641
Declared Functions0
Declared Constants647
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite638 not23 and2234 =>516
=640 let638 bvadd616 bvsub1871
bvult2125 bvule265 select980 store242

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 Boolector Boolector sat ✅ 3.20000 —
CVC3 CVC3-1.5 sat ✅ 11.90000 —
Z3 Z3 0.1 sat ✅ 26.90000 —
Z3.2 sat ✅ 1074.40000 —
SMT-COMP 2010 Boolector Boolector 1.2 sat ✅ 3.50000 —
CVC3 CVC3 2.3 sat ✅ 16.20000 —
SMT-COMP 2011 0.40 (3/5) Boolector Boolector 1.5.23-833 sat ✅ 6.80000 —
CVC3 CVC3 v2.4 sat ✅ 1.90000 —
MathSAT MathSAT5 sat ✅ 168.00000 —
SONOLAR SONOLAR unknown ❌ 1200.00000 —
Z3 Z3 unknown ❌ 1200.00000 —
SMT Evaluation 2013 0.57 (3/7) Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌ — —
Boolector-SMT-COMP-2011 default unknown ❌ — —
Boolector-SMT-COMP-2012 default unknown ❌ — —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default sat ✅ 1.31583 —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unknown ❌ — —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.74542 —
MathSAT5-SMT-COMP-2011 default unknown ❌ — —
MathSAT5-SMT-COMP-2012 default unknown ❌ — —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌ — —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unknown ❌ — —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default sat ✅ 0.36794 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌ — —
Z3-SMT-COMP-2011 default unknown ❌ — —
SMT-COMP 2014 0.29 (5/7) Boolector Boolector boolectord sat ✅ 0.15273 0.14198
Boolector boolectorj sat ✅ 0.12389 0.11398
CVC4 CVC4 f7118b2 default sat ✅ 2.53314 2.52461
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.02445 0.01500
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.03953 0.03000
MathSAT MathSAT-5.2.12-Main default sat ✅ 0.73982 0.73189
SONOLAR sonolar_smtcomp-2014 default sat ✅ 312.15200 312.25900
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 0.14700 0.13798
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2398.91000 2400.01000
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv sat ✅ 1.24640 1.24581
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 0.35777 0.35595
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 0.69820 0.69589
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.71208 0.71089
Yices2 Yices default sat ✅ 0.25486 0.25396
Z3 z3 4.4.0 default sat ✅ 216.19200 216.23800
SMT-COMP 2016 Boolector Boolector boolector sat ✅ 165.61100 165.70700
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 0.66684 0.66744
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.62255 0.62389
Yices2 Yices-2.4.2 default sat ✅ 0.22830 0.22842
Z3 z3-4.4.1 default sat ✅ 1076.71000 1077.25000
SMT-COMP 2017 Boolector Boolector SMT17 final boolector sat ✅ 284.16000 284.09800
CVC4 CVC4-smtcomp2017-main default sat ✅ 0.75545 0.75480
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.62256 0.62163
Yices2 Yices2-Main default sat ✅ 0.14030 0.13877
Z3 z3-4.5.0 default sat ✅ 254.39600 254.30700
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default sat ✅ 401.91000 401.91200
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.74350 0.74371
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.63911 0.64079
Yices2 Yices 2.6.0_default sat ✅ 0.23563 0.23559
Z3 z3-4.7.1_default sat ✅ 697.86700 697.78200
SMT-COMP 2021 MathSAT mathsat-5.6.6_default sat ✅ 0.61337 0.61326
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.14505 0.14500
Yices 2.6.2 for SMTCOMP2020_default sat ✅ 0.14509 0.14501
Z3 z3-4.8.11_default sat ✅ 0.70593 0.70568
SMT-COMP 2022 0.20 (4/5) Bitwuzla Bitwuzla-wrapped_default sat ✅ 0.20430 0.20427
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 1.15420 1.15485
MathSAT MathSAT-5.6.8_default sat ✅ 0.66561 0.66551
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.14380 0.14375
Z3 z3-4.8.17_default unknown ❌ 1200.03000 1199.77000
SMT-COMP 2023 0.20 (4/5) Bitwuzla Bitwuzla-fixed_default sat ✅ 3.94404 3.94322
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 1.08270 2.07321
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.04000 1264.56000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.22609 0.22602
Z3-Owl z3-Owl-Final_default sat ✅ 1.48220 1.48212
z3-Owl-Final_default unknown ❌ 1200.03000 1199.61000