Benchmark

non-incremental/QF_ABV/platania/no_init_bubble_sort/no_init_bubble_sort_safe27.c.smt2

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Bubble Sort algorithm for sorting an
array of N (the increasing parameter) elements. Differently from the
bubble_sort benchmarks, here arrays are not instantiated, that results in
arrays with unconstrained elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size1812888
Compressed Size106081
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status None
Size 1812880
Compressed Size106092
Max. Term Depth5567
Asserts 3461
Declared Functions0
Declared Constants3467
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite3458 not53 and12299 =>2781
=3460 let3458 bvadd3406 bvsub10271
bvult11650 bvule1405 select5435 store1352

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 1.00 (0/2) Yices Yices 1.0.10 unknown ❌ 1800.80000
Z3 Z3 0.1 unknown ❌ 1801.00000
Z3 0.1 (fixed BV) unknown ❌ 1800.80000
SMT-COMP 2008 1.00 (0/3) Boolector Boolector unknown ❌ 1801.00000
CVC3 CVC3-1.5 unknown ❌ 1801.00000
Z3 Z3 0.1 unknown ❌ 1800.80000
Z3.2 unknown ❌ 1800.80000
SMT-COMP 2009 1.00 (0/4) Boolector Boolector unknown ❌ 900.00000
Boolector 1.2 unknown ❌ 900.00000
CVC3 CVC3 2.0 unknown ❌ 70.90000
MathSAT MathSAT 4.3 unknown ❌ 295.30000
Yices2 Yices 2 proto unknown ❌ 900.10000
SMT-COMP 2010 1.00 (0/2) Boolector Boolector 1.2 unknown ❌ 1200.00000
CVC3 CVC3 2.3 unknown ❌ 66.00000
SMT-COMP 2012 1.00 (0/4) Boolector Boolector unknown ❌ 1200.00000
Boolector 1.5.23-833 unknown ❌ 1200.00000
CVC3 CVC3 v2.4.2 unknown ❌
CVC4 1.0rc.3931 unknown ❌ 1200.00000
CVC4 1.0rc.3970 unknown ❌ 1200.00000
SONOLAR SONOLAR unknown ❌ 1200.00000
Tiffany de Wintermonte Tiffany de Wintermonte & Sonolar unknown ❌ 1200.00000
SMT-COMP 2011 1.00 (0/5) Boolector Boolector 1.5.23-833 unknown ❌ 1200.00000
CVC3 CVC3 v2.4 unknown ❌ 1200.10000
MathSAT MathSAT5 unknown ❌ 1200.00000
SONOLAR SONOLAR unknown ❌ 1200.00000
Z3 Z3 unknown ❌ 1200.00000
SMT Evaluation 2013 0.86 (1/7) Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌
Boolector-SMT-COMP-2011 default unknown ❌
Boolector-SMT-COMP-2012 default unknown ❌
CVC3 CVC3-SMT-COMP-2010 default unknown ❌
CVC3-SMT-COMP-2011 default unknown ❌
CVC3-SMT-COMP-2012 default unknown ❌
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌
CVC4-SMT-EVAL-2013 default unknown ❌
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌
MathSAT5-SMT-COMP-2011 default unknown ❌
MathSAT5-SMT-COMP-2012 default unsat ✅ 1341.79000
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌
SONOLAR-SMT-COMP-2011 default unknown ❌
SONOLAR-SMT-COMP-2012 default unknown ❌
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unknown ❌
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌
Z3-SMT-COMP-2011 default unknown ❌
SMT-COMP 2014 1.00 (0/7) Boolector Boolector boolectord unknown ❌ 2399.12000 2400.02000
Boolector boolectorj unknown ❌ 2399.12000 2400.09000
CVC4 CVC4 f7118b2 default unknown ❌ 2399.41000 2400.03000
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.02556 0.01500
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.04262 0.03299
MathSAT MathSAT-5.2.12-Main default unknown ❌ 2399.51000 2400.07000
SONOLAR sonolar_smtcomp-2014 default unknown ❌ 2399.31000 2400.07000
Yices2 Yices-2.2.1-smtcomp2014 default unknown ❌ 2399.22000 2400.08000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.31000 2400.08000
SMT-COMP 2015 0.80 (1/5) Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 2000.71000 2001.51000
CVC4 CVC4-master-2015-06-15-9b32405-main default unknown ❌ 2400.01000 2400.98000
CVC4-experimental-2015-06-15-ff5745a-main default unknown ❌ 2400.01000 2400.66000
MathSAT MathSat 5.3.6 main smtcomp2015_main unknown ❌ 2400.01000 2400.66000
Yices2 Yices default unknown ❌ 2400.01000 2400.75000
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.75000
SMT-COMP 2016 1.00 (0/5) Boolector Boolector boolector unknown ❌ 2400.02000 2401.13000
CVC4 CVC4-master-2016-05-27-cfef263-main default unknown ❌ 2400.02000 2400.19000
MathSAT mathsat-5.3.11-linux-x86_64-Main default unknown ❌ 2400.02000 2401.17000
Yices2 Yices-2.4.2 default unknown ❌ 2400.02000 2401.09000
Z3 z3-4.4.1 default unknown ❌ 2400.02000 2401.38000
SMT-COMP 2017 1.00 (0/5) Boolector Boolector SMT17 final boolector unknown ❌ 600.06400 600.03000
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.01500 599.48000
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.05500 599.88000
Yices2 Yices2-Main default unknown ❌ 600.01500 599.64000
Z3 z3-4.5.0 default unknown ❌ 600.10600 599.91000
SMT-COMP 2018 1.00 (0/5) Boolector Boolector_default unknown ❌ 1200.04000 1199.95000
CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.01000 1199.39000
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 1200.02000 1199.94000
Yices2 Yices 2.6.0_default unknown ❌ 1200.04000 1199.95000
Z3 z3-4.7.1_default unknown ❌ 1200.01000 1199.79000
SMT-COMP 2021 1.00 (0/3) MathSAT mathsat-5.6.6_default unknown ❌ 1200.06000 1199.81000
Yices2 Yices 2.6.2 bug fix_default unknown ❌ 1200.10000 1199.80000
Yices 2.6.2 for SMTCOMP2020_default unknown ❌ 1200.06000 1199.71000
Z3 z3-4.8.11_default unknown ❌ 1200.02000 1199.79000
SMT-COMP 2022 1.00 (0/5) Bitwuzla Bitwuzla-wrapped_default unknown ❌ 1200.08000 1199.91000
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.12000 1194.38000
MathSAT MathSAT-5.6.8_default unknown ❌ 1200.10000 1199.81000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.08000 1199.65000
Z3 z3-4.8.17_default unknown ❌ 1200.08000 1199.76000
SMT-COMP 2023 0.80 (1/5) Bitwuzla Bitwuzla-fixed_default unknown ❌ 1200.02000 1199.24000
cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.02000 1196.21000
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1257.72000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.03000 1199.84000
Z3-Owl z3-Owl-Final_default sat ✅ 13.11400 13.11150
z3-Owl-Final_default unknown ❌ 1200.02000 1199.79000