Benchmark

non-incremental/QF_ABV/platania/no_init_bubble_sort/no_init_bubble_sort_safe12.c.smt2 

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Bubble Sort algorithm for sorting an
array of N (the increasing parameter) elements. Differently from the
bubble_sort benchmarks, here arrays are not instantiated, that results in
arrays with unconstrained elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size325506
Compressed Size20396
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 325498
Compressed Size20398
Max. Term Depth1037
Asserts 641
Declared Functions0
Declared Constants647
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite638 not23 and2234 =>516
=640 let638 bvadd616 bvsub1871
bvult2125 bvule265 select980 store242

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 1.00 (0/2) Yices Yices 1.0.10 unknown ❌ 1800.70000 —
Z3 Z3 0.1 unknown ❌ 1801.00000 —
Z3 0.1 (fixed BV) unknown ❌ 1800.70000 —
SMT-COMP 2008 1.00 (0/3) Boolector Boolector unknown ❌ 1800.80000 —
CVC3 CVC3-1.5 unknown ❌ 1801.00000 —
Z3 Z3 0.1 unknown ❌ 1800.80000 —
Z3.2 unknown ❌ 1801.00000 —
SMT-COMP 2009 1.00 (0/4) Boolector Boolector unknown ❌ 900.00000 —
Boolector 1.2 unknown ❌ 900.00000 —
CVC3 CVC3 2.0 unknown ❌ 900.00000 —
MathSAT MathSAT 4.3 unknown ❌ 900.00000 —
Yices2 Yices 2 proto unknown ❌ 900.00000 —
SMT-COMP 2010 1.00 (0/2) Boolector Boolector 1.2 unknown ❌ 1200.00000 —
CVC3 CVC3 2.3 unknown ❌ 398.00000 —
SMT-COMP 2011 1.00 (0/5) Boolector Boolector 1.5.23-833 unknown ❌ 1200.00000 —
CVC3 CVC3 v2.4 unknown ❌ 1200.10000 —
MathSAT MathSAT5 unknown ❌ 1200.00000 —
SONOLAR SONOLAR unknown ❌ 1200.00000 —
Z3 Z3 unknown ❌ 1200.00000 —
SMT Evaluation 2013 0.71 (2/7) Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌ — —
Boolector-SMT-COMP-2011 default unknown ❌ — —
Boolector-SMT-COMP-2012 default unknown ❌ — —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unknown ❌ — —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 515.59700 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 28.03910 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 21.57630 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌ — —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unknown ❌ — —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 14.82420 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌ — —
Z3-SMT-COMP-2011 default unknown ❌ — —
SMT-COMP 2014 0.71 (2/7) Boolector Boolector boolectord unsat ✅ 100.24200 100.24800
Boolector boolectorj unsat ✅ 102.12500 102.14000
CVC4 CVC4 f7118b2 default unknown ❌ 2399.12000 2400.02000
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.02388 0.01500
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.04027 0.03200
MathSAT MathSAT-5.2.12-Main default unsat ✅ 528.10800 528.25000
SONOLAR sonolar_smtcomp-2014 default unknown ❌ 2399.12000 2400.05000
Yices2 Yices-2.2.1-smtcomp2014 default unknown ❌ 2399.12000 2400.02000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.12000 2400.00000
SMT-COMP 2015 0.60 (2/5) Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 59.27180 59.29400
CVC4 CVC4-master-2015-06-15-9b32405-main default unknown ❌ 2400.01000 2400.72000
CVC4-experimental-2015-06-15-ff5745a-main default unknown ❌ 2400.01000 2400.90000
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 518.21400 518.31600
Yices2 Yices default unknown ❌ 2400.01000 2400.98000
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.63000
SMT-COMP 2016 0.80 (1/5) Boolector Boolector boolector unknown ❌ 2400.02000 2401.34000
CVC4 CVC4-master-2016-05-27-cfef263-main default unknown ❌ 2400.01000 2401.33000
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 555.94000 556.24900
Yices2 Yices-2.4.2 default unknown ❌ 2400.02000 2401.18000
Z3 z3-4.4.1 default unknown ❌ 2400.02000 2401.29000
SMT-COMP 2017 0.80 (1/5) Boolector Boolector SMT17 final boolector unknown ❌ 600.02700 599.97500
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.02700 599.96300
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 578.84500 578.68900
Yices2 Yices2-Main default unknown ❌ 600.01700 599.95000
Z3 z3-4.5.0 default unknown ❌ 600.01300 599.88000
SMT-COMP 2018 1.00 (0/5) Boolector Boolector_default unknown ❌ 1200.01000 1199.96000
CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.02000 1199.87000
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 625.59000 625.56900
Yices2 Yices 2.6.0_default unknown ❌ 1200.01000 1199.87000
Z3 z3-4.7.1_default unknown ❌ 1200.03000 1199.92000
SMT-COMP 2019 1.00 (0/5) Boolector Boolector-wrapped-sq_default unknown ❌ 2400.08000 2399.88000
Poolector-wrapped-sq_default unknown ❌ 2400.08000 9512.13000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unknown ❌ 2400.10000 2399.57000
Par4 Par4-wrapped-sq_default unknown ❌ 2400.13000 7200.02000
Yices2 Yices 2.6.2-wrapped-sq_default unknown ❌ 2400.06000 2399.96000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.02000 2399.53000
SMT-COMP 2020 1.00 (0/7) Bitwuzla Bitwuzla-fixed_default unknown ❌ 1200.01000 1200.01000
Boolector Boolector-wrapped-sq_default unknown ❌ 1200.05000 1199.97000
CVC4 CVC4-sq-final_default unknown ❌ 1200.03000 1198.38000
MathSAT MathSAT5_default.sh unknown ❌ 1200.03000 1199.36000
Par4 Par4-wrapped-sq_default unknown ❌ 1200.07000 3599.38000
Yices2 Yices 2.6.2 bug fix_default unknown ❌ 1200.02000 1199.99000
Z3 z3-4.8.8_default unknown ❌ 1200.02000 1199.47000
SMT-COMP 2021 1.00 (0/3) MathSAT mathsat-5.6.6_default unknown ❌ 1200.01000 1199.44000
Yices2 Yices 2.6.2 bug fix_default unknown ❌ 1200.06000 1199.96000
Yices 2.6.2 for SMTCOMP2020_default unknown ❌ 1200.13000 1200.03000
Z3 z3-4.8.11_default unknown ❌ 1200.02000 1199.91000
SMT-COMP 2025 1.00 (0/6) Bitwuzla Bitwuzla unknown ❌ 1201.31938 1201.01053
cvc5 cvc5 unknown ❌ 1201.77693 1201.31820
SMTInterpol SMTInterpol unknown ❌ 1201.77150 1244.90765
Yices2 Yices2 unknown ❌ 1201.26529 1200.98339
Z3 Z3-Owl-base unknown ❌ 1201.33609 1201.03651
Z3-Owl Z3-Owl unknown ❌ 1201.76048 1201.01053