Benchmark

non-incremental/QF_ABV/platania/no_init_bubble_sort/no_init_bubble_sort_safe7.c.smt2 

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Bubble Sort algorithm for sorting an
array of N (the increasing parameter) elements. Differently from the
bubble_sort benchmarks, here arrays are not instantiated, that results in
arrays with unconstrained elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size99177
Compressed Size7692
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 99169
Compressed Size7770
Max. Term Depth327
Asserts 201
Declared Functions0
Declared Constants207
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite198 not13 and679 =>161
=200 let198 bvadd186 bvsub571
bvult650 bvule85 select295 store72

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 0.50 (1/2) Yices Yices 1.0.10 unknown ❌ 1800.90000 —
Z3 Z3 0.1 unsat ✅ 4.60000 —
Z3 0.1 (fixed BV) unsat ✅ 4.60000 —
SMT-COMP 2008 0.33 (2/3) Boolector Boolector unsat ✅ 37.20000 —
CVC3 CVC3-1.5 unknown ❌ 1800.80000 —
Z3 Z3 0.1 unsat ✅ 4.60000 —
Z3.2 unknown ❌ 1801.00000 —
SMT-COMP 2009 0.25 (3/4) Boolector Boolector unsat ✅ 33.90000 —
Boolector 1.2 unsat ✅ 274.10000 —
CVC3 CVC3 2.0 unknown ❌ 900.00000 —
MathSAT MathSAT 4.3 unsat ✅ 177.30000 —
Yices2 Yices 2 proto unsat ✅ 827.60000 —
SMT-COMP 2010 0.50 (1/2) Boolector Boolector 1.2 unsat ✅ 278.30000 —
CVC3 CVC3 2.3 unknown ❌ 817.80000 —
SMT-COMP 2012 0.25 (3/4) Boolector Boolector unsat ✅ 61.70000 —
Boolector 1.5.23-833 unsat ✅ 75.20000 —
CVC3 CVC3 v2.4.2 unknown ❌ — —
CVC4 1.0rc.3931 unknown ❌ 1200.00000 —
CVC4 1.0rc.3970 unknown ❌ 1200.00000 —
SONOLAR SONOLAR unsat ✅ 40.80000 —
Tiffany de Wintermonte Tiffany de Wintermonte & Sonolar unsat ✅ 2.10000 —
SMT-COMP 2011 0.80 (1/5) Boolector Boolector 1.5.23-833 unsat ✅ 75.10000 —
CVC3 CVC3 v2.4 unknown ❌ 1200.20000 —
MathSAT MathSAT5 unknown ❌ 1200.00000 —
SONOLAR SONOLAR unknown ❌ 1200.00000 —
Z3 Z3 unknown ❌ 1200.00000 —
SMT Evaluation 2013 0.29 (5/7) Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 39.13720 —
Boolector-SMT-COMP-2011 default unsat ✅ 52.99910 —
Boolector-SMT-COMP-2012 default unsat ✅ 33.39520 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unsat ✅ 3.13751 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 10.29720 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.77781 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.77149 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 19.20690 —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unsat ✅ 19.86680 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 1.03650 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌ — —
Z3-SMT-COMP-2011 default unknown ❌ — —
SMT-COMP 2014 0.29 (5/7) Boolector Boolector boolectord unsat ✅ 2.56167 2.55161
Boolector boolectorj unsat ✅ 2.56523 2.55561
CVC4 CVC4 f7118b2 default unsat ✅ 16.81840 16.81140
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.02440 0.01500
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.03917 0.02899
MathSAT MathSAT-5.2.12-Main default unsat ✅ 10.00880 10.00450
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 15.39320 15.38570
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 45.81960 45.82500
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.12000 2400.04000
SMT-COMP 2015 0.20 (4/5) Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 14.74020 14.74480
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 5.89644 5.89610
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 14.87000 14.87070
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 10.00000 10.00050
Yices2 Yices default unsat ✅ 55.87440 55.89650
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.50000
SMT-COMP 2016 0.20 (4/5) Boolector Boolector boolector unsat ✅ 27.64470 27.66040
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 14.53550 14.54400
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 10.13100 10.13770
Yices2 Yices-2.4.2 default unsat ✅ 58.71170 58.74110
Z3 z3-4.4.1 default unknown ❌ 2400.01000 2401.59000
SMT-COMP 2017 0.40 (3/5) Boolector Boolector SMT17 final boolector unsat ✅ 32.08740 32.08090
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.01600 599.80700
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 10.12190 10.12190
Yices2 Yices2-Main default unsat ✅ 56.51560 56.50850
Z3 z3-4.5.0 default unknown ❌ 600.01900 599.93300
SMT-COMP 2018 0.40 (3/5) Boolector Boolector_default unsat ✅ 30.52690 30.52590
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 131.39800 131.38600
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 10.15660 10.15670
Yices2 Yices 2.6.0_default unsat ✅ 46.93740 46.93860
Z3 z3-4.7.1_default unknown ❌ 1200.10000 1200.06000
SMT-COMP 2021 MathSAT mathsat-5.6.6_default unsat ✅ 13.01600 13.01540
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 55.91580 55.90970
Yices 2.6.2 for SMTCOMP2020_default unsat ✅ 56.37770 56.37760
Z3 z3-4.8.11_default unsat ✅ 7.32024 7.31472