Benchmark

non-incremental/QF_ABV/platania/bubble_sort/bubble_sort22.c.smt2 

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Bubble Sort algorithm for sorting an
array of N (the increasing parameter) elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size1078303
Compressed Size68802
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1078295
Compressed Size68812
Max. Term Depth3639
Asserts 2293
Declared Functions0
Declared Constants2299
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite2268 not23 and8047 =>1786
=2314 let2228 bvadd2226 bvsub6721
bvult7625 bvule904 select3550 store904

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 Boolector Boolector unsat ✅ 0.10000 —
CVC3 CVC3-1.5 unsat ✅ 16.20000 —
Z3 Z3 0.1 unsat ✅ 0.20000 —
Z3.2 unsat ✅ 0.30000 —
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.08190 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.10773 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.08848 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 3.21199 —
CVC3-SMT-COMP-2011 default unsat ✅ 2.82516 —
CVC3-SMT-COMP-2012 default unsat ✅ 2.85331 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.61982 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.51166 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.34039 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.70064 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.62029 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.26929 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.29655 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.28654 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 0.13619 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.16259 —
Z3-SMT-COMP-2011 default unsat ✅ 0.16002 —
SMT-COMP 2014 0.14 (6/7) Boolector Boolector boolectord unsat ✅ 0.28195 0.27996
Boolector boolectorj unsat ✅ 0.28197 0.27996
CVC4 CVC4 f7118b2 default unsat ✅ 0.73545 0.72489
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.01740 0.01600
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.04222 0.03299
MathSAT MathSAT-5.2.12-Main default unsat ✅ 0.31685 0.30795
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 0.28222 0.27096
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.08111 0.07199
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.15393 0.14598
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 0.13783 0.13698
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.76564 0.76388
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.75866 0.75588
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.26464 0.26396
Yices2 Yices default unsat ✅ 0.07284 0.07199
Z3 z3 4.4.0 default unsat ✅ 0.16473 0.16497
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 0.12476 0.12472
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.76642 0.76699
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.25372 0.25516
Yices2 Yices-2.4.2 default unsat ✅ 0.07452 0.07447
Z3 z3-4.4.1 default unsat ✅ 0.15517 0.15655
SMT-COMP 2017 Boolector Boolector SMT17 final boolector unsat ✅ 0.11111 0.10969
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.79313 0.79326
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.24443 0.24535
Yices2 Yices2-Main default unsat ✅ 0.07170 0.07019
Z3 z3-4.5.0 default unsat ✅ 0.16313 0.16228
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 0.10063 0.10057
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.90932 0.90507
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.24088 0.24192
Yices2 Yices 2.6.0_default unsat ✅ 0.07112 0.07106
Z3 z3-4.7.1_default unsat ✅ 0.17466 0.17455
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.15502 0.15503
Poolector-wrapped-sq_default unsat ✅ 0.27567 0.76723
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.92363 0.92394
Par4 Par4-wrapped-sq_default unsat ✅ 0.07517 0.00587
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.07344 0.07342
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.16936 0.16935
SMT-COMP 2024 0.25 (3/4) Bitwuzla Bitwuzla unsat ✅ 0.34733 0.24762
cvc5 cvc5 unsat ✅ 0.66993 0.57035
SMTInterpol SMTInterpol unknown ❌ 1201.71739 1232.25412
Yices2 Yices2 unsat ✅ 0.26942 0.16997