Benchmark

non-incremental/QF_ABV/platania/selection_sort/selection_sort30.c.smt2 

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Selection Sort algorithm for sorting
an array of N (the increasing parameter) elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size976325
Compressed Size53524
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 976317
Compressed Size53531
Max. Term Depth2788
Asserts 2759
Declared Functions0
Declared Constants2766
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite2726 not31 and7948 =>1770
=2758 let843 bvadd928 bvsub2727
bvult7948 bvule1828 select1798 store88

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 0.50 (1/2) Yices Yices 1.0.10 unknown ❌ 1801.00000 —
Z3 Z3 0.1 unsat ✅ 0.20000 —
Z3 0.1 (fixed BV) unsat ✅ 0.20000 —
SMT-COMP 2008 Boolector Boolector unsat ✅ 0.10000 —
CVC3 CVC3-1.5 unsat ✅ 16.60000 —
Z3 Z3 0.1 unsat ✅ 0.20000 —
Z3.2 unsat ✅ 0.30000 —
SMT-COMP 2010 0.50 (1/2) Boolector Boolector 1.2 unsat ✅ 0.10000 —
CVC3 CVC3 2.3 unknown ❌ 109.10000 —
SMT-COMP 2011 0.40 (3/5) Boolector Boolector 1.5.23-833 unsat ✅ 0.10000 —
CVC3 CVC3 v2.4 unsat ✅ 2.70000 —
MathSAT MathSAT5 unknown ❌ 1200.00000 —
SONOLAR SONOLAR unsat ✅ 0.30000 —
Z3 Z3 unknown ❌ 1200.00000 —
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.06885 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.08446 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.07937 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 2.47374 —
CVC3-SMT-COMP-2011 default unsat ✅ 2.22418 —
CVC3-SMT-COMP-2012 default unsat ✅ 2.22997 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.49937 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.47654 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.31372 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.90715 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.77742 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.22043 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.25321 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.23239 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 0.11788 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.15094 —
Z3-SMT-COMP-2011 default unsat ✅ 0.15284 —
SMT-COMP 2014 0.14 (6/7) Boolector Boolector boolectord unsat ✅ 0.16755 0.15698
Boolector boolectorj unsat ✅ 0.17087 0.15698
CVC4 CVC4 f7118b2 default unsat ✅ 0.67153 0.65390
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.03551 0.01900
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.04757 0.03299
MathSAT MathSAT-5.2.12-Main default unsat ✅ 0.29497 0.28196
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 0.22897 0.21597
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 153.75200 153.73600
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.13390 0.13298
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 0.09148 0.08998
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.69397 0.69189
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.68846 0.68590
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.25316 0.25196
Yices2 Yices default unsat ✅ 466.77300 466.78600
Z3 z3 4.4.0 default unsat ✅ 0.14929 0.14898
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 0.10126 0.10129
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.67356 0.67417
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.22750 0.22856
Yices2 Yices-2.4.2 default unsat ✅ 40.11640 40.13950
Z3 z3-4.4.1 default unsat ✅ 0.14037 0.14177
SMT-COMP 2017 Boolector Boolector SMT17 final boolector unsat ✅ 0.09913 0.09844
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.71736 0.71672
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.22707 0.22728
Yices2 Yices2-Main default unsat ✅ 75.36640 75.36010
Z3 z3-4.5.0 default unsat ✅ 0.14994 0.14913
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 0.09068 0.09057
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.78351 0.78367
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.22392 0.22472
Yices2 Yices 2.6.0_default unsat ✅ 65.31420 65.31630
Z3 z3-4.7.1_default unsat ✅ 0.16129 0.16122
SMT-COMP 2023 0.20 (4/5) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.29896 0.29778
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.57787 0.57294
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1267.95000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 675.41900 675.21500
Z3-Owl z3-Owl-Final_default unsat ✅ 1.05201 1.05181
z3-Owl-Final_default unsat ✅ 1.03944 1.03973
SMT-COMP 2024 0.25 (3/4) Bitwuzla Bitwuzla unsat ✅ 0.36492 0.26463
cvc5 cvc5 unsat ✅ 0.58786 0.48806
SMTInterpol SMTInterpol unknown ❌ 1201.71758 1258.77822
Yices2 Yices2 unsat ✅ 544.32659 543.93926