Benchmark

non-incremental/QF_ABV/platania/selection_sort/selection_sort10.c.smt2 

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Selection Sort algorithm for sorting
an array of N (the increasing parameter) elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size106465
Compressed Size7541
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 106457
Compressed Size7552
Max. Term Depth328
Asserts 319
Declared Functions0
Declared Constants326
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite306 not11 and848 =>190
=318 let83 bvadd108 bvsub307
bvult848 bvule208 select198 store28

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 Yices Yices 1.0.10 unsat ✅ 12.40000 —
Z3 Z3 0.1 unsat ✅ — —
Z3 0.1 (fixed BV) unsat ✅ — —
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.01517 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.01245 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.01045 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 0.28367 —
CVC3-SMT-COMP-2011 default unsat ✅ 0.24468 —
CVC3-SMT-COMP-2012 default unsat ✅ 0.24252 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.05769 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.05799 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.03918 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.06511 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.04751 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.02571 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.03118 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.03020 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 0.01863 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.02222 —
Z3-SMT-COMP-2011 default unsat ✅ 0.03061 —
SMT-COMP 2014 0.14 (6/7) Boolector Boolector boolectord unsat ✅ 0.02889 0.01600
Boolector boolectorj unsat ✅ 0.02684 0.01600
CVC4 CVC4 f7118b2 default unsat ✅ 0.08361 0.07099
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.02507 0.01600
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.03238 0.03100
MathSAT MathSAT-5.2.12-Main default unsat ✅ 0.04043 0.03199
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 0.03976 0.02300
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.46595 0.45793
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.02804 0.01900
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 0.01240 0.01100
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.07755 0.07499
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.07801 0.07499
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.03680 0.03599
Yices2 Yices default unsat ✅ 0.23047 0.22996
Z3 z3 4.4.0 default unsat ✅ 0.04206 0.04099
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 0.01420 0.01418
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.07889 0.07766
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.03011 0.03107
Yices2 Yices-2.4.2 default unsat ✅ 0.59313 0.59344
Z3 z3-4.4.1 default unsat ✅ 0.04777 0.04241
SMT-COMP 2017 Boolector Boolector SMT17 final boolector unsat ✅ 0.01447 0.01291
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.07995 0.07876
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.03124 0.03010
Yices2 Yices2-Main default unsat ✅ 0.59257 0.59249
Z3 z3-4.5.0 default unsat ✅ 0.04538 0.04346
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 0.01239 0.01230
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.08432 0.08454
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.02971 0.03072
Yices2 Yices 2.6.0_default unsat ✅ 0.57281 0.57264
Z3 z3-4.7.1_default unsat ✅ 0.04714 0.04707
SMT-COMP 2022 Bitwuzla Bitwuzla-wrapped_default unsat ✅ 0.01833 0.01830
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.12604 0.12636
MathSAT MathSAT-5.6.8_default unsat ✅ 0.03069 0.03064
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.14141 0.14138
Z3 z3-4.8.17_default unsat ✅ 0.02987 0.03161
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.22691 0.12672
cvc5 cvc5 unsat ✅ 0.24840 0.14863
SMTInterpol SMTInterpol unsat ✅ 152.44046 185.48605
Yices2 Yices2 unsat ✅ 0.64496 0.54482