Benchmark

non-incremental/QF_ABV/platania/selection_sort/selection_sort14.c.smt2 

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Selection Sort algorithm for sorting
an array of N (the increasing parameter) elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size210362
Compressed Size14283
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 210354
Compressed Size14040
Max. Term Depth628
Asserts 615
Declared Functions0
Declared Constants622
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite598 not15 and1692 =>378
=614 let171 bvadd208 bvsub599
bvult1692 bvule404 select390 store40

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 Yices Yices 1.0.10 unsat ✅ 146.80000 —
Z3 Z3 0.1 unsat ✅ — —
Z3 0.1 (fixed BV) unsat ✅ — —
SMT-COMP 2008 Boolector Boolector unsat ✅ — —
CVC3 CVC3-1.5 unsat ✅ 2.20000 —
Z3 Z3 0.1 unsat ✅ — —
Z3.2 unsat ✅ — —
SMT-COMP 2010 Boolector Boolector 1.2 unsat ✅ — —
CVC3 CVC3 2.3 unsat ✅ 15.40000 —
SMT Evaluation 2013 0.14 (6/7) Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.01917 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.02100 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.01800 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 0.52780 —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unsat ✅ 0.46897 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.09499 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.09997 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌ — —
MathSAT5-SMT-COMP-2011 default unknown ❌ — —
MathSAT5-SMT-COMP-2012 default unknown ❌ — —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.04754 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.05753 —
SONOLAR-SMT-COMP-2012 default unsat ✅ — —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 0.03520 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌ — —
Z3-SMT-COMP-2011 default unsat ✅ 0.04414 —
SMT-COMP 2014 0.14 (6/7) Boolector Boolector boolectord unsat ✅ 0.04028 0.02899
Boolector boolectorj unsat ✅ 0.04043 0.02999
CVC4 CVC4 f7118b2 default unsat ✅ 0.14361 0.13298
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.02622 0.01700
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.04030 0.03100
MathSAT MathSAT-5.2.12-Main default unsat ✅ 0.06349 0.05399
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 0.05636 0.04499
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.53499 0.52592
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.04126 0.03199
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 0.02164 0.02100
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.14396 0.14198
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.14489 0.14198
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.05369 0.05299
Yices2 Yices default unsat ✅ 1.20452 1.20382
Z3 z3 4.4.0 default unsat ✅ 0.05524 0.05499
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 0.02441 0.02440
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.14185 0.14196
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.04623 0.04721
Yices2 Yices-2.4.2 default unsat ✅ 0.92085 0.92121
Z3 z3-4.4.1 default unsat ✅ 0.05337 0.05462
SMT-COMP 2017 Boolector Boolector SMT17 final boolector unsat ✅ 0.02464 0.02400
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.14424 0.14382
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.04779 0.04741
Yices2 Yices2-Main default unsat ✅ 0.77009 0.76892
Z3 z3-4.5.0 default unsat ✅ 0.05669 0.05547
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 0.02161 0.02154
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.15421 0.15426
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.04515 0.04611
Yices2 Yices 2.6.0_default unsat ✅ 1.01199 1.01177
Z3 z3-4.7.1_default unsat ✅ 0.05993 0.05983
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.03097 0.03089
Boolector Boolector-wrapped-sq_default unsat ✅ 0.03306 0.03305
CVC4 CVC4-sq-final_default unsat ✅ 0.22302 0.22336
MathSAT MathSAT5_default.sh unsat ✅ 0.04946 0.04943
Par4 Par4-wrapped-sq_default unsat ✅ 0.03206 0.00597
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 1.35463 1.35445
Z3 z3-4.8.8_default unsat ✅ 0.05867 0.05861
SMT-COMP 2021 MathSAT mathsat-5.6.6_default unsat ✅ 0.04868 0.04865
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.78104 0.77768
Yices 2.6.2 for SMTCOMP2020_default unsat ✅ 0.78631 1.47623
Z3 z3-4.8.11_default unsat ✅ 0.04525 0.04516
SMT-COMP 2022 Bitwuzla Bitwuzla-wrapped_default unsat ✅ 0.03146 0.03144
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.29360 0.29144
MathSAT MathSAT-5.6.8_default unsat ✅ 0.04682 0.04673
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.77467 0.77103
Z3 z3-4.8.17_default unsat ✅ 0.04334 0.04512
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.30386 0.18265
cvc5 cvc5 unsat ✅ 0.31097 0.19397
SMTInterpol SMTInterpol unsat ✅ 5.48924 15.98956
Yices2 Yices2 unsat ✅ 0.90703 0.78676
Z3 Z3-Owl-base unsat ✅ 0.38647 0.26100
Z3-Owl Z3-Owl unsat ✅ 0.85889 0.72952