Benchmark

non-incremental/QF_ABV/platania/selection_sort/selection_sort16.c.smt2 

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Selection Sort algorithm for sorting
an array of N (the increasing parameter) elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size275428
Compressed Size17873
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 275420
Compressed Size17863
Max. Term Depth814
Asserts 799
Declared Functions0
Declared Constants806
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite780 not17 and2222 =>496
=798 let227 bvadd270 bvsub781
bvult2222 bvule526 select510 store46

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 Boolector Boolector unsat ✅ — —
CVC3 CVC3-1.5 unsat ✅ 3.10000 —
Z3 Z3 0.1 unsat ✅ 0.10000 —
Z3.2 unsat ✅ — —
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.02163 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.02637 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.02781 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 0.69505 —
CVC3-SMT-COMP-2011 default unsat ✅ 0.61454 —
CVC3-SMT-COMP-2012 default unsat ✅ 0.62300 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.12100 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.12620 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.08186 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.17049 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.13356 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.06417 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.07342 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.06973 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 0.04236 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.04791 —
Z3-SMT-COMP-2011 default unsat ✅ 0.05538 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 0.02763 0.02700
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.18444 0.18197
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.18491 0.18197
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.06614 0.06499
Yices2 Yices default unsat ✅ 1.76684 1.76573
Z3 z3 4.4.0 default unsat ✅ 0.06296 0.06299
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 0.02969 0.02969
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.18212 0.18226
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.05741 0.05833
Yices2 Yices-2.4.2 default unsat ✅ 1.10564 1.10623
Z3 z3-4.4.1 default unsat ✅ 0.06182 0.06305
SMT-COMP 2017 Boolector Boolector SMT17 final boolector unsat ✅ 0.03007 0.03004
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.18373 0.18319
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.05783 0.05862
Yices2 Yices2-Main default unsat ✅ 2.61286 2.61152
Z3 z3-4.5.0 default unsat ✅ 0.06537 0.06479
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 0.02683 0.02677
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.19916 0.19934
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.05591 0.05688
Yices2 Yices 2.6.0_default unsat ✅ 1.43246 1.43222
Z3 z3-4.7.1_default unsat ✅ 0.07131 0.07120
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.04182 0.04183
Poolector-wrapped-sq_default unsat ✅ 0.17574 0.25493
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.21292 0.21321
Par4 Par4-wrapped-sq_default unsat ✅ 0.04025 0.00576
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 1.72149 1.72120
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.07008 0.07006
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.03911 0.03904
Boolector Boolector-wrapped-sq_default unsat ✅ 0.04182 0.04181
CVC4 CVC4-sq-final_default unsat ✅ 0.28606 0.28639
MathSAT MathSAT5_default.sh unsat ✅ 0.06037 0.06032
Par4 Par4-wrapped-sq_default unsat ✅ 0.03642 0.00598
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 1.35817 1.35817
Z3 z3-4.8.8_default unsat ✅ 0.06714 0.06709
SMT-COMP 2022 Bitwuzla Bitwuzla-wrapped_default unsat ✅ 0.03941 0.03939
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.30699 0.30659
MathSAT MathSAT-5.6.8_default unsat ✅ 0.05826 0.05824
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 2.81153 2.81120
Z3 z3-4.8.17_default unsat ✅ 0.05101 0.05280
SMT-COMP 2023 0.20 (4/5) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.07794 0.07791
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.16652 0.16711
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.02000 1258.08000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 3.00138 3.00098
Z3-Owl z3-Owl-Final_default unsat ✅ 0.79215 0.79210
z3-Owl-Final_default unsat ✅ 0.85881 0.85900
SMT-COMP 2024 0.25 (3/4) Bitwuzla Bitwuzla unsat ✅ 0.24736 0.14760
cvc5 cvc5 unsat ✅ 0.30534 0.20549
SMTInterpol SMTInterpol unknown ❌ 1201.71981 1266.07952
Yices2 Yices2 unsat ✅ 9.16547 9.06212
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.30694 0.18474
cvc5 cvc5 unsat ✅ 0.33861 0.21875
SMTInterpol SMTInterpol unsat ✅ 7.58411 20.65365
Yices2 Yices2 unsat ✅ 1.35668 1.23510
Z3 Z3-Owl-base unsat ✅ 0.44345 0.31487
Z3-Owl Z3-Owl unsat ✅ 0.86784 0.74008