Benchmark

non-incremental/QF_ABV/platania/selection_sort/selection_sort18.c.smt2 

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Selection Sort algorithm for sorting
an array of N (the increasing parameter) elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size349146
Compressed Size21708
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 349138
Compressed Size21717
Max. Term Depth1024
Asserts 1007
Declared Functions0
Declared Constants1014
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite986 not19 and2824 =>630
=1006 let291 bvadd340 bvsub987
bvult2824 bvule664 select646 store52

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 Boolector Boolector unsat ✅ — —
CVC3 CVC3-1.5 unsat ✅ 4.10000 —
Z3 Z3 0.1 unsat ✅ 0.10000 —
Z3.2 unsat ✅ 0.10000 —
SMT-COMP 2011 Boolector Boolector 1.5.23-833 unsat ✅ — —
CVC3 CVC3 v2.4 unsat ✅ 1.00000 —
MathSAT MathSAT5 unsat ✅ 111.10000 —
SONOLAR SONOLAR unsat ✅ 0.10000 —
Z3 Z3 unsat ✅ 291.90000 —
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.02651 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.03259 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.03231 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 0.87844 —
CVC3-SMT-COMP-2011 default unsat ✅ 0.77427 —
CVC3-SMT-COMP-2012 default unsat ✅ 0.78251 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.16415 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.16071 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.10094 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.22815 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.18540 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.08352 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.09295 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.08586 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 0.05050 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.05857 —
Z3-SMT-COMP-2011 default unsat ✅ 0.06418 —
SMT-COMP 2014 0.14 (6/7) Boolector Boolector boolectord unsat ✅ 0.05849 0.04899
Boolector boolectorj unsat ✅ 0.05975 0.04899
CVC4 CVC4 f7118b2 default unsat ✅ 0.22671 0.21797
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.02589 0.01700
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.04137 0.03199
MathSAT MathSAT-5.2.12-Main default unsat ✅ 0.08708 0.08599
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 0.08579 0.07499
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 3.79035 3.77643
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.05238 0.05099
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 0.03409 0.03299
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.23240 0.22997
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.23286 0.22997
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.08087 0.07999
Yices2 Yices default unsat ✅ 5.97818 5.97809
Z3 z3 4.4.0 default unsat ✅ 0.07155 0.07099
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 0.03757 0.03756
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.22866 0.22915
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.07111 0.07209
Yices2 Yices-2.4.2 default unsat ✅ 3.25105 3.25318
Z3 z3-4.4.1 default unsat ✅ 0.06930 0.07053
SMT-COMP 2017 Boolector Boolector SMT17 final boolector unsat ✅ 0.03708 0.03639
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.23213 0.23230
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.07095 0.07183
Yices2 Yices2-Main default unsat ✅ 6.13582 6.13500
Z3 z3-4.5.0 default unsat ✅ 0.07266 0.07215
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 0.03329 0.03325
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.25208 0.25224
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.07015 0.07107
Yices2 Yices 2.6.0_default unsat ✅ 2.34053 2.34010
Z3 z3-4.7.1_default unsat ✅ 0.07855 0.07847
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.05014 0.05015
Poolector-wrapped-sq_default unsat ✅ 0.17537 0.28981
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.26669 0.26701
Par4 Par4-wrapped-sq_default unsat ✅ 0.04152 0.00595
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 5.66594 5.66590
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.07848 0.07848
SMT-COMP 2022 Bitwuzla Bitwuzla-wrapped_default unsat ✅ 0.04850 0.04849
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.37756 0.37805
MathSAT MathSAT-5.6.8_default unsat ✅ 0.07274 0.07272
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 2.58276 2.58143
Z3 z3-4.8.17_default unsat ✅ 0.06197 0.06376
SMT-COMP 2023 0.20 (4/5) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.09917 0.09910
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.20242 0.20300
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.12000 1255.31000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 6.58115 6.58052
Z3-Owl z3-Owl-Final_default unsat ✅ 0.81788 0.81788
z3-Owl-Final_default unsat ✅ 0.81577 0.81597
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.28689 0.16844
cvc5 cvc5 unsat ✅ 0.39762 0.26659
SMTInterpol SMTInterpol unsat ✅ 9.85467 23.57420
Yices2 Yices2 unsat ✅ 1.96211 1.84354
Z3 Z3-Owl-base unsat ✅ 0.44751 0.32428
Z3-Owl Z3-Owl unsat ✅ 0.87883 0.75141