Benchmark

non-incremental/QF_ABV/platania/selection_sort/selection_sort26.c.smt2 

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Selection Sort algorithm for sorting
an array of N (the increasing parameter) elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size732005
Compressed Size43794
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 731997
Compressed Size43801
Max. Term Depth2104
Asserts 2079
Declared Functions0
Declared Constants2086
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite2050 not27 and5952 =>1326
=2078 let627 bvadd700 bvsub2051
bvult5952 bvule1376 select1350 store76

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 0.50 (1/2) Yices Yices 1.0.10 unknown ❌ 1800.80000 —
Z3 Z3 0.1 unsat ✅ 0.20000 —
Z3 0.1 (fixed BV) unsat ✅ 0.20000 —
SMT-COMP 2008 Boolector Boolector unsat ✅ 0.10000 —
CVC3 CVC3-1.5 unsat ✅ 11.50000 —
Z3 Z3 0.1 unsat ✅ 0.20000 —
Z3.2 unsat ✅ 0.20000 —
SMT Evaluation 2013 0.29 (5/7) Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.05315 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.06778 —
Boolector-SMT-COMP-2012 default unknown ❌ — —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unknown ❌ — —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.22082 —
MathSAT5-SMT-COMP-2011 default unknown ❌ — —
MathSAT5-SMT-COMP-2012 default unknown ❌ — —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌ — —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.17241 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 0.08861 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.11763 —
Z3-SMT-COMP-2011 default unknown ❌ — —
SMT-COMP 2014 0.14 (6/7) Boolector Boolector boolectord unsat ✅ 0.12086 0.10998
Boolector boolectorj unsat ✅ 0.12102 0.11198
CVC4 CVC4 f7118b2 default unsat ✅ 0.48805 0.47893
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.02653 0.01700
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.04542 0.03599
MathSAT MathSAT-5.2.12-Main default unsat ✅ 0.20485 0.19597
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 0.17213 0.15997
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 249.07500 249.12300
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.11056 0.10298
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 0.06978 0.06899
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.50630 0.50392
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.50762 0.50492
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.17589 0.17497
Yices2 Yices default unsat ✅ 186.83600 186.84800
Z3 z3 4.4.0 default unsat ✅ 0.12040 0.11998
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 0.07614 0.07616
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.49749 0.49788
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.15703 0.15802
Yices2 Yices-2.4.2 default unsat ✅ 60.23280 60.27240
Z3 z3-4.4.1 default unsat ✅ 0.11389 0.11520
SMT-COMP 2017 Boolector Boolector SMT17 final boolector unsat ✅ 0.07487 0.07370
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.52273 0.52228
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.15928 0.15868
Yices2 Yices2-Main default unsat ✅ 59.69410 59.69300
Z3 z3-4.5.0 default unsat ✅ 0.12212 0.12200
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 0.06794 0.06789
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.56641 0.56656
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.15606 0.15700
Yices2 Yices 2.6.0_default unsat ✅ 258.05600 258.02300
Z3 z3-4.7.1_default unsat ✅ 0.12752 0.12740
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.09905 0.09901
Poolector-wrapped-sq_default unsat ✅ 0.29067 0.51740
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.59876 0.59901
Par4 Par4-wrapped-sq_default unsat ✅ 0.07936 0.00497
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 32.07740 32.07710
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.12744 0.12744
SMT-COMP 2023 0.20 (4/5) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.20229 0.20223
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.44042 0.44103
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1254.95000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 276.99800 276.99500
Z3-Owl z3-Owl-Final_default unsat ✅ 0.96278 0.96272
z3-Owl-Final_default unsat ✅ 0.95676 0.95695