Benchmark

non-incremental/QF_ABV/platania/selection_sort/selection_sort17.c.smt2 

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Selection Sort algorithm for sorting
an array of N (the increasing parameter) elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size311201
Compressed Size20243
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 311193
Compressed Size20253
Max. Term Depth916
Asserts 900
Declared Functions0
Declared Constants907
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite880 not18 and2514 =>561
=899 let258 bvadd304 bvsub881
bvult2514 bvule593 select576 store49

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 Boolector Boolector unsat ✅ — —
CVC3 CVC3-1.5 unsat ✅ 3.60000 —
Z3 Z3 0.1 unsat ✅ 0.10000 —
Z3.2 unsat ✅ 0.10000 —
SMT-COMP 2010 Boolector Boolector 1.2 unsat ✅ — —
CVC3 CVC3 2.3 unsat ✅ 30.90000 —
SMT-COMP 2011 Boolector Boolector 1.5.23-833 unsat ✅ — —
CVC3 CVC3 v2.4 unsat ✅ 0.90000 —
MathSAT MathSAT5 unsat ✅ 52.90000 —
SONOLAR SONOLAR unsat ✅ 0.10000 —
Z3 Z3 unsat ✅ 166.80000 —
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.02441 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.02963 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.02560 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 0.78108 —
CVC3-SMT-COMP-2011 default unsat ✅ 0.68988 —
CVC3-SMT-COMP-2012 default unsat ✅ 0.70245 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.13943 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.14164 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.09090 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.19958 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.15756 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.07424 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.08259 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.07711 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 0.04212 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.05270 —
Z3-SMT-COMP-2011 default unsat ✅ 0.05883 —
SMT-COMP 2014 0.14 (6/7) Boolector Boolector boolectord unsat ✅ 0.05686 0.04399
Boolector boolectorj unsat ✅ 0.06092 0.04399
CVC4 CVC4 f7118b2 default unsat ✅ 0.20342 0.19297
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.02556 0.01700
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.03566 0.03399
MathSAT MathSAT-5.2.12-Main default unsat ✅ 0.08544 0.07699
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 0.07937 0.06799
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 1.78363 1.77573
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.05403 0.04599
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 0.03154 0.03099
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.20726 0.20497
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.20936 0.20697
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.07251 0.07199
Yices2 Yices default unsat ✅ 2.76263 2.76258
Z3 z3 4.4.0 default unsat ✅ 0.06759 0.06799
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 0.03420 0.03417
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.20572 0.20628
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.06481 0.06578
Yices2 Yices-2.4.2 default unsat ✅ 2.73901 2.74044
Z3 z3-4.4.1 default unsat ✅ 0.06348 0.06467
SMT-COMP 2017 Boolector Boolector SMT17 final boolector unsat ✅ 0.03249 0.03253
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.20575 0.20480
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.06518 0.06423
Yices2 Yices2-Main default unsat ✅ 3.09475 3.09449
Z3 z3-4.5.0 default unsat ✅ 0.06987 0.06923
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 0.03030 0.03022
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.22143 0.22169
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.06325 0.06427
Yices2 Yices 2.6.0_default unsat ✅ 2.98311 2.98217
Z3 z3-4.7.1_default unsat ✅ 0.07564 0.07556
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.04595 0.04596
Poolector-wrapped-sq_default unsat ✅ 0.17639 0.27582
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.23208 0.23229
Par4 Par4-wrapped-sq_default unsat ✅ 0.03887 0.00598
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 5.57190 5.57141
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.07173 0.07171