Benchmark

non-incremental/QF_ABV/platania/no_init_selection_sort/no_init_selection_sort_safe7.c.smt2 

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Selection Sort algorithm for sorting
an array of N (the increasing parameter) unknown elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size50660
Compressed Size4341
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 50652
Compressed Size4377
Max. Term Depth163
Asserts 153
Declared Functions0
Declared Constants160
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite150 not8 and396 =>91
=152 let38 bvadd54 bvsub151
bvult403 bvule102 select96 store12

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 0.50 (1/2) Yices Yices 1.0.10 unknown ❌ 1800.90000 —
Z3 Z3 0.1 unsat ✅ 983.40000 —
Z3 0.1 (fixed BV) unsat ✅ 986.70000 —
SMT-COMP 2008 0.33 (2/3) Boolector Boolector unsat ✅ 557.00000 —
CVC3 CVC3-1.5 unknown ❌ 1800.80000 —
Z3 Z3 0.1 unsat ✅ 999.80000 —
Z3.2 unknown ❌ 1801.00000 —
SMT-COMP 2009 0.25 (3/4) Boolector Boolector unsat ✅ 333.50000 —
Boolector 1.2 unknown ❌ 900.00000 —
CVC3 CVC3 2.0 unknown ❌ 900.00000 —
MathSAT MathSAT 4.3 unsat ✅ 143.40000 —
Yices2 Yices 2 proto unsat ✅ 545.00000 —
SMT-COMP 2010 1.00 (0/2) Boolector Boolector 1.2 unknown ❌ 1200.00000 —
CVC3 CVC3 2.3 unknown ❌ 1200.10000 —
SMT-COMP 2012 0.25 (3/4) Boolector Boolector unsat ✅ 128.90000 —
Boolector 1.5.23-833 unsat ✅ 361.20000 —
CVC3 CVC3 v2.4.2 unsat ✅ 303.30000 —
CVC4 1.0rc.3931 unknown ❌ 1200.00000 —
CVC4 1.0rc.3970 unknown ❌ 1200.00000 —
SONOLAR SONOLAR unsat ✅ 71.50000 —
Tiffany de Wintermonte Tiffany de Wintermonte & Sonolar unknown ❌ 1200.00000 —
SMT-COMP 2011 Boolector Boolector 1.5.23-833 unsat ✅ 326.70000 —
CVC3 CVC3 v2.4 unsat ✅ 439.40000 —
MathSAT MathSAT5 unsat ✅ 25.00000 —
SONOLAR SONOLAR unsat ✅ 94.50000 —
Z3 Z3 unsat ✅ 587.90000 —
SMT Evaluation 2013 0.14 (6/7) Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 72.69880 —
Boolector-SMT-COMP-2011 default unsat ✅ 240.67700 —
Boolector-SMT-COMP-2012 default unsat ✅ 92.66480 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unsat ✅ 7.61267 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 56.83960 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 21.83140 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 20.93050 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 29.94160 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 34.18780 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 31.05050 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 731.04500 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 1232.29000 —
Z3-SMT-COMP-2011 default unsat ✅ 86.34830 —
SMT-COMP 2014 0.14 (6/7) Boolector Boolector boolectord unsat ✅ 43.84080 43.84230
Boolector boolectorj unsat ✅ 35.06280 35.07370
CVC4 CVC4 f7118b2 default unsat ✅ 13.61270 13.61490
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.02953 0.01700
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.03931 0.03000
MathSAT MathSAT-5.2.12-Main default unsat ✅ 57.71290 57.72620
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 25.11890 25.12620
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 142.19900 142.24300
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 1493.99000 1494.59000
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 35.83470 35.84860
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 4.87046 4.87026
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 3.54440 3.54346
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 41.91150 41.92760
Yices2 Yices default unsat ✅ 101.51500 101.56000
Z3 z3 4.4.0 default unsat ✅ 751.02600 751.31900
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 24.79820 24.81240
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 7.75786 7.76327
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 55.65930 55.69340
Yices2 Yices-2.4.2 default unsat ✅ 195.58100 195.71000
Z3 z3-4.4.1 default unsat ✅ 1236.16000 1236.87000
SMT-COMP 2017 0.20 (4/5) Boolector Boolector SMT17 final boolector unsat ✅ 20.75900 20.75810
CVC4 CVC4-smtcomp2017-main default unsat ✅ 12.74080 12.74010
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 51.83460 51.81620
Yices2 Yices2-Main default unsat ✅ 146.70100 146.68100
Z3 z3-4.5.0 default unknown ❌ 600.10300 600.06200
SMT-COMP 2018 0.40 (3/5) Boolector Boolector_default unsat ✅ 24.23090 24.23180
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 6.62101 6.61987
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 6.71806 6.71808
Yices2 Yices 2.6.0_default unsat ✅ 149.57200 149.56400
Z3 z3-4.7.1_default unknown ❌ 1200.02000 1199.92000
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 13.00080 12.99990
Poolector-wrapped-sq_default unsat ✅ 14.23690 55.99000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 7.23387 7.23346
Par4 Par4-wrapped-sq_default unsat ✅ 6.78482 20.03000
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 165.02700 164.99900
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 1451.58000 1451.54000
SMT-COMP 2021 MathSAT mathsat-5.6.6_default unsat ✅ 227.66500 227.62000
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 184.87800 184.84000
Yices 2.6.2 for SMTCOMP2020_default unsat ✅ 209.77000 209.76600
Z3 z3-4.8.11_default unsat ✅ 239.15900 239.12800
SMT-COMP 2023 0.20 (4/5) Bitwuzla Bitwuzla-fixed_default unsat ✅ 9.21192 9.21053
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 217.87600 217.86400
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.09000 1268.11000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 160.11400 160.10400
Z3-Owl z3-Owl-Final_default sat ✅ 1.46220 1.46193
z3-Owl-Final_default unsat ✅ 403.17800 403.14700