Benchmark

non-incremental/QF_ABV/platania/no_init_selection_sort/no_init_selection_sort_unsafe22.c.smt2 

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Selection Sort algorithm for sorting
an array of N (the increasing parameter) unknown elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size518809
Compressed Size30780
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 518801
Compressed Size30792
Max. Term Depth1498
Asserts 1473
Declared Functions0
Declared Constants1480
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite1470 not23 and4221 =>946
=1472 let443 bvadd504 bvsub1471
bvult4243 bvule987 select966 store42

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 0.50 (1/2) Yices Yices 1.0.10 unknown ❌ 1800.80000 —
Z3 Z3 0.1 sat ✅ 210.60000 —
Z3 0.1 (fixed BV) sat ✅ 210.30000 —
SMT-COMP 2008 0.67 (1/3) Boolector Boolector unknown ❌ 1801.00000 —
CVC3 CVC3-1.5 unknown ❌ 1800.70000 —
Z3 Z3 0.1 sat ✅ 108.80000 —
Z3.2 sat ✅ 187.90000 —
SMT-COMP 2009 1.00 (0/4) Boolector Boolector unknown ❌ 900.00000 —
Boolector 1.2 unknown ❌ 900.00000 —
CVC3 CVC3 2.0 unknown ❌ 900.00000 —
MathSAT MathSAT 4.3 unknown ❌ 900.00000 —
Yices2 Yices 2 proto unknown ❌ 900.00000 —
SMT-COMP 2010 1.00 (0/2) Boolector Boolector 1.2 unknown ❌ 1200.00000 —
CVC3 CVC3 2.3 unknown ❌ 352.90000 —
SMT-COMP 2012 0.50 (2/4) Boolector Boolector unknown ❌ 1200.00000 —
Boolector 1.5.23-833 unknown ❌ 1200.00000 —
CVC3 CVC3 v2.4.2 unknown ❌ 1202.00000 —
CVC4 1.0rc.3931 unknown ❌ 1200.00000 —
CVC4 1.0rc.3970 unknown ❌ 1200.00000 —
SONOLAR SONOLAR sat ✅ 899.50000 —
Tiffany de Wintermonte Tiffany de Wintermonte & Sonolar sat ✅ 184.80000 —
SMT-COMP 2011 1.00 (0/5) Boolector Boolector 1.5.23-833 unknown ❌ 1200.00000 —
CVC3 CVC3 v2.4 unknown ❌ 1200.00000 —
MathSAT MathSAT5 unknown ❌ 1200.00000 —
SONOLAR SONOLAR unknown ❌ 1200.00000 —
Z3 Z3 unknown ❌ 1200.00000 —
SMT Evaluation 2013 0.29 (5/7) Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌ — —
Boolector-SMT-COMP-2011 default unknown ❌ — —
Boolector-SMT-COMP-2012 default unknown ❌ — —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ 632.48800 —
CVC4-SMT-EVAL-2013 default sat ✅ 7.52295 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 624.86900 —
MathSAT5-SMT-COMP-2011 default sat ✅ 18.36620 —
MathSAT5-SMT-COMP-2012 default sat ✅ 122.52900 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 449.05500 —
SONOLAR-SMT-COMP-2011 default sat ✅ 732.89500 —
SONOLAR-SMT-COMP-2012 default sat ✅ 395.75300 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default sat ✅ 101.36900 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 129.53400 —
Z3-SMT-COMP-2011 default sat ✅ 123.37200 —
SMT-COMP 2014 0.14 (6/7) Boolector Boolector boolectord sat ✅ 239.60000 239.65800
Boolector boolectorj sat ✅ 12.50740 12.49910
CVC4 CVC4 f7118b2 default sat ✅ 6.84602 6.83896
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.02582 0.01700
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.04111 0.03199
MathSAT MathSAT-5.2.12-Main default sat ✅ 691.51900 691.70800
SONOLAR sonolar_smtcomp-2014 default sat ✅ 383.23600 383.37000
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 15.21710 15.21470
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 97.75210 97.78510
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv sat ✅ 56.90740 56.91130
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 3.18128 3.18051
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 62.11120 62.11760
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 674.19900 674.37900
Yices2 Yices default sat ✅ 8.67532 8.67768
Z3 z3 4.4.0 default sat ✅ 87.22740 87.23270
SMT-COMP 2016 Boolector Boolector boolector sat ✅ 265.99400 266.12900
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 63.20360 61.99190
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 647.92200 648.23200
Yices2 Yices-2.4.2 default sat ✅ 10.34050 10.34620
Z3 z3-4.4.1 default sat ✅ 103.56500 103.60800
SMT-COMP 2017 0.40 (3/5) Boolector Boolector SMT17 final boolector sat ✅ 236.62300 236.59200
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.02000 599.67100
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.05900 599.91000
Yices2 Yices2-Main default sat ✅ 14.50380 14.50160
Z3 z3-4.5.0 default sat ✅ 118.81700 118.79100
SMT-COMP 2018 0.40 (3/5) Boolector Boolector_default sat ✅ 269.88800 269.81000
CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.05000 1192.15000
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 1200.03000 1199.83000
Yices2 Yices 2.6.0_default sat ✅ 12.44020 12.43990
Z3 z3-4.7.1_default sat ✅ 208.11700 208.08400
SMT-COMP 2019 0.20 (4/5) Boolector Boolector-wrapped-sq_default sat ✅ 1.37209 1.37198
Poolector-wrapped-sq_default sat ✅ 1.58967 5.82000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unknown ❌ 2400.02000 2383.23000
Par4 Par4-wrapped-sq_default sat ✅ 2.31722 6.85000
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 2.37418 2.37398
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 226.67000 226.63000
SMT-COMP 2021 MathSAT mathsat-5.6.6_default sat ✅ 135.76100 135.73400
Yices2 Yices 2.6.2 bug fix_default sat ✅ 6.06006 6.05899
Yices 2.6.2 for SMTCOMP2020_default sat ✅ 6.14429 6.14288
Z3 z3-4.8.11_default sat ✅ 172.75300 172.70400