Benchmark

non-incremental/QF_ABV/platania/no_init_selection_sort/no_init_selection_sort_unsafe12.c.smt2 

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Selection Sort algorithm for sorting
an array of N (the increasing parameter) unknown elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size151904
Compressed Size10709
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 151896
Compressed Size10882
Max. Term Depth458
Asserts 443
Declared Functions0
Declared Constants450
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite440 not13 and1221 =>276
=442 let123 bvadd154 bvsub441
bvult1233 bvule297 select286 store22

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 0.50 (1/2) Yices Yices 1.0.10 unknown ❌ 1801.00000 —
Z3 Z3 0.1 sat ✅ 1.10000 —
Z3 0.1 (fixed BV) sat ✅ 1.10000 —
SMT-COMP 2008 0.33 (2/3) Boolector Boolector sat ✅ 21.80000 —
CVC3 CVC3-1.5 unknown ❌ 1801.00000 —
Z3 Z3 0.1 sat ✅ 1.10000 —
Z3.2 sat ✅ 5.10000 —
SMT-COMP 2009 0.25 (3/4) Boolector Boolector sat ✅ 11.90000 —
Boolector 1.2 sat ✅ 11.40000 —
CVC3 CVC3 2.0 unknown ❌ 900.00000 —
MathSAT MathSAT 4.3 sat ✅ 65.50000 —
Yices2 Yices 2 proto sat ✅ 5.60000 —
SMT-COMP 2010 0.50 (1/2) Boolector Boolector 1.2 sat ✅ 12.20000 —
CVC3 CVC3 2.3 unknown ❌ 1200.10000 —
SMT-COMP 2012 Boolector Boolector sat ✅ 21.90000 —
Boolector 1.5.23-833 sat ✅ 282.60000 —
CVC3 CVC3 v2.4.2 unknown ❌ 1201.00000 —
CVC4 1.0rc.3931 sat ✅ 184.40000 —
CVC4 1.0rc.3970 sat ✅ 187.30000 —
SONOLAR SONOLAR sat ✅ 28.00000 —
Tiffany de Wintermonte Tiffany de Wintermonte & Sonolar sat ✅ 14.80000 —
SMT-COMP 2011 0.20 (4/5) Boolector Boolector 1.5.23-833 sat ✅ 340.40000 —
CVC3 CVC3 v2.4 unknown ❌ 1200.00000 —
MathSAT MathSAT5 sat ✅ 21.10000 —
SONOLAR SONOLAR sat ✅ 40.10000 —
Z3 Z3 sat ✅ 77.20000 —
SMT Evaluation 2013 1.00 (0/7) Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌ — —
Boolector-SMT-COMP-2011 default unknown ❌ — —
Boolector-SMT-COMP-2012 default unknown ❌ — —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unknown ❌ — —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌ — —
MathSAT5-SMT-COMP-2011 default unknown ❌ — —
MathSAT5-SMT-COMP-2012 default unknown ❌ — —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌ — —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unknown ❌ — —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unknown ❌ — —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌ — —
Z3-SMT-COMP-2011 default unknown ❌ — —
SMT-COMP 2014 0.14 (6/7) Boolector Boolector boolectord sat ✅ 9.37133 9.37057
Boolector boolectorj sat ✅ 1.66576 1.65375
CVC4 CVC4 f7118b2 default sat ✅ 0.41526 0.40494
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.02474 0.01600
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.03929 0.03000
MathSAT MathSAT-5.2.12-Main default sat ✅ 27.49710 27.49980
SONOLAR sonolar_smtcomp-2014 default sat ✅ 13.23360 13.22400
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 0.43867 0.42993
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 2.46127 2.45163
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv sat ✅ 3.39433 3.39448
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 0.33216 0.32895
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 50.72540 50.74030
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 24.60170 24.61030
Yices2 Yices default sat ✅ 0.48286 0.48193
Z3 z3 4.4.0 default sat ✅ 1.79197 1.79273
SMT-COMP 2016 Boolector Boolector boolector sat ✅ 7.55558 7.55921
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 50.69280 50.70280
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 22.97250 22.98470
Yices2 Yices-2.4.2 default sat ✅ 0.75705 0.75745
Z3 z3-4.4.1 default sat ✅ 1.10796 1.10984
SMT-COMP 2017 0.20 (4/5) Boolector Boolector SMT17 final boolector sat ✅ 12.13420 12.13320
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.03000 597.64100
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 22.90310 22.89290
Yices2 Yices2-Main default sat ✅ 0.37770 0.37369
Z3 z3-4.5.0 default sat ✅ 3.06621 3.06495
SMT-COMP 2018 0.40 (3/5) Boolector Boolector_default sat ✅ 9.94142 9.93993
CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.01000 1195.47000
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 52.32940 52.32310
Yices2 Yices 2.6.0_default sat ✅ 0.23544 0.23536
Z3 z3-4.7.1_default sat ✅ 2.29672 2.29672
SMT-COMP 2020 0.14 (6/7) Bitwuzla Bitwuzla-fixed_default sat ✅ 0.15374 0.15369
Boolector Boolector-wrapped-sq_default sat ✅ 0.17347 0.17351
CVC4 CVC4-sq-final_default unknown ❌ 1200.02000 1193.46000
MathSAT MathSAT5_default.sh sat ✅ 1.35675 1.35589
Par4 Par4-wrapped-sq_default sat ✅ 0.94513 2.72000
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.94941 0.94904
Z3 z3-4.8.8_default sat ✅ 7.81475 7.81464
SMT-COMP 2021 MathSAT mathsat-5.6.6_default sat ✅ 3.08630 3.08537
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.49113 0.49094
Yices 2.6.2 for SMTCOMP2020_default sat ✅ 0.48496 0.48473
Z3 z3-4.8.11_default sat ✅ 2.87059 2.87033
SMT-COMP 2022 Bitwuzla Bitwuzla-wrapped_default sat ✅ 0.15600 0.15592
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 324.48500 324.46400
MathSAT MathSAT-5.6.8_default sat ✅ 3.55869 3.55835
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.53605 0.53649
Z3 z3-4.8.17_default sat ✅ 2.30352 2.30504
SMT-COMP 2023 0.20 (4/5) Bitwuzla Bitwuzla-fixed_default sat ✅ 3.04378 3.04330
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 216.04700 216.00300
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1277.03000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.37781 0.37776
Z3-Owl z3-Owl-Final_default sat ✅ 2.07091 2.07077
z3-Owl-Final_default sat ✅ 4.88987 4.88874
SMT-COMP 2024 Bitwuzla Bitwuzla sat ✅ 0.33610 0.23605
cvc5 cvc5 sat ✅ 155.37896 155.15291
SMTInterpol SMTInterpol sat ✅ 83.56481 113.83069
Yices2 Yices2 sat ✅ 0.43788 0.33747
SMT-COMP 2025 Bitwuzla Bitwuzla sat ✅ 0.61149 0.48947
cvc5 cvc5 sat ✅ 1.00662 0.87600
SMTInterpol SMTInterpol sat ✅ 7.75747 18.43018
Yices2 Yices2 sat ✅ 0.49049 0.37058
Z3 Z3-Owl-base sat ✅ 21.70268 21.58186
Z3-Owl Z3-Owl sat ✅ 3.47575 3.35258