Benchmark

non-incremental/QF_ABV/platania/no_init_selection_sort/no_init_selection_sort_safe12.c.smt2 

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Selection Sort algorithm for sorting
an array of N (the increasing parameter) unknown elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size151906
Compressed Size10734
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 151898
Compressed Size10891
Max. Term Depth458
Asserts 443
Declared Functions0
Declared Constants450
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite440 not13 and1221 =>276
=442 let123 bvadd154 bvsub441
bvult1233 bvule297 select286 store22

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 1.00 (0/2) Yices Yices 1.0.10 unknown ❌ 1801.00000 —
Z3 Z3 0.1 unknown ❌ 1801.00000 —
Z3 0.1 (fixed BV) unknown ❌ 1800.80000 —
SMT-COMP 2008 1.00 (0/3) Boolector Boolector unknown ❌ 1800.80000 —
CVC3 CVC3-1.5 unknown ❌ 1801.00000 —
Z3 Z3 0.1 unknown ❌ 1800.80000 —
Z3.2 unknown ❌ 1801.00000 —
SMT-COMP 2009 1.00 (0/4) Boolector Boolector unknown ❌ 900.00000 —
Boolector 1.2 unknown ❌ 900.00000 —
CVC3 CVC3 2.0 unknown ❌ 900.00000 —
MathSAT MathSAT 4.3 unknown ❌ 900.00000 —
Yices2 Yices 2 proto unknown ❌ 900.00000 —
SMT-COMP 2010 1.00 (0/2) Boolector Boolector 1.2 unknown ❌ 1200.00000 —
CVC3 CVC3 2.3 unknown ❌ 1200.10000 —
SMT-COMP 2012 1.00 (0/4) Boolector Boolector unknown ❌ 1200.00000 —
Boolector 1.5.23-833 unknown ❌ 1200.00000 —
CVC3 CVC3 v2.4.2 unknown ❌ 1201.00000 —
CVC4 1.0rc.3931 unknown ❌ 1200.00000 —
CVC4 1.0rc.3970 unknown ❌ 1200.00000 —
SONOLAR SONOLAR unknown ❌ 1200.00000 —
Tiffany de Wintermonte Tiffany de Wintermonte & Sonolar unknown ❌ 1200.00000 —
SMT-COMP 2011 1.00 (0/5) Boolector Boolector 1.5.23-833 unknown ❌ 1200.00000 —
CVC3 CVC3 v2.4 unknown ❌ 1200.10000 —
MathSAT MathSAT5 unknown ❌ 1200.00000 —
SONOLAR SONOLAR unknown ❌ 1200.00000 —
Z3 Z3 unknown ❌ 1200.00000 —
SMT Evaluation 2013 0.86 (1/7) Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌ — —
Boolector-SMT-COMP-2011 default unknown ❌ — —
Boolector-SMT-COMP-2012 default unknown ❌ — —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unsat ✅ 667.24700 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌ — —
MathSAT5-SMT-COMP-2011 default unknown ❌ — —
MathSAT5-SMT-COMP-2012 default unknown ❌ — —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌ — —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unknown ❌ — —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unknown ❌ — —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌ — —
Z3-SMT-COMP-2011 default unknown ❌ — —
SMT-COMP 2014 0.71 (2/7) Boolector Boolector boolectord unsat ✅ 1779.76000 1780.48000
Boolector boolectorj unsat ✅ 2323.84000 2324.53000
CVC4 CVC4 f7118b2 default unknown ❌ 2399.12000 2400.07000
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.02497 0.01600
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.04311 0.03299
MathSAT MathSAT-5.2.12-Main default unknown ❌ 2399.51000 2400.06000
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 1195.47000 1195.71000
Yices2 Yices-2.2.1-smtcomp2014 default unknown ❌ 2399.12000 2400.05000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.02000 2400.03000
SMT-COMP 2015 0.80 (1/5) Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 878.80800 879.03200
CVC4 CVC4-master-2015-06-15-9b32405-main default unknown ❌ 2400.01000 2400.92000
CVC4-experimental-2015-06-15-ff5745a-main default unknown ❌ 2400.01000 2400.83000
MathSAT MathSat 5.3.6 main smtcomp2015_main unknown ❌ 2400.01000 2400.78000
Yices2 Yices default unknown ❌ 2400.01000 2401.05000
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.92000
SMT-COMP 2016 0.80 (1/5) Boolector Boolector boolector unsat ✅ 1033.89000 1034.47000
CVC4 CVC4-master-2016-05-27-cfef263-main default unknown ❌ 2400.02000 2399.85000
MathSAT mathsat-5.3.11-linux-x86_64-Main default unknown ❌ 2400.02000 2401.26000
Yices2 Yices-2.4.2 default unknown ❌ 2400.02000 2401.34000
Z3 z3-4.4.1 default unknown ❌ 2400.01000 2401.36000
SMT-COMP 2017 1.00 (0/5) Boolector Boolector SMT17 final boolector unknown ❌ 600.02100 599.98200
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.09500 597.91000
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.02300 599.86000
Yices2 Yices2-Main default unknown ❌ 600.01600 599.96400
Z3 z3-4.5.0 default unknown ❌ 600.10600 600.03600
SMT-COMP 2018 0.80 (1/5) Boolector Boolector_default unsat ✅ 564.50400 564.50900
CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.11000 1194.43000
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 152.64500 152.64100
Yices2 Yices 2.6.0_default unknown ❌ 1200.02000 1200.02000
Z3 z3-4.7.1_default unknown ❌ 1200.02000 1199.96000
SMT-COMP 2019 0.60 (2/5) Boolector Boolector-wrapped-sq_default unsat ✅ 622.96300 622.90300
Poolector-wrapped-sq_default unsat ✅ 522.52200 2071.06000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unknown ❌ 2400.03000 2379.82000
Par4 Par4-wrapped-sq_default unsat ✅ 592.93000 1771.87000
Yices2 Yices 2.6.2-wrapped-sq_default unknown ❌ 2400.02000 2399.94000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.11000 2400.06000
SMT-COMP 2020 0.57 (3/7) Bitwuzla Bitwuzla-fixed_default unsat ✅ 505.60500 505.55100
Boolector Boolector-wrapped-sq_default unsat ✅ 511.12400 511.09500
CVC4 CVC4-sq-final_default unknown ❌ 1200.10000 1193.03000
MathSAT MathSAT5_default.sh unknown ❌ 1200.02000 1199.71000
Par4 Par4-wrapped-sq_default unsat ✅ 682.27800 2039.97000
Yices2 Yices 2.6.2 bug fix_default unknown ❌ 1200.02000 1200.01000
Z3 z3-4.8.8_default unknown ❌ 1200.02000 1199.96000
SMT-COMP 2023 0.60 (2/5) Bitwuzla Bitwuzla-fixed_default unsat ✅ 890.97900 890.84300
cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.02000 1198.09000
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1284.04000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.11000 1199.79000
Z3-Owl z3-Owl-Final_default sat ✅ 2.09114 2.09097
z3-Owl-Final_default unknown ❌ 1200.02000 1199.95000
SMT-COMP 2024 0.75 (1/4) Bitwuzla Bitwuzla unsat ✅ 546.63103 546.29215
cvc5 cvc5 unknown ❌ 1201.72811 1200.89539
SMTInterpol SMTInterpol unknown ❌ 1201.71875 1250.95088
Yices2 Yices2 unknown ❌ 1201.22871 1201.08945
SMT-COMP 2025 0.83 (1/6) Bitwuzla Bitwuzla unsat ✅ 372.26660 372.10442
cvc5 cvc5 unknown ❌ 1201.79480 1200.86370
SMTInterpol SMTInterpol unknown ❌ 1201.76608 1776.58733
Yices2 Yices2 unknown ❌ 1201.28413 1201.05877
Z3 Z3-Owl-base unknown ❌ 1201.25240 1200.95040
Z3-Owl Z3-Owl unknown ❌ 1201.75859 1201.04061