Benchmark

non-incremental/QF_ABV/platania/no_init_selection_sort/no_init_selection_sort_unsafe27.c.smt2 

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Selection Sort algorithm for sorting
an array of N (the increasing parameter) unknown elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size785102
Compressed Size46411
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 785094
Compressed Size46420
Max. Term Depth2243
Asserts 2213
Declared Functions0
Declared Constants2220
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite2210 not28 and6396 =>1431
=2212 let678 bvadd754 bvsub2211
bvult6423 bvule1482 select1456 store52

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 0.50 (1/2) Yices Yices 1.0.10 unknown ❌ 1800.80000 —
Z3 Z3 0.1 sat ✅ 1155.00000 —
Z3 0.1 (fixed BV) sat ✅ 1144.10000 —
SMT-COMP 2008 0.67 (1/3) Boolector Boolector unknown ❌ 1801.00000 —
CVC3 CVC3-1.5 unknown ❌ 1800.80000 —
Z3 Z3 0.1 sat ✅ 1173.80000 —
Z3.2 unknown ❌ 1800.80000 —
SMT-COMP 2009 1.00 (0/4) Boolector Boolector unknown ❌ 900.00000 —
Boolector 1.2 unknown ❌ 900.00000 —
CVC3 CVC3 2.0 unknown ❌ 900.00000 —
MathSAT MathSAT 4.3 unknown ❌ 223.50000 —
Yices2 Yices 2 proto unknown ❌ 900.00000 —
SMT-COMP 2010 1.00 (0/2) Boolector Boolector 1.2 unknown ❌ 1200.00000 —
CVC3 CVC3 2.3 unknown ❌ 93.50000 —
SMT-COMP 2012 1.00 (0/4) Boolector Boolector unknown ❌ 1200.00000 —
Boolector 1.5.23-833 unknown ❌ 1200.00000 —
CVC3 CVC3 v2.4.2 unknown ❌ — —
CVC4 1.0rc.3931 unknown ❌ 1200.00000 —
CVC4 1.0rc.3970 unknown ❌ 1200.00000 —
SONOLAR SONOLAR unknown ❌ 1200.00000 —
Tiffany de Wintermonte Tiffany de Wintermonte & Sonolar unknown ❌ 1200.00000 —
SMT-COMP 2011 1.00 (0/5) Boolector Boolector 1.5.23-833 unknown ❌ 1200.00000 —
CVC3 CVC3 v2.4 unknown ❌ 1201.20000 —
MathSAT MathSAT5 unknown ❌ 1200.00000 —
SONOLAR SONOLAR unknown ❌ 1200.00000 —
Z3 Z3 unknown ❌ 1200.00000 —
SMT Evaluation 2013 1.00 (0/7) Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌ — —
Boolector-SMT-COMP-2011 default unknown ❌ — —
Boolector-SMT-COMP-2012 default unknown ❌ — —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unknown ❌ — —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌ — —
MathSAT5-SMT-COMP-2011 default unknown ❌ — —
MathSAT5-SMT-COMP-2012 default unknown ❌ — —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌ — —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unknown ❌ — —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unknown ❌ — —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌ — —
Z3-SMT-COMP-2011 default unknown ❌ — —
SMT-COMP 2014 0.14 (6/7) Boolector Boolector boolectord sat ✅ 1881.35000 1881.99000
Boolector boolectorj sat ✅ 59.31570 59.32900
CVC4 CVC4 f7118b2 default sat ✅ 20.76660 20.76480
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.01858 0.01700
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.04125 0.03199
MathSAT MathSAT-5.2.12-Main default sat ✅ 2012.28000 2012.92000
SONOLAR sonolar_smtcomp-2014 default sat ✅ 1163.67000 1164.10000
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 64.62150 64.62120
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 598.17800 598.35100
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv sat ✅ 265.60200 265.65900
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 8.00064 8.00178
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 115.86100 115.87500
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 2149.20000 2149.92000
Yices2 Yices default sat ✅ 93.52560 93.56280
Z3 z3 4.4.0 default sat ✅ 981.62500 981.86500
SMT-COMP 2016 Boolector Boolector boolector sat ✅ 665.74600 666.12700
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 110.61300 109.36000
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 2157.53000 2158.71000
Yices2 Yices-2.4.2 default sat ✅ 68.43730 68.45190
Z3 z3-4.4.1 default sat ✅ 789.88800 790.29900
SMT-COMP 2017 0.60 (2/5) Boolector Boolector SMT17 final boolector unknown ❌ 600.08200 600.00300
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.09600 591.12000
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.01600 599.81700
Yices2 Yices2-Main default sat ✅ 45.91910 45.89370
Z3 z3-4.5.0 default sat ✅ 399.79500 399.73000
SMT-COMP 2018 0.40 (3/5) Boolector Boolector_default sat ✅ 759.68100 759.71600
CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.01000 1188.01000
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 1200.02000 1199.78000
Yices2 Yices 2.6.0_default sat ✅ 37.71070 37.69800
Z3 z3-4.7.1_default sat ✅ 538.83300 538.71800
SMT-COMP 2021 0.33 (2/3) MathSAT mathsat-5.6.6_default sat ✅ 355.45000 355.32600
Yices2 Yices 2.6.2 bug fix_default sat ✅ 100.32200 100.31200
Yices 2.6.2 for SMTCOMP2020_default sat ✅ 101.17900 101.16900
Z3 z3-4.8.11_default unknown ❌ 1200.02000 1199.89000
SMT-COMP 2024 0.50 (2/4) Bitwuzla Bitwuzla sat ✅ 1.13111 1.03085
cvc5 cvc5 unknown ❌ 1201.71972 1201.10477
SMTInterpol SMTInterpol unknown ❌ 1201.73676 1279.26386
Yices2 Yices2 sat ✅ 39.28310 39.17411