Benchmark

non-incremental/QF_ABV/platania/selection_sort/selection_sort22.c.smt2 

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Selection Sort algorithm for sorting
an array of N (the increasing parameter) elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size522579
Compressed Size32061
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 522571
Compressed Size32077
Max. Term Depth1516
Asserts 1495
Declared Functions0
Declared Constants1502
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite1470 not23 and4244 =>946
=1494 let443 bvadd504 bvsub1471
bvult4244 bvule988 select966 store64

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 Boolector Boolector unsat ✅ — —
CVC3 CVC3-1.5 unsat ✅ 7.40000 —
Z3 Z3 0.1 unsat ✅ 0.10000 —
Z3.2 unsat ✅ 0.10000 —
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.03856 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.04735 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.04624 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 1.31545 —
CVC3-SMT-COMP-2011 default unsat ✅ 1.17927 —
CVC3-SMT-COMP-2012 default unsat ✅ 1.17777 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.24556 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.23765 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.15313 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.38039 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.31261 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.11447 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.13568 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.12531 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 0.06547 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.08368 —
Z3-SMT-COMP-2011 default unsat ✅ 0.08716 —
SMT-COMP 2014 0.14 (6/7) Boolector Boolector boolectord unsat ✅ 0.08697 0.07599
Boolector boolectorj unsat ✅ 0.09164 0.07599
CVC4 CVC4 f7118b2 default unsat ✅ 0.34508 0.33495
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.01857 0.01700
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.04100 0.03100
MathSAT MathSAT-5.2.12-Main default unsat ✅ 0.13347 0.13198
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 0.12282 0.11198
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 8.58655 8.57770
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.08312 0.07499
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 0.05003 0.04899
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.35578 0.35395
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.35661 0.35395
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.11891 0.11798
Yices2 Yices default unsat ✅ 9.20507 9.20560
Z3 z3 4.4.0 default unsat ✅ 0.09303 0.09298
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 0.05565 0.05566
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.35109 0.35144
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.10821 0.10923
Yices2 Yices-2.4.2 default unsat ✅ 11.57260 11.57900
Z3 z3-4.4.1 default unsat ✅ 0.09002 0.09130
SMT-COMP 2017 Boolector Boolector SMT17 final boolector unsat ✅ 0.05457 0.05373
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.36567 0.36605
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.10696 0.10722
Yices2 Yices2-Main default unsat ✅ 19.62760 19.62580
Z3 z3-4.5.0 default unsat ✅ 0.09582 0.09493
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 0.04952 0.04943
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.39480 0.39497
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.10454 0.10544
Yices2 Yices 2.6.0_default unsat ✅ 7.62835 7.62750
Z3 z3-4.7.1_default unsat ✅ 0.10054 0.10043
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.07019 0.07015
Boolector Boolector-wrapped-sq_default unsat ✅ 0.07299 0.07297
CVC4 CVC4-sq-final_default unsat ✅ 0.56669 0.56689
MathSAT MathSAT5_default.sh unsat ✅ 0.11132 0.11124
Par4 Par4-wrapped-sq_default unsat ✅ 0.06266 0.00659
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 123.01300 122.99800
Z3 z3-4.8.8_default unsat ✅ 0.09796 0.09792
SMT-COMP 2023 0.20 (4/5) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.14597 0.14583
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.29948 0.29995
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.02000 1259.96000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 15.31240 15.31270
Z3-Owl z3-Owl-Final_default unsat ✅ 0.87966 0.87930
z3-Owl-Final_default unsat ✅ 0.88805 0.88811
SMT-COMP 2024 0.25 (3/4) Bitwuzla Bitwuzla unsat ✅ 0.28282 0.18310
cvc5 cvc5 unsat ✅ 0.37077 0.27105
SMTInterpol SMTInterpol unknown ❌ 1201.72377 1272.15734
Yices2 Yices2 unsat ✅ 9.04150 8.93852