Benchmark

non-incremental/QF_ABV/platania/selection_sort/selection_sort28.c.smt2 

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Selection Sort algorithm for sorting
an array of N (the increasing parameter) elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size849803
Compressed Size50077
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 849795
Compressed Size50087
Max. Term Depth2434
Asserts 2407
Declared Functions0
Declared Constants2414
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite2376 not29 and6914 =>1540
=2406 let731 bvadd810 bvsub2377
bvult6914 bvule1594 select1566 store82

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 0.50 (1/2) Yices Yices 1.0.10 unknown ❌ 1800.70000 —
Z3 Z3 0.1 unsat ✅ 0.20000 —
Z3 0.1 (fixed BV) unsat ✅ 0.20000 —
SMT-COMP 2008 Boolector Boolector unsat ✅ 0.10000 —
CVC3 CVC3-1.5 unsat ✅ 14.40000 —
Z3 Z3 0.1 unsat ✅ 0.20000 —
Z3.2 unsat ✅ 0.20000 —
SMT-COMP 2009 0.25 (3/4) Boolector Boolector unsat ✅ 0.10000 —
Boolector 1.2 unsat ✅ 0.10000 —
CVC3 CVC3 2.0 unsat ✅ 3.10000 —
MathSAT MathSAT 4.3 unknown ❌ 169.60000 —
Yices2 Yices 2 proto unsat ✅ 0.10000 —
SMT-COMP 2010 0.50 (1/2) Boolector Boolector 1.2 unsat ✅ 0.10000 —
CVC3 CVC3 2.3 unknown ❌ 101.00000 —
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.06128 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.07542 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.06621 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 2.13576 —
CVC3-SMT-COMP-2011 default unsat ✅ 1.90307 —
CVC3-SMT-COMP-2012 default unsat ✅ 1.90460 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.39968 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.39343 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.26687 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.73757 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.63219 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.19176 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.21395 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.20200 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 0.10317 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.13197 —
Z3-SMT-COMP-2011 default unsat ✅ 0.13133 —
SMT-COMP 2014 0.14 (6/7) Boolector Boolector boolectord unsat ✅ 0.13456 0.13198
Boolector boolectorj unsat ✅ 0.14202 0.13098
CVC4 CVC4 f7118b2 default unsat ✅ 0.56552 0.55492
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.02674 0.01800
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.03640 0.03499
MathSAT MathSAT-5.2.12-Main default unsat ✅ 0.24491 0.23596
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 0.20200 0.18597
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 399.77900 399.84300
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.12524 0.11698
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 0.08032 0.07899
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.59159 0.58991
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.58587 0.58291
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.20849 0.20797
Yices2 Yices default unsat ✅ 364.64300 364.73300
Z3 z3 4.4.0 default unsat ✅ 0.13354 0.13398
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 0.08775 0.08776
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.57759 0.57816
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.19037 0.19146
Yices2 Yices-2.4.2 default unsat ✅ 53.29160 53.32260
Z3 z3-4.4.1 default unsat ✅ 0.12658 0.12787
SMT-COMP 2017 Boolector Boolector SMT17 final boolector unsat ✅ 0.08625 0.08529
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.61976 0.61922
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.19040 0.19037
Yices2 Yices2-Main default unsat ✅ 95.28930 95.26680
Z3 z3-4.5.0 default unsat ✅ 0.13570 0.13418
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 0.07909 0.07898
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.67561 0.67560
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.18725 0.18816
Yices2 Yices 2.6.0_default unsat ✅ 436.00400 435.90800
Z3 z3-4.7.1_default unsat ✅ 0.14459 0.14450
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.10868 0.10866
Boolector Boolector-wrapped-sq_default unsat ✅ 0.11451 0.11456
CVC4 CVC4-sq-final_default unsat ✅ 0.96770 0.96793
MathSAT MathSAT5_default.sh unsat ✅ 0.19395 0.19387
Par4 Par4-wrapped-sq_default unsat ✅ 0.09927 0.01080
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 421.23600 421.12100
Z3 z3-4.8.8_default unsat ✅ 0.14488 0.14485
SMT-COMP 2022 Bitwuzla Bitwuzla-wrapped_default unsat ✅ 0.11293 0.11290
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.94974 0.95004
MathSAT MathSAT-5.6.8_default unsat ✅ 0.19264 0.19241
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 393.08000 392.99500
Z3 z3-4.8.17_default unsat ✅ 0.12949 0.13125
SMT-COMP 2023 0.20 (4/5) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.23744 0.23739
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.51443 0.51504
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.12000 1264.82000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 457.82700 457.80100
Z3-Owl z3-Owl-Final_default unsat ✅ 1.00254 1.00255
z3-Owl-Final_default unsat ✅ 0.99945 0.99967