Benchmark

non-incremental/QF_ABV/platania/no_init_selection_sort/no_init_selection_sort_safe2.c.smt2

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Selection Sort algorithm for sorting
an array of N (the increasing parameter) unknown elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size4328
Compressed Size1030
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 4320
Compressed Size1043
Max. Term Depth18
Asserts 13
Declared Functions0
Declared Constants20
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite10 not3 and21 =>6
=12 let3 bvadd4 bvsub11
bvult23 bvule7 select6 store2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 Yices Yices 1.0.10 unsat ✅ 0.10000
Z3 Z3 0.1 unsat ✅
Z3 0.1 (fixed BV) unsat ✅
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.01315
Boolector-SMT-COMP-2011 default unknown ❌
Boolector-SMT-COMP-2012 default unsat ✅ 0.01428
CVC3 CVC3-SMT-COMP-2010 default unknown ❌
CVC3-SMT-COMP-2011 default unsat ✅ 0.03054
CVC3-SMT-COMP-2012 default unsat ✅ 0.02836
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.01793
CVC4-SMT-EVAL-2013 default unsat ✅ 0.01076
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.02854
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.02898
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.02531
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.01449
SONOLAR-SMT-COMP-2011 default unsat ✅
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.01718
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 0.01795
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.01947
Z3-SMT-COMP-2011 default unsat ✅ 0.02178
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 0.04379 0.04299
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.01189 0.00900
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.01307 0.01000
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.03428 0.03299
Yices2 Yices default unsat ✅ 0.00819 0.00400
Z3 z3 4.4.0 default unsat ✅ 0.03721 0.03699
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 0.05242 0.05242
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.01332 0.01353
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.02813 0.02905
Yices2 Yices-2.4.2 default unsat ✅ 0.01131 0.00522
Z3 z3-4.4.1 default unsat ✅ 0.03541 0.03660
SMT-COMP 2017 Boolector Boolector SMT17 final boolector unsat ✅ 0.06010 0.06051
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.01616 0.01634
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.02879 0.02893
Yices2 Yices2-Main default unsat ✅ 0.01664 0.00662
Z3 z3-4.5.0 default unsat ✅ 0.04590 0.04402
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 0.05490 0.05487
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.01447 0.01469
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.02870 0.02973
Yices2 Yices 2.6.0_default unsat ✅ 0.00908 0.00900
Z3 z3-4.7.1_default unsat ✅ 0.04275 0.04264
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.01686 0.01282
Poolector-wrapped-sq_default unsat ✅ 0.17595 0.18881
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.02010 0.02045
Par4 Par4-wrapped-sq_default unsat ✅ 0.01938 0.00760
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.02161 0.00878
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.04642 0.04641