Benchmark

non-incremental/QF_ABV/brummayerbiere/selsort003un.smt2

We verify that selection sort sorts an array
of length 3 in memory. Additionally, we read an element
at an arbitrary index of the initial array and show that this
element can not be unequal to an element in the sorted array.

Contributed by Robert Brummayer (robert.brummayer@gmail.com).
Benchmark
Size1797
Compressed Size652
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2008-07-07
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1789
Compressed Size648
Max. Term Depth21
Asserts 1
Declared Functions0
Declared Constants3
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite14 not1 =7 let9
bvnot8 bvand8 bvadd3 bvult7
select11 store4

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2011 0.20 (4/5) Boolector Boolector 1.5.23-833 unsat ✅ 0.60000
CVC3 CVC3 v2.4 unsat ✅ 2.60000
MathSAT MathSAT5 unsat ✅ 0.40000
SONOLAR SONOLAR unsat ✅ 0.20000
Z3 Z3 unknown ❌ 1200.00000
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.81465
Boolector-SMT-COMP-2011 default unsat ✅ 0.42359
Boolector-SMT-COMP-2012 default unsat ✅ 0.32375
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 2.13591
CVC3-SMT-COMP-2011 default unsat ✅ 1.84224
CVC3-SMT-COMP-2012 default unsat ✅ 1.85177
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.10784
CVC4-SMT-EVAL-2013 default unsat ✅ 0.10669
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.10906
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.09716
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.15375
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.19012
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.25261
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.24793
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 0.10353
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.07400
Z3-SMT-COMP-2011 default unsat ✅ 0.07629
SMT-COMP 2014 Boolector Boolector boolectord unsat ✅ 0.20905 0.19797
Boolector boolectorj unsat ✅ 0.14683 0.13598
CVC4 CVC4 f7118b2 default unsat ✅ 0.07861 0.06799
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unsat ✅ 0.11889 0.10998
Kleaver-indie-more-typed kleaver_portfolio unsat ✅ 0.11268 0.30895
MathSAT MathSAT-5.2.12-Main default unsat ✅ 0.13419 0.12398
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 0.23766 0.22596
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.05616 0.05499
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.06809 0.05899
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 0.84828 0.84787
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.07043 0.06799
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.10223 0.09998
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.11813 0.11698
Yices2 Yices default unsat ✅ 0.07727 0.07599
Z3 z3 4.4.0 default unsat ✅ 0.11794 0.11798
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 0.30426 0.30440
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.10705 0.10730
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.11057 0.11199
Yices2 Yices-2.4.2 default unsat ✅ 0.07758 0.07754
Z3 z3-4.4.1 default unsat ✅ 0.10632 0.10764
SMT-COMP 2017 Boolector Boolector SMT17 final boolector unsat ✅ 0.18122 0.18060
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.09828 0.09785
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.12832 0.12856
Yices2 Yices2-Main default unsat ✅ 0.05076 0.05021
Z3 z3-4.5.0 default unsat ✅ 0.12044 0.12040
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 0.21950 0.21943
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.10464 0.10486
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.08288 0.08376
Yices2 Yices 2.6.0_default unsat ✅ 0.06142 0.06084
Z3 z3-4.7.1_default unsat ✅ 0.09984 0.09979
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.15703 0.15700
Poolector-wrapped-sq_default unsat ✅ 0.18067 0.17737
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.11177 0.11211
Par4 Par4-wrapped-sq_default unsat ✅ 0.09097 0.00651
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.07534 0.07533
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.09069 0.09067
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.35611 0.25546
cvc5 cvc5 unsat ✅ 0.28987 0.19023
SMTInterpol SMTInterpol unsat ✅ 0.89651 2.17697
Yices2 Yices2 unsat ✅ 0.25230 0.15213