Benchmark

non-incremental/QF_ABV/brummayerbiere/bubsort005un.smt2

We verify that bubble sort sorts an array
of length 5 in memory. Additionally, we read an element
at an arbitrary index of the initial array and show that this
element can not be unequal to an element in the sorted array.

Contributed by Robert Brummayer (robert.brummayer@gmail.com).
Benchmark
Size3917
Compressed Size1012
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2008-07-07
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3909
Compressed Size1008
Max. Term Depth53
Asserts 1
Declared Functions0
Declared Constants3
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite41 not1 =16 let39
bvnot12 bvand12 bvadd5 bvult16
select19 store20

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.14 (6/7) Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌
Boolector-SMT-COMP-2011 default unknown ❌
Boolector-SMT-COMP-2012 default unsat ✅ 1.59673
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 4.55531
CVC3-SMT-COMP-2011 default unknown ❌
CVC3-SMT-COMP-2012 default unknown ❌
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.23231
CVC4-SMT-EVAL-2013 default unknown ❌
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.25299
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.45642
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌
SONOLAR-SMT-COMP-2011 default unknown ❌
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.77782
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 0.16894
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌
Z3-SMT-COMP-2011 default unknown ❌
SMT-COMP 2014 Boolector Boolector boolectord unsat ✅ 0.41343 0.40294
Boolector boolectorj unsat ✅ 0.40699 0.39694
CVC4 CVC4 f7118b2 default unsat ✅ 0.12481 0.12298
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unsat ✅ 0.27577 0.26696
Kleaver-indie-more-typed kleaver_portfolio unsat ✅ 0.29046 0.81787
MathSAT MathSAT-5.2.12-Main default unsat ✅ 0.39116 0.38294
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 0.37082 0.35894
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.32985 0.31995
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.39034 0.38194
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 0.63618 0.63590
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.12509 0.12298
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.12494 0.12198
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.91118 0.91086
Yices2 Yices default unsat ✅ 1.08308 1.08283
Z3 z3 4.4.0 default unsat ✅ 0.30958 0.30995
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 0.21200 0.21210
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.16832 0.16866
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.44608 0.44732
Yices2 Yices-2.4.2 default unsat ✅ 0.52151 0.51136
Z3 z3-4.4.1 default unsat ✅ 0.36475 0.36620
SMT-COMP 2017 Boolector Boolector SMT17 final boolector unsat ✅ 0.37597 0.37481
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.18942 0.18955
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.48812 0.48851
Yices2 Yices2-Main default unsat ✅ 0.56721 0.56661
Z3 z3-4.5.0 default unsat ✅ 0.49876 0.49826
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 0.60437 0.60406
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.19740 0.19762
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 1.00428 1.00496
Yices2 Yices 2.6.0_default unsat ✅ 0.45099 0.45074
Z3 z3-4.7.1_default unsat ✅ 0.41062 0.41034
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.27082 0.27083
Poolector-wrapped-sq_default unsat ✅ 0.28512 0.28521
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.15565 0.15570
Par4 Par4-wrapped-sq_default unsat ✅ 0.15724 0.00643
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.44660 0.44664
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.50287 0.50288
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.44647 0.34670
cvc5 cvc5 unsat ✅ 0.87260 0.77255
SMTInterpol SMTInterpol unsat ✅ 4.00591 11.80127
Yices2 Yices2 unsat ✅ 0.85493 0.75472