Benchmark

non-incremental/QF_ABV/brummayerbiere/bubsort004un.smt2

We verify that bubble sort sorts an array
of length 4 in memory. Additionally, we read an element
at an arbitrary index of the initial array and show that this
element can not be unequal to an element in the sorted array.

Contributed by Robert Brummayer (robert.brummayer@gmail.com).
Benchmark
Size2802
Compressed Size838
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2008-07-07
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 2794
Compressed Size840
Max. Term Depth37
Asserts 1
Declared Functions0
Declared Constants3
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite27 not1 =11 let24
bvnot10 bvand10 bvadd4 bvult11
select13 store12

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2010 Boolector Boolector 1.2 unsat ✅ 0.30000
CVC3 CVC3 2.3 unsat ✅ 2.40000
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.49787
Boolector-SMT-COMP-2011 default unsat ✅ 0.26623
Boolector-SMT-COMP-2012 default unsat ✅ 0.13958
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 1.20484
CVC3-SMT-COMP-2011 default unsat ✅ 1.06250
CVC3-SMT-COMP-2012 default unsat ✅ 1.06158
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.07422
CVC4-SMT-EVAL-2013 default unsat ✅ 0.06571
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.18294
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.11636
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.21458
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.09279
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.32356
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.10253
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 0.07265
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.15501
Z3-SMT-COMP-2011 default unsat ✅ 0.13583
SMT-COMP 2014 Boolector Boolector boolectord unsat ✅ 0.19282 0.18197
Boolector boolectorj unsat ✅ 0.18879 0.17797
CVC4 CVC4 f7118b2 default unsat ✅ 0.07936 0.06899
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unsat ✅ 0.15617 0.14698
Kleaver-indie-more-typed kleaver_portfolio unsat ✅ 0.10947 0.27696
MathSAT MathSAT-5.2.12-Main default unsat ✅ 0.16899 0.15998
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 0.11459 0.10298
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.08222 0.07299
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.21905 0.20997
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 0.21320 0.21197
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.07009 0.06699
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.07068 0.06699
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.16154 0.16097
Yices2 Yices default unsat ✅ 0.27773 0.27696
Z3 z3 4.4.0 default unsat ✅ 0.17494 0.17497
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 0.29798 0.29838
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.08097 0.08157
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.19824 0.19931
Yices2 Yices-2.4.2 default unsat ✅ 0.06778 0.06709
Z3 z3-4.4.1 default unsat ✅ 0.22368 0.22501
SMT-COMP 2017 Boolector Boolector SMT17 final boolector unsat ✅ 0.15335 0.15283
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.10151 0.10073
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.21577 0.21528
Yices2 Yices2-Main default unsat ✅ 0.06093 0.06017
Z3 z3-4.5.0 default unsat ✅ 0.30027 0.29961
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 0.28894 0.28890
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.07301 0.07318
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.16345 0.16440
Yices2 Yices 2.6.0_default unsat ✅ 0.25661 0.25657
Z3 z3-4.7.1_default unsat ✅ 0.18924 0.18917
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.17062 0.17056
Boolector Boolector-wrapped-sq_default unsat ✅ 0.19733 0.19734
CVC4 CVC4-sq-final_default unsat ✅ 0.08282 0.08311
MathSAT MathSAT5_default.sh unsat ✅ 0.26594 0.26585
Par4 Par4-wrapped-sq_default unsat ✅ 0.08814 0.00609
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.07220 0.07215
Z3 z3-4.8.8_default unsat ✅ 0.16357 0.16349
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.35268 0.22920
cvc5 cvc5 unsat ✅ 0.40854 0.28719
SMTInterpol SMTInterpol unsat ✅ 1.45666 3.74789
Yices2 Yices2 unsat ✅ 0.30462 0.18762
Z3 Z3-Owl-base unsat ✅ 0.57688 0.45787
Z3-Owl Z3-Owl unsat ✅ 1.12425 0.99686