Benchmark

non-incremental/QF_ABV/brummayerbiere/bubsort008un.smt2 

We verify that bubble sort sorts an array
of length 8 in memory. Additionally, we read an element
at an arbitrary index of the initial array and show that this
element can not be unequal to an element in the sorted array.

Contributed by Robert Brummayer (robert.brummayer@gmail.com).
Benchmark
Size8775
Compressed Size1704
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2008-07-07
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 8767
Compressed Size1699
Max. Term Depth125
Asserts 1
Declared Functions0
Declared Constants3
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite101 not1 =37 let108
bvnot18 bvand18 bvadd8 bvult37
select43 store56

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 6.75143 —
Boolector-SMT-COMP-2011 default unsat ✅ 12.29580 —
Boolector-SMT-COMP-2012 default unsat ✅ 5.26321 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 162.01100 —
CVC3-SMT-COMP-2011 default unsat ✅ 140.72800 —
CVC3-SMT-COMP-2012 default unsat ✅ 145.93900 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 371.35200 —
CVC4-SMT-EVAL-2013 default unsat ✅ 2.36990 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 18.16810 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 2.35498 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 2.34537 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 402.13300 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 545.45700 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 100.96300 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 29.82160 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 6.14919 —
Z3-SMT-COMP-2011 default unsat ✅ 8.42222 —
SMT-COMP 2014 Boolector Boolector boolectord unsat ✅ 7.39083 7.38088
Boolector boolectorj unsat ✅ 7.38109 7.37288
CVC4 CVC4 f7118b2 default unsat ✅ 2.96991 2.96055
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unsat ✅ 95.67560 95.68650
Kleaver-indie-more-typed kleaver_portfolio unsat ✅ 100.90400 302.68300
MathSAT MathSAT-5.2.12-Main default unsat ✅ 23.11220 23.11450
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 11.97000 11.96420
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 1282.69000 1283.20000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 4.67283 4.66729
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 8.99166 8.99463
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 3.00711 3.00654
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 2.99830 2.99654
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 13.63490 13.63890
Yices2 Yices default unsat ✅ 2093.18000 2094.03000
Z3 z3 4.4.0 default unsat ✅ 4.99841 5.00124
SMT-COMP 2016 0.20 (4/5) Boolector Boolector boolector unsat ✅ 6.09143 6.09531
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 3.00343 3.00529
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 14.11270 28.21180
Yices2 Yices-2.4.2 default unknown ❌ 2400.02000 2401.44000
Z3 z3-4.4.1 default unsat ✅ 5.40253 5.40680
SMT-COMP 2017 0.20 (4/5) Boolector Boolector SMT17 final boolector unsat ✅ 6.48012 6.47895
CVC4 CVC4-smtcomp2017-main default unsat ✅ 5.45060 5.44450
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 19.29510 19.29300
Yices2 Yices2-Main default unknown ❌ 600.11100 600.02700
Z3 z3-4.5.0 default unsat ✅ 6.36541 6.36429
SMT-COMP 2018 0.40 (3/5) Boolector Boolector_default unsat ✅ 64.86470 64.85850
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.64393 3.64332
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 13.85760 13.85900
Yices2 Yices 2.6.0_default unknown ❌ 1200.02000 1199.93000
Z3 z3-4.7.1_default unsat ✅ 9.47898 9.47859
SMT-COMP 2019 0.20 (4/5) Boolector Boolector-wrapped-sq_default unsat ✅ 16.05500 16.05390
Poolector-wrapped-sq_default unsat ✅ 16.76560 66.03000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 3.37520 3.37534
Par4 Par4-wrapped-sq_default unsat ✅ 3.25862 9.51000
Yices2 Yices 2.6.2-wrapped-sq_default unknown ❌ 2400.07000 2399.88000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 8.72055 8.71494
SMT-COMP 2021 0.33 (2/3) MathSAT mathsat-5.6.6_default unsat ✅ 23.63380 23.63180
Yices2 Yices 2.6.2 bug fix_default unknown ❌ 1200.02000 1199.88000
Yices 2.6.2 for SMTCOMP2020_default unknown ❌ 1200.12000 1200.10000
Z3 z3-4.8.11_default unsat ✅ 28.24560 28.23760
SMT-COMP 2022 0.20 (4/5) Bitwuzla Bitwuzla-wrapped_default unsat ✅ 14.42380 14.42300
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 2.98383 2.98458
MathSAT MathSAT-5.6.8_default unsat ✅ 50.03320 50.02970
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.03000 1199.79000
Z3 z3-4.8.17_default unsat ✅ 23.30090 23.30370