Benchmark

non-incremental/QF_ABV/brummayerbiere/bubsort010un.smt2 

We verify that bubble sort sorts an array
of length 10 in memory. Additionally, we read an element
at an arbitrary index of the initial array and show that this
element can not be unequal to an element in the sorted array.

Contributed by Robert Brummayer (robert.brummayer@gmail.com).
Benchmark
Size13379
Compressed Size2352
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2008-07-07
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 13371
Compressed Size2343
Max. Term Depth193
Asserts 1
Declared Functions0
Declared Constants3
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite156 not1 =56 let174
bvnot22 bvand22 bvadd10 bvult56
select64 store90

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 0.33 (2/3) Boolector Boolector unsat ✅ 220.10000 —
CVC3 CVC3-1.5 unknown ❌ 1801.00000 —
Z3 Z3 0.1 unknown ❌ 1801.00000 —
Z3.2 unsat ✅ 725.10000 —
SMT Evaluation 2013 0.29 (5/7) Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 38.79020 —
Boolector-SMT-COMP-2011 default unsat ✅ 1070.76000 —
Boolector-SMT-COMP-2012 default unsat ✅ 24.01780 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 614.58300 —
CVC4-SMT-EVAL-2013 default unsat ✅ 119.84000 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 246.70300 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 8.42581 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 7.38406 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌ — —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unknown ❌ — —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 372.91900 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 84.77420 —
Z3-SMT-COMP-2011 default unsat ✅ 62.26800 —
SMT-COMP 2014 0.43 (4/7) Boolector Boolector boolectord unknown ❌ 2399.12000 2400.06000
Boolector boolectorj unknown ❌ 2399.12000 2400.03000
CVC4 CVC4 f7118b2 default unsat ✅ 37.23560 37.24430
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.02624 0.01600
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.04085 0.03099
MathSAT MathSAT-5.2.12-Main default unsat ✅ 77.99580 77.99710
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 921.12800 921.38300
Yices2 Yices-2.2.1-smtcomp2014 default unknown ❌ 2399.12000 2400.03000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 78.47600 78.49710
SMT-COMP 2015 0.20 (4/5) Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 16.38620 16.39150
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 72.25880 72.27500
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 92.48600 92.51790
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 133.71400 133.76800
Yices2 Yices default unknown ❌ 2400.01000 2400.98000
Z3 z3 4.4.0 default unsat ✅ 67.50310 67.51570
SMT-COMP 2016 0.20 (4/5) Boolector Boolector boolector unsat ✅ 567.63600 567.97100
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 85.53730 85.34720
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 136.34400 136.40600
Yices2 Yices-2.4.2 default unknown ❌ 2400.02000 2401.37000
Z3 z3-4.4.1 default unsat ✅ 52.01850 52.05130
SMT-COMP 2017 0.20 (4/5) Boolector Boolector SMT17 final boolector unsat ✅ 427.53400 427.50000
CVC4 CVC4-smtcomp2017-main default unsat ✅ 167.51300 167.44600
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 167.17000 167.14400
Yices2 Yices2-Main default unknown ❌ 600.01100 599.96000
Z3 z3-4.5.0 default unsat ✅ 256.94100 256.90300
SMT-COMP 2018 0.40 (3/5) Boolector Boolector_default unsat ✅ 318.58800 318.54100
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 226.14600 226.00100
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 163.34600 163.33000
Yices2 Yices 2.6.0_default unknown ❌ 1200.02000 1199.93000
Z3 z3-4.7.1_default unsat ✅ 184.82900 184.81600
SMT-COMP 2019 0.20 (4/5) Boolector Boolector-wrapped-sq_default unsat ✅ 56.67970 56.68170
Poolector-wrapped-sq_default unsat ✅ 60.66020 239.91500
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 248.46500 248.42100
Par4 Par4-wrapped-sq_default unsat ✅ 195.67500 586.56000
Yices2 Yices 2.6.2-wrapped-sq_default unknown ❌ 2400.07000 2399.92000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 176.59000 176.58700
SMT-COMP 2020 0.43 (4/7) Bitwuzla Bitwuzla-fixed_default unsat ✅ 72.22100 72.22500
Boolector Boolector-wrapped-sq_default unsat ✅ 66.33560 66.32020
CVC4 CVC4-sq-final_default unsat ✅ 181.31800 181.29400
MathSAT MathSAT5_default.sh unknown ❌ 1200.11000 1199.97000
Par4 Par4-wrapped-sq_default unsat ✅ 211.72400 634.92000
Yices2 Yices 2.6.2 bug fix_default unknown ❌ 1200.02000 1200.01000
Z3 z3-4.8.8_default unknown ❌ 1200.02000 1199.94000
SMT-COMP 2021 1.00 (0/3) MathSAT mathsat-5.6.6_default unknown ❌ 1200.03000 1199.92000
Yices2 Yices 2.6.2 bug fix_default unknown ❌ 1200.02000 1199.91000
Yices 2.6.2 for SMTCOMP2020_default unknown ❌ 1200.01000 1199.96000
Z3 z3-4.8.11_default unknown ❌ 1200.02000 1199.91000
SMT-COMP 2024 0.75 (1/4) Bitwuzla Bitwuzla unsat ✅ 70.49918 70.36901
cvc5 cvc5 unknown ❌ 1201.72748 1201.07434
SMTInterpol SMTInterpol unknown ❌ 1201.71807 1259.37738
Yices2 Yices2 unknown ❌ 1201.22727 1200.27004