Benchmark

non-incremental/QF_ABV/brummayerbiere/bubsort012un.smt2

We verify that bubble sort sorts an array
of length 12 in memory. Additionally, we read an element
at an arbitrary index of the initial array and show that this
element can not be unequal to an element in the sorted array.

Contributed by Robert Brummayer (robert.brummayer@gmail.com).
Benchmark
Size18972
Compressed Size3030
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2008-07-07
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 18964
Compressed Size3044
Max. Term Depth277
Asserts 1
Declared Functions0
Declared Constants3
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite223 not1 =79 let256
bvnot26 bvand26 bvadd12 bvult79
select89 store132

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 1.00 (0/3) Boolector Boolector unknown ❌ 1801.00000
CVC3 CVC3-1.5 unknown ❌ 1800.80000
Z3 Z3 0.1 unknown ❌ 1801.00000
Z3.2 unknown ❌ 1800.80000
SMT Evaluation 2013 0.43 (4/7) Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌
Boolector-SMT-COMP-2011 default unknown ❌
Boolector-SMT-COMP-2012 default unsat ✅ 417.83300
CVC3 CVC3-SMT-COMP-2010 default unknown ❌
CVC3-SMT-COMP-2011 default unknown ❌
CVC3-SMT-COMP-2012 default unknown ❌
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 666.27300
CVC4-SMT-EVAL-2013 default unsat ✅ 611.90000
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 429.22500
MathSAT5-SMT-COMP-2011 default unsat ✅ 33.39860
MathSAT5-SMT-COMP-2012 default unsat ✅ 102.73700
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌
SONOLAR-SMT-COMP-2011 default unknown ❌
SONOLAR-SMT-COMP-2012 default unknown ❌
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unknown ❌
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 1160.84000
Z3-SMT-COMP-2011 default unsat ✅ 687.96000
SMT-COMP 2014 0.57 (3/7) Boolector Boolector boolectord unknown ❌ 2399.42000 2400.04000
Boolector boolectorj unknown ❌ 2399.61000 2400.07000
CVC4 CVC4 f7118b2 default unsat ✅ 1428.05000 1428.58000
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.02667 0.01700
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.03662 0.03399
MathSAT MathSAT-5.2.12-Main default unsat ✅ 541.31000 541.48100
SONOLAR sonolar_smtcomp-2014 default unknown ❌ 2399.12000 2400.06000
Yices2 Yices-2.2.1-smtcomp2014 default unknown ❌ 2399.12000 2400.07000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 734.51000 734.80400
SMT-COMP 2015 0.40 (3/5) Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 637.74400 637.97600
CVC4 CVC4-master-2015-06-15-9b32405-main default unknown ❌ 2400.01000 2400.90000
CVC4-experimental-2015-06-15-ff5745a-main default unknown ❌ 2400.01000 2400.84000
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 749.61000 749.85300
Yices2 Yices default unknown ❌ 2400.01000 2400.95000
Z3 z3 4.4.0 default unsat ✅ 616.11200 616.41800
SMT-COMP 2016 0.60 (2/5) Boolector Boolector boolector unknown ❌ 2400.01000 2401.36000
CVC4 CVC4-master-2016-05-27-cfef263-main default unknown ❌ 2400.02000 2389.40000
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 379.19500 379.41500
Yices2 Yices-2.4.2 default unknown ❌ 2400.01000 2401.38000
Z3 z3-4.4.1 default unsat ✅ 948.50600 949.13200
SMT-COMP 2017 1.00 (0/5) Boolector Boolector SMT17 final boolector unknown ❌ 600.01900 599.98300
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.11500 594.96700
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.02100 599.89000
Yices2 Yices2-Main default unknown ❌ 600.01800 599.97300
Z3 z3-4.5.0 default unknown ❌ 600.11300 600.11400
SMT-COMP 2018 1.00 (0/5) Boolector Boolector_default unknown ❌ 1200.01000 1199.87000
CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.11000 1195.79000
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 673.11400 673.10800
Yices2 Yices 2.6.0_default unknown ❌ 1200.11000 1200.04000
Z3 z3-4.7.1_default unknown ❌ 1200.06000 1200.05000
SMT-COMP 2021 1.00 (0/3) MathSAT mathsat-5.6.6_default unknown ❌ 1200.03000 1118.98000
Yices2 Yices 2.6.2 bug fix_default unknown ❌ 1200.01000 1199.88000
Yices 2.6.2 for SMTCOMP2020_default unknown ❌ 1200.03000 1199.94000
Z3 z3-4.8.11_default unknown ❌ 1200.04000 1199.91000
SMT-COMP 2024 0.75 (1/4) Bitwuzla Bitwuzla unsat ✅ 317.68732 317.52369
cvc5 cvc5 unknown ❌ 1201.71951 1201.08383
SMTInterpol SMTInterpol unknown ❌ 1201.72501 1269.69223
Yices2 Yices2 unknown ❌ 1201.22280 1201.07703