Benchmark

non-incremental/QF_ABV/brummayerbiere/selsort010un.smt2

We verify that selection sort sorts an array
of length 10 in memory. Additionally, we read an element
at an arbitrary index of the initial array and show that this
element can not be unequal to an element in the sorted array.

Contributed by Robert Brummayer (robert.brummayer@gmail.com).
Benchmark
Size10317
Compressed Size1813
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2008-07-07
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 10309
Compressed Size1826
Max. Term Depth119
Asserts 1
Declared Functions0
Declared Constants3
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite147 not1 =56 let100
bvnot22 bvand22 bvadd10 bvult56
select74 store18

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2009 1.00 (0/4) Boolector Boolector unknown ❌ 900.00000
Boolector 1.2 unknown ❌ 900.00000
CVC3 CVC3 2.0 unknown ❌ 900.00000
MathSAT MathSAT 4.3 unknown ❌ 900.00000
Yices2 Yices 2 proto unknown ❌ 900.00000
SMT Evaluation 2013 0.57 (3/7) Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 139.05900
Boolector-SMT-COMP-2011 default unknown ❌
Boolector-SMT-COMP-2012 default unsat ✅ 124.25300
CVC3 CVC3-SMT-COMP-2010 default unknown ❌
CVC3-SMT-COMP-2011 default unknown ❌
CVC3-SMT-COMP-2012 default unknown ❌
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌
CVC4-SMT-EVAL-2013 default unsat ✅ 641.36500
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 221.36100
MathSAT5-SMT-COMP-2011 default unsat ✅ 583.24100
MathSAT5-SMT-COMP-2012 default unsat ✅ 405.97400
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌
SONOLAR-SMT-COMP-2011 default unknown ❌
SONOLAR-SMT-COMP-2012 default unknown ❌
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unknown ❌
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌
Z3-SMT-COMP-2011 default unknown ❌
SMT-COMP 2014 0.57 (3/7) Boolector Boolector boolectord unsat ✅ 261.74600 261.78300
Boolector boolectorj unsat ✅ 161.72100 161.73400
CVC4 CVC4 f7118b2 default unknown ❌ 2399.61000 2400.05000
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 2399.02000 2400.01000
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 799.81800 2400.09000
MathSAT MathSAT-5.2.12-Main default unsat ✅ 129.25400 129.27600
SONOLAR sonolar_smtcomp-2014 default unknown ❌ 2399.02000 2400.02000
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 177.70500 177.76800
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.31000 2400.02000
SMT-COMP 2015 0.20 (4/5) Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 78.92940 78.96000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1506.44000 1507.03000
CVC4-experimental-2015-06-15-ff5745a-main default unknown ❌ 2400.01000 2400.72000
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 254.22800 254.30200
Yices2 Yices default unsat ✅ 207.02800 207.10300
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.50000
SMT-COMP 2016 0.40 (3/5) Boolector Boolector boolector unsat ✅ 106.40700 106.46900
CVC4 CVC4-master-2016-05-27-cfef263-main default unknown ❌ 2400.02000 2400.85000
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 160.82900 160.89500
Yices2 Yices-2.4.2 default unsat ✅ 179.62900 179.72700
Z3 z3-4.4.1 default unknown ❌ 2400.01000 2401.61000
SMT-COMP 2017 0.40 (3/5) Boolector Boolector SMT17 final boolector unsat ✅ 94.57290 94.56210
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.01200 598.08000
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 198.14900 198.11000
Yices2 Yices2-Main default unsat ✅ 148.42100 148.41300
Z3 z3-4.5.0 default unknown ❌ 600.10200 600.05500
SMT-COMP 2018 0.80 (1/5) Boolector Boolector_default unknown ❌ 1200.12000 1199.96000
CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.02000 1198.73000
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 30.13430 30.13370
Yices2 Yices 2.6.0_default unsat ✅ 284.09200 284.09600
Z3 z3-4.7.1_default unknown ❌ 1200.09000 1199.98000
SMT-COMP 2020 0.43 (4/7) Bitwuzla Bitwuzla-fixed_default unsat ✅ 102.77000 102.75000
Boolector Boolector-wrapped-sq_default unsat ✅ 224.66000 224.61600
CVC4 CVC4-sq-final_default unknown ❌ 1200.01000 1198.64000
MathSAT MathSAT5_default.sh unknown ❌ 1200.05000 1199.78000
Par4 Par4-wrapped-sq_default unsat ✅ 310.81700 931.44000
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 311.78700 311.63600
Z3 z3-4.8.8_default unknown ❌ 1200.01000 1199.88000
SMT-COMP 2023 0.40 (3/5) Bitwuzla Bitwuzla-fixed_default unsat ✅ 27.17170 27.17310
cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.12000 1195.87000
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.09000 1249.08000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 185.80200 185.78900
Z3-Owl z3-Owl-Final_default sat ✅ 0.84704 0.84710
z3-Owl-Final_default unknown ❌ 1200.01000 1199.90000
SMT-COMP 2024 0.25 (3/4) Bitwuzla Bitwuzla unsat ✅ 31.14149 31.03235
cvc5 cvc5 unknown ❌ 1201.71902 1200.61553
SMTInterpol SMTInterpol unsat ✅ 623.12915 732.00296
Yices2 Yices2 unsat ✅ 139.12795 138.97046