Benchmark

non-incremental/QF_ABV/brummayerbiere/selsort008un.smt2

We verify that selection sort sorts an array
of length 8 in memory. Additionally, we read an element
at an arbitrary index of the initial array and show that this
element can not be unequal to an element in the sorted array.

Contributed by Robert Brummayer (robert.brummayer@gmail.com).
Benchmark
Size6948
Compressed Size1359
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2008-07-07
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 6940
Compressed Size1358
Max. Term Depth81
Asserts 1
Declared Functions0
Declared Constants3
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite94 not1 =37 let64
bvnot18 bvand18 bvadd8 bvult37
select51 store14

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.71 (2/7) Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌
Boolector-SMT-COMP-2011 default unknown ❌
Boolector-SMT-COMP-2012 default unsat ✅ 29.21770
CVC3 CVC3-SMT-COMP-2010 default unknown ❌
CVC3-SMT-COMP-2011 default unknown ❌
CVC3-SMT-COMP-2012 default unknown ❌
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌
CVC4-SMT-EVAL-2013 default unknown ❌
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌
MathSAT5-SMT-COMP-2011 default unknown ❌
MathSAT5-SMT-COMP-2012 default unknown ❌
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌
SONOLAR-SMT-COMP-2011 default unknown ❌
SONOLAR-SMT-COMP-2012 default unknown ❌
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unknown ❌
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌
Z3-SMT-COMP-2011 default unsat ✅ 209.10300
SMT-COMP 2014 0.14 (6/7) Boolector Boolector boolectord unsat ✅ 49.04720 49.04750
Boolector boolectorj unsat ✅ 54.26950 54.27970
CVC4 CVC4 f7118b2 default unsat ✅ 88.67290 88.67750
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unsat ✅ 214.57200 214.64400
Kleaver-indie-more-typed kleaver_portfolio unsat ✅ 46.35460 138.96200
MathSAT MathSAT-5.2.12-Main default unsat ✅ 42.16610 42.17160
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 90.97850 90.99620
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 20.90460 20.90280
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.31000 2400.04000
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 36.91220 36.91940
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 89.78260 89.81730
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 163.79500 163.85000
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 56.92770 56.95030
Yices2 Yices default unsat ✅ 43.94090 43.95630
Z3 z3 4.4.0 default unsat ✅ 1725.11000 1725.83000
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 14.93570 14.94570
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 125.07800 125.13500
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 28.21720 28.23690
Yices2 Yices-2.4.2 default unsat ✅ 36.00410 36.02790
Z3 z3-4.4.1 default unsat ✅ 1539.48000 1540.38000
SMT-COMP 2017 0.20 (4/5) Boolector Boolector SMT17 final boolector unsat ✅ 13.65830 13.65560
CVC4 CVC4-smtcomp2017-main default unsat ✅ 167.62500 167.60000
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 64.00110 63.98060
Yices2 Yices2-Main default unsat ✅ 51.76800 51.75880
Z3 z3-4.5.0 default unknown ❌ 600.01100 599.95400
SMT-COMP 2018 0.40 (3/5) Boolector Boolector_default unsat ✅ 233.15800 233.14000
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 265.18100 265.14800
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 2.51619 2.51659
Yices2 Yices 2.6.0_default unsat ✅ 30.92560 30.92140
Z3 z3-4.7.1_default unknown ❌ 1200.10000 1200.03000
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 21.28110 21.28040
Poolector-wrapped-sq_default unsat ✅ 22.33900 88.10280
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 302.28500 302.28200
Par4 Par4-wrapped-sq_default unsat ✅ 45.98060 137.57000
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 43.22290 43.21600
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 2175.68000 2175.60000
SMT-COMP 2022 Bitwuzla Bitwuzla-wrapped_default unsat ✅ 6.51740 6.51442
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 254.44800 254.38700
MathSAT MathSAT-5.6.8_default unsat ✅ 328.61100 328.59700
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 36.16180 36.15600
Z3 z3-4.8.17_default unsat ✅ 981.73200 981.59100
SMT-COMP 2023 0.40 (3/5) Bitwuzla Bitwuzla-fixed_default unsat ✅ 5.69510 5.69413
cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.11000 1197.09000
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.05000 1251.28000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 52.49000 52.48940
Z3-Owl z3-Owl-Final_default sat ✅ 0.82672 0.82664
z3-Owl-Final_default unsat ✅ 1105.47000 1105.41000
SMT-COMP 2024 0.25 (3/4) Bitwuzla Bitwuzla unsat ✅ 4.23814 4.13828
cvc5 cvc5 unknown ❌ 1201.72177 1200.92527
SMTInterpol SMTInterpol unsat ✅ 96.32070 146.40742
Yices2 Yices2 unsat ✅ 35.52936 35.41498
SMT-COMP 2025 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 3.94494 3.82618
cvc5 cvc5 unsat ✅ 926.12520 925.84962
SMTInterpol SMTInterpol unsat ✅ 445.06240 789.06813
Yices2 Yices2 unsat ✅ 20.56984 20.45064
Z3 Z3-Owl-base unknown ❌ 1201.24635 1200.97641
Z3-Owl Z3-Owl unsat ✅ 617.57713 617.39763