Benchmark

non-incremental/QF_ABV/brummayerbiere/selsort009un.smt2 

We verify that selection sort sorts an array
of length 9 in memory. Additionally, we read an element
at an arbitrary index of the initial array and show that this
element can not be unequal to an element in the sorted array.

Contributed by Robert Brummayer (robert.brummayer@gmail.com).
Benchmark
Size8544
Compressed Size1568
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2008-07-07
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 8536
Compressed Size1570
Max. Term Depth99
Asserts 1
Declared Functions0
Declared Constants3
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite119 not1 =46 let81
bvnot20 bvand20 bvadd9 bvult46
select62 store16

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.29 (5/7) Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 62.17450 —
Boolector-SMT-COMP-2011 default unsat ✅ 756.47800 —
Boolector-SMT-COMP-2012 default unsat ✅ 54.40880 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unsat ✅ 192.15400 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 85.21580 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 175.07800 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 151.47200 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌ — —
SONOLAR-SMT-COMP-2011 default unsat ✅ 951.45800 —
SONOLAR-SMT-COMP-2012 default unknown ❌ — —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 1039.99000 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌ — —
Z3-SMT-COMP-2011 default unknown ❌ — —
SMT-COMP 2014 0.14 (6/7) Boolector Boolector boolectord unsat ✅ 106.22100 106.24400
Boolector boolectorj unsat ✅ 103.34500 103.37200
CVC4 CVC4 f7118b2 default unsat ✅ 1611.73000 1612.32000
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 2399.21000 2400.01000
Kleaver-indie-more-typed kleaver_portfolio unsat ✅ 313.69400 941.37000
MathSAT MathSAT-5.2.12-Main default unsat ✅ 76.46390 76.48640
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 421.67900 421.75200
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 66.48920 66.50990
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.02000 2400.05000
SMT-COMP 2015 0.20 (4/5) Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 51.73100 51.74210
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 710.79500 710.93400
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1451.17000 1451.73000
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 83.43140 83.46430
Yices2 Yices default unsat ✅ 135.15900 135.21600
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2401.03000
SMT-COMP 2016 0.20 (4/5) Boolector Boolector boolector unsat ✅ 22.07740 22.08730
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1645.34000 1645.81000
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 115.38300 115.44800
Yices2 Yices-2.4.2 default unsat ✅ 84.52880 84.58530
Z3 z3-4.4.1 default unknown ❌ 2400.01000 2401.41000
SMT-COMP 2017 0.40 (3/5) Boolector Boolector SMT17 final boolector unsat ✅ 20.50500 20.50370
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.10300 598.89400
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 134.39300 134.37200
Yices2 Yices2-Main default unsat ✅ 78.50800 78.51120
Z3 z3-4.5.0 default unknown ❌ 600.01100 600.00500
SMT-COMP 2018 0.80 (1/5) Boolector Boolector_default unknown ❌ 1200.11000 1199.90000
CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.01000 1198.67000
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 6.62924 6.62898
Yices2 Yices 2.6.0_default unsat ✅ 99.82630 99.80930
Z3 z3-4.7.1_default unknown ❌ 1200.01000 1199.97000
SMT-COMP 2019 0.40 (3/5) Boolector Boolector-wrapped-sq_default unsat ✅ 85.31220 85.30370
Poolector-wrapped-sq_default unsat ✅ 98.52730 390.02000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unknown ❌ 2400.11000 2397.29000
Par4 Par4-wrapped-sq_default unsat ✅ 109.87700 329.35000
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 73.10430 73.09900
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.09000 2399.96000
SMT-COMP 2020 0.29 (5/7) Bitwuzla Bitwuzla-fixed_default unsat ✅ 77.44750 77.43570
Boolector Boolector-wrapped-sq_default unsat ✅ 69.19560 69.16180
CVC4 CVC4-sq-final_default unknown ❌ 1200.11000 1198.66000
MathSAT MathSAT5_default.sh unsat ✅ 413.70300 413.61200
Par4 Par4-wrapped-sq_default unsat ✅ 72.90140 218.31000
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 98.62100 98.60550
Z3 z3-4.8.8_default unknown ❌ 1200.02000 1199.63000
SMT-COMP 2023 0.40 (3/5) Bitwuzla Bitwuzla-fixed_default unsat ✅ 17.29710 17.29680
cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.11000 1197.86000
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.08000 1247.92000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 78.74280 78.73900
Z3-Owl z3-Owl-Final_default sat ✅ 0.83787 0.83779
z3-Owl-Final_default unknown ❌ 1200.03000 1199.93000
SMT-COMP 2024 0.25 (3/4) Bitwuzla Bitwuzla unsat ✅ 14.46702 14.36639
cvc5 cvc5 unknown ❌ 1201.71789 1200.74897
SMTInterpol SMTInterpol unsat ✅ 253.95231 318.89784
Yices2 Yices2 unsat ✅ 92.62121 92.51850
SMT-COMP 2025 0.67 (2/6) Bitwuzla Bitwuzla unsat ✅ 12.90051 12.77940
cvc5 cvc5 unknown ❌ 1201.78462 1200.94987
SMTInterpol SMTInterpol unknown ❌ 1201.78311 1818.17894
Yices2 Yices2 unsat ✅ 42.68455 42.54998
Z3 Z3-Owl-base unknown ❌ 1201.24870 1200.98484
Z3-Owl Z3-Owl unknown ❌ 1201.76019 1201.05955