Benchmark
non-incremental/QF_ABV/bmc-arrays/selectSort.smt2
Generated using using the Low-Level Bounded Model Checker LLBMC.
C files used in the paper: Florian Merz, Stephan Falke, Carsten Sinz: LLBMC: Bounded Model Checking of C and C++ Programs Using a Compiler IR. VSTTE 2012: 146-161
| Benchmark |
|---|
| Size | 90324 |
| Compressed Size | 18768 |
| License |
Creative Commons Attribution 4.0 International
(CC-BY-4.0)
|
| Category | industrial |
| First Occurrence | 2014-07-21 |
| Generated By | — |
| Generated On | — |
| Generator | — |
| Dolmen OK | 1 |
| strict Dolmen OK | 1 |
| check-sat calls | 1 |
| Status | unsat |
| Inferred Status | unsat |
| Size | 90316 |
| Compressed Size | 18808 |
| Max. Term Depth | 2477 |
| Asserts | 1 |
| Declared Functions | 0 |
| Declared Constants | 7 |
| Declared Sorts | 0 |
| Defined Functions | 0 |
| Defined Recursive Functions | 0 |
| Defined Sorts | 0 |
| Constants | 0 |
| Declared Datatypes | 0 |
Symbols
ite | 70 |
not | 250 |
or | 288 |
and | 341 |
= | 26 |
let | 2474 |
concat | 225 |
extract | 88 |
bvnot | 3 |
bvand | 4 |
bvor | 1 |
bvadd | 151 |
bvmul | 26 |
bvsub | 13 |
bvult | 25 |
bvule | 96 |
bvugt | 1 |
bvslt | 20 |
bvsle | 6 |
bvsgt | 26 |
bvsge | 23 |
zero_extend | 50 |
sign_extend | 26 |
select | 300 |
store | 60 |
| | | | | |
Evaluations
| Evaluation |
Rating |
Solver |
Variant |
Result |
Wallclock |
CPU Time |
|
SMT-COMP 2014
|
0.29 (5/7) |
Boolector |
Boolector boolectord |
unsat ✅
|
21.62290
|
21.61670
|
| |
|
Boolector boolectorj |
unsat ✅
|
18.49460
|
18.48820
|
| |
CVC4 |
CVC4 f7118b2 default |
unknown ❌
|
2399.21000
|
2400.06000
|
| |
Kleaver |
Kleaver-indie-more-typed kleaver_indie_1 |
unknown ❌
|
0.01756
|
0.01600
|
| |
|
Kleaver-indie-more-typed kleaver_portfolio |
unknown ❌
|
0.04366
|
0.03499
|
| |
MathSAT |
MathSAT-5.2.12-Main default |
unsat ✅
|
38.19610
|
38.20320
|
| |
SONOLAR |
sonolar_smtcomp-2014 default |
unsat ✅
|
5.04766
|
5.03823
|
| |
Yices2 |
Yices-2.2.1-smtcomp2014 default |
unsat ✅
|
29.31410
|
29.31550
|
| |
Z3 |
Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default |
unsat ✅
|
79.96340
|
79.98480
|
|
SMT-COMP 2015
|
|
Boolector |
Boolector SMT15 QF_AUFBV final boolector_qf_aufbv |
unsat ✅
|
10.77710
|
10.78040
|
| |
CVC4 |
CVC4-master-2015-06-15-9b32405-main default |
unsat ✅
|
212.15700
|
212.24500
|
| |
|
CVC4-experimental-2015-06-15-ff5745a-main default |
unsat ✅
|
114.23600
|
114.27800
|
| |
MathSAT |
MathSat 5.3.6 main smtcomp2015_main |
unsat ✅
|
33.02430
|
33.00700
|
| |
Yices2 |
Yices default |
unsat ✅
|
29.81010
|
29.82150
|
| |
Z3 |
z3 4.4.0 default |
unsat ✅
|
85.25320
|
85.28800
|
|
SMT-COMP 2016
|
|
Boolector |
Boolector boolector |
unsat ✅
|
5.47754
|
5.48058
|
| |
CVC4 |
CVC4-master-2016-05-27-cfef263-main default |
unsat ✅
|
135.67300
|
135.41400
|
| |
MathSAT |
mathsat-5.3.11-linux-x86_64-Main default |
unsat ✅
|
60.81870
|
60.85520
|
| |
Yices2 |
Yices-2.4.2 default |
unsat ✅
|
29.89040
|
29.91000
|
| |
Z3 |
z3-4.4.1 default |
unsat ✅
|
85.05970
|
85.11750
|
|
SMT-COMP 2017
|
|
Boolector |
Boolector SMT17 final boolector |
unsat ✅
|
7.00380
|
7.00262
|
| |
CVC4 |
CVC4-smtcomp2017-main default |
unsat ✅
|
172.17900
|
171.91400
|
| |
MathSAT |
mathsat-5.4.1-linux-x86_64-Main default |
unsat ✅
|
40.02890
|
40.02990
|
| |
Yices2 |
Yices2-Main default |
unsat ✅
|
29.37490
|
29.37310
|
| |
Z3 |
z3-4.5.0 default |
unsat ✅
|
227.28400
|
227.26600
|
|
SMT-COMP 2018
|
0.20 (4/5) |
Boolector |
Boolector_default |
unsat ✅
|
6.77118
|
6.76856
|
| |
CVC4 |
master-2018-06-10-b19c840-competition-default_default |
unsat ✅
|
43.05840
|
43.05510
|
| |
MathSAT |
mathsat-5.5.2-linux-x86_64-Main_default |
unknown ❌
|
4.98344
|
4.98390
|
| |
Yices2 |
Yices 2.6.0_default |
unsat ✅
|
28.76110
|
28.75880
|
| |
Z3 |
z3-4.7.1_default |
unsat ✅
|
266.54700
|
266.52100
|
|
SMT-COMP 2020
|
|
Bitwuzla |
Bitwuzla-fixed_default |
unsat ✅
|
1.95225
|
1.95189
|
| |
Boolector |
Boolector-wrapped-sq_default |
unsat ✅
|
1.90522
|
1.90482
|
| |
CVC4 |
CVC4-sq-final_default |
unsat ✅
|
111.05300
|
110.74000
|
| |
MathSAT |
MathSAT5_default.sh |
unsat ✅
|
65.49090
|
65.48430
|
| |
Par4 |
Par4-wrapped-sq_default |
unsat ✅
|
6.97458
|
20.62000
|
| |
Yices2 |
Yices 2.6.2 bug fix_default |
unsat ✅
|
29.71770
|
29.71380
|
| |
Z3 |
z3-4.8.8_default |
unsat ✅
|
555.16600
|
555.11900
|
|
SMT-COMP 2023
|
0.40 (3/5) |
Bitwuzla |
Bitwuzla-fixed_default |
unsat ✅
|
2.53810
|
2.53790
|
| |
cvc5 |
cvc5-default-2023-05-16-ea045f305_sq |
unknown ❌
|
1200.12000
|
1198.40000
|
| |
UltimateEliminator |
UltimateIntBlastingWrapper+SMTInterpol_default |
unknown ❌
|
1200.02000
|
1261.03000
|
| |
Yices2 |
Yices 2 for SMTCOMP 2023_default |
unsat ✅
|
28.49490
|
28.48930
|
| |
Z3-Owl |
z3-Owl-Final_default |
sat ✅
|
3.11445
|
2.20994
|
| |
|
z3-Owl-Final_default |
unsat ✅
|
310.53700
|
310.48600
|
|
SMT-COMP 2024
|
0.25 (3/4) |
Bitwuzla |
Bitwuzla |
unsat ✅
|
2.34094
|
2.24069
|
| |
cvc5 |
cvc5 |
unsat ✅
|
25.29194
|
25.17992
|
| |
SMTInterpol |
SMTInterpol |
unknown ❌
|
1201.71807
|
1255.37079
|
| |
Yices2 |
Yices2 |
unsat ✅
|
23.96714
|
23.85926
|