Benchmark
non-incremental/QF_AUFBV/ecc/com.galois.ecc.P384ECC64.verifySignature.short.smt2
These benchmarks are derived from a semi-automated proof of functional equivalence between two implementations of an Elliptic Curve Digital Signature Algorithm (ECDSA). More information about problem they encode can be found here: http://cps-vo.org/node/3405
| Benchmark |
|---|
| Size | 91370 |
| Compressed Size | 10140 |
| License |
Creative Commons Attribution 4.0 International
(CC-BY-4.0)
|
| Category | industrial |
| First Occurrence | 2014-07-21 |
| Generated By | — |
| Generated On | — |
| Generator | — |
| Dolmen OK | 1 |
| strict Dolmen OK | 1 |
| check-sat calls | 1 |
| Status | unsat |
| Inferred Status | unsat |
| Size | 91362 |
| Compressed Size | 10153 |
| Max. Term Depth | 14 |
| Asserts | 1173 |
| Declared Functions | 5 |
| Declared Constants | 949 |
| Declared Sorts | 0 |
| Defined Functions | 0 |
| Defined Recursive Functions | 0 |
| Defined Sorts | 0 |
| Constants | 0 |
| Declared Datatypes | 0 |
Symbols
true | 1 |
ite | 108 |
not | 91 |
or | 127 |
and | 115 |
=> | 1 |
= | 1338 |
concat | 226 |
extract | 12 |
bvnot | 90 |
bvand | 115 |
bvor | 127 |
bvneg | 17 |
bvadd | 5 |
bvsub | 2 |
bvult | 28 |
bvule | 101 |
select | 552 |
| | | |
Evaluations
| Evaluation |
Rating |
Solver |
Variant |
Result |
Wallclock |
CPU Time |
|
SMT-COMP 2014
|
0.50 (2/4) |
CVC4 |
CVC4 f7118b2 default |
unsat ✅
|
0.54524
|
0.53392
|
| |
MathSAT |
MathSAT-5.2.12-Main default |
unsat ✅
|
0.15459
|
0.14598
|
| |
Yices2 |
Yices-2.2.1-smtcomp2014 default |
unknown ❌
|
2399.12000
|
2400.02000
|
| |
Z3 |
Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default |
unknown ❌
|
2398.91000
|
2400.07000
|
|
SMT-COMP 2015
|
|
Boolector |
Boolector SMT15 QF_AUFBV final boolector_qf_aufbv |
unsat ✅
|
17.02550
|
17.02840
|
| |
CVC4 |
CVC4-master-2015-06-15-9b32405-main default |
unsat ✅
|
0.55983
|
0.55691
|
| |
|
CVC4-experimental-2015-06-15-ff5745a-main default |
unsat ✅
|
0.55776
|
0.55391
|
| |
MathSAT |
MathSat 5.3.6 main smtcomp2015_main |
unsat ✅
|
0.19930
|
0.19797
|
| |
Yices2 |
Yices default |
unsat ✅
|
8.91054
|
8.91264
|
| |
Z3 |
z3 4.4.0 default |
unsat ✅
|
52.09450
|
52.11610
|
|
SMT-COMP 2016
|
|
Boolector |
Boolector boolector |
unsat ✅
|
7.03145
|
7.03606
|
| |
CVC4 |
CVC4-master-2016-05-27-cfef263-main default |
unsat ✅
|
0.57438
|
0.57494
|
| |
MathSAT |
mathsat-5.3.11-linux-x86_64-Main default |
unsat ✅
|
0.16551
|
0.16680
|
| |
Yices2 |
Yices-2.4.2 default |
unsat ✅
|
10.53310
|
10.53850
|
| |
Z3 |
z3-4.4.1 default |
unsat ✅
|
40.86850
|
40.87090
|
|
SMT-COMP 2017
|
|
Boolector |
Boolector SMT17 final boolector |
unsat ✅
|
9.78928
|
9.78739
|
| |
CVC4 |
CVC4-smtcomp2017-main default |
unsat ✅
|
0.58789
|
0.58687
|
| |
MathSAT |
mathsat-5.4.1-linux-x86_64-Main default |
unsat ✅
|
0.17389
|
0.16920
|
| |
Yices2 |
Yices2-Main default |
unsat ✅
|
7.44003
|
7.43772
|
| |
Z3 |
z3-4.5.0 default |
unsat ✅
|
5.84090
|
5.83946
|
|
SMT-COMP 2018
|
0.20 (4/5) |
Boolector |
Boolector_default |
unsat ✅
|
9.65174
|
9.65014
|
| |
CVC4 |
master-2018-06-10-b19c840-competition-default_default |
unsat ✅
|
0.66819
|
0.66836
|
| |
MathSAT |
mathsat-5.5.2-linux-x86_64-Main_default |
unknown ❌
|
0.17710
|
0.17804
|
| |
Yices2 |
Yices 2.6.0_default |
unsat ✅
|
10.79770
|
10.79710
|
| |
Z3 |
z3-4.7.1_default |
unsat ✅
|
3.91475
|
3.91398
|
|
SMT-COMP 2019
|
|
Boolector |
Boolector-wrapped-sq_default |
unsat ✅
|
1.39424
|
1.39433
|
| |
|
Poolector-wrapped-sq_default |
unsat ✅
|
1.99638
|
7.47000
|
| |
CVC4 |
CVC4-2019-06-03-d350fe1-wrapped-sq_default |
unsat ✅
|
0.69749
|
0.69776
|
| |
|
master-2018-06-10-b19c840-competition-default_default |
unsat ✅
|
0.67185
|
0.67209
|
| |
Yices2 |
Yices 2.6.2-wrapped-sq_default |
unsat ✅
|
8.62430
|
8.62344
|
| |
Z3 |
z3-4.8.4-d6df51951f4c-wrapped-sq_default |
unsat ✅
|
6.11128
|
6.11103
|
|
SMT-COMP 2020
|
|
Bitwuzla |
Bitwuzla-fixed_default |
unsat ✅
|
2.27339
|
2.27338
|
| |
CVC4 |
CVC4-sq-final_default |
unsat ✅
|
2.41351
|
2.41278
|
| |
MathSAT |
MathSAT5_default.sh |
unsat ✅
|
0.19296
|
0.19289
|
| |
Yices2 |
Yices 2.6.2 bug fix_default |
unsat ✅
|
9.67445
|
9.67311
|
| |
Z3 |
z3-4.8.8_default |
unsat ✅
|
7.91254
|
7.91043
|
|
SMT-COMP 2021
|
|
MathSAT |
mathsat-5.6.6_default |
unsat ✅
|
0.18324
|
0.18322
|
| |
Yices2 |
Yices 2.6.2 bug fix_default |
unsat ✅
|
6.12516
|
6.12483
|
| |
|
Yices 2.6.2 for SMTCOMP2020_default |
unsat ✅
|
6.09592
|
6.09551
|
| |
Z3 |
z3-4.8.11_default |
unsat ✅
|
5.84952
|
5.84857
|
|
SMT-COMP 2022
|
|
Bitwuzla |
Bitwuzla-wrapped_default |
unsat ✅
|
3.03908
|
3.03862
|
| |
cvc5 |
cvc5-default-2022-07-02-b15e116-wrapped_sq |
unsat ✅
|
0.29752
|
0.29811
|
| |
MathSAT |
MathSAT-5.6.8_default |
unsat ✅
|
0.22905
|
0.22900
|
| |
Yices2 |
Yices 2.6.2 for SMTCOMP 2021_default |
unsat ✅
|
9.65575
|
9.65526
|
| |
Z3 |
z3-4.8.17_default |
unsat ✅
|
10.59840
|
10.59990
|
|
SMT-COMP 2023
|
|
Bitwuzla |
Bitwuzla-fixed_default |
unsat ✅
|
2.87331
|
2.87276
|
| |
cvc5 |
cvc5-default-2023-05-16-ea045f305_sq |
unsat ✅
|
0.62189
|
0.62242
|
| |
UltimateEliminator |
UltimateIntBlastingWrapper+SMTInterpol_default |
sat ✅
|
43.00880
|
76.25640
|
| |
Yices2 |
Yices 2 for SMTCOMP 2023_default |
unsat ✅
|
6.17061
|
6.17090
|
| |
Z3-Owl |
z3-Owl-Final_default |
unsat ✅
|
16.96080
|
16.96000
|
| |
|
z3-Owl-Final_default |
unsat ✅
|
40.61570
|
40.61490
|
|
SMT-COMP 2024
|
0.20 (4/5) |
Bitwuzla |
Bitwuzla |
unsat ✅
|
2.79283
|
2.69261
|
| |
cvc5 |
cvc5 |
unsat ✅
|
0.57749
|
0.47793
|
| |
SMTInterpol |
SMTInterpol |
unsat ✅
|
68.53759
|
94.40234
|
| |
Yices2 |
Yices2 |
unknown ❌
|
1201.22683
|
1200.87364
|
| |
Z3alpha |
Z3-alpha |
unsat ✅
|
6.17125
|
6.07090
|
|
SMT-COMP 2025
|
|
Bitwuzla |
Bitwuzla |
unsat ✅
|
1.92025
|
1.80285
|
| |
cvc5 |
cvc5 |
unsat ✅
|
0.53272
|
0.40848
|
| |
SMTInterpol |
SMTInterpol |
unsat ✅
|
94.20572
|
119.00219
|
| |
Yices2 |
Yices2 |
unsat ✅
|
3.73798
|
3.59548
|
| |
Z3 |
Z3-Owl-base |
unsat ✅
|
18.57863
|
18.44366
|
| |
Z3-Owl |
Z3-Owl |
unsat ✅
|
14.93353
|
14.80734
|