Benchmark
non-incremental/QF_UFBV/20230314-Jaroslav-Bendik-Certora/52759_af0c476fe3b544b9a8507f3e42472c43_12_QF_UFBV.smt2
Publications: https://docs.certora.com/en/latest/docs/whitepaper/index.html
This benchmarkset was produced by the Certora Prover, i.e. a tool for
formal verification of Ethereum Smart Contracts. The benchmarks encode
verification conditions for real Smart Contracts (programs) written by
Certora customers.
The Certora Prover uses various strategies and SMT encodings of the
underlying verification problem. In most cases, we use either LIA,
NIA or BV encodings, where:
1. LIA is typically an overapproximation of the underlying verification
problem.
2. NIA is typically a precise encoding.
3. BV is required when the input contains non-trivial bitwise operations
that we do not model precisely with NIA (i.e., in these cases, NIA
is an overapproximation).
Note that our specification language allows unbounded integers
(i.e. mathints); this the reason why we need NIA and LIA instead of
using just BV.
We also use various encodings of "underlying hashing functions"; the
two main encodings we use rely on i) UF and ii) on UFDT. Therefore,
given a single input (a smart contract and a specification), we typically
produce 6 different encodings: QF_UFNIA, QF_UFLIA, QF_UFBV, QF_UFDTNIA,
QF_UFDTLIA, and QF_UFDTBV. The 462 benchmarks in this benchmark set
originate from 77 unique smart contracts and specifications (77*6 =
462) and can be mapped based on the common name-prefix of the files. For
instances:
./QF_UFBV/20230314-Jaroslav-Bendik-Certora/940_590f27b1c3c800d3243e_33_QF_UFBV.smt2
./QF_UFDTLIA/20230314-Jaroslav-Bendik-Certora/940_590f27b1c3c800d3243e_33_QF_UFDTLIA.smt2
./QF_UFLIA/20230314-Jaroslav-Bendik-Certora/940_590f27b1c3c800d3243e_33_QF_UFLIA.smt2
./QF_UFDTBV/20230314-Jaroslav-Bendik-Certora/940_590f27b1c3c800d3243e_33_QF_UFDTBV.smt2
./QF_UFDTNIA/20230314-Jaroslav-Bendik-Certora/940_590f27b1c3c800d3243e_33_QF_UFDTNIA.smt2
./QF_UFNIA/20230314-Jaroslav-Bendik-Certora/940_590f27b1c3c800d3243e_33_QF_UFNIA.smt2
| Benchmark |
|---|
| Size | 973036 |
| Compressed Size | 157330 |
| License |
Creative Commons Attribution 4.0 International
(CC-BY-4.0)
|
| Category | industrial |
| First Occurrence | 2023-07-06 |
| Generated By | Jaroslav Bendik |
| Generated On | 2023-03-14 00:00:00 |
| Generator | Certora Prover |
| Dolmen OK | 1 |
| strict Dolmen OK | 1 |
| check-sat calls | 1 |
| Status | unknown |
| Inferred Status | sat |
| Size | 973029 |
| Compressed Size | 157339 |
| Max. Term Depth | 17 |
| Asserts | 10816 |
| Declared Functions | 22 |
| Declared Constants | 365 |
| Declared Sorts | 0 |
| Defined Functions | 12 |
| Defined Recursive Functions | 0 |
| Defined Sorts | 0 |
| Constants | 0 |
| Declared Datatypes | 0 |
Symbols
true | 1 |
false | 4 |
Bool | 3 |
ite | 17 |
not | 6661 |
or | 16 |
and | 3847 |
=> | 9023 |
= | 20065 |
BitVec | 9 |
bvand | 38 |
bvneg | 10 |
bvadd | 2610 |
bvmul | 8 |
bvudiv | 7 |
bvsdiv | 2 |
bvult | 31 |
bvule | 2409 |
bvugt | 18 |
bvuge | 2478 |
bvslt | 5 |
| | | | | |
Evaluations
| Evaluation |
Rating |
Solver |
Variant |
Result |
Wallclock |
CPU Time |
|
SMT-COMP 2023
|
0.40 (3/5) |
Bitwuzla |
Bitwuzla-fixed_default |
sat ✅
|
356.42100
|
356.27700
|
| |
cvc5 |
cvc5-default-2023-05-16-ea045f305_sq |
sat ✅
|
710.25500
|
710.18100
|
| |
UltimateEliminator |
UltimateIntBlastingWrapper+SMTInterpol_default |
unknown ❌
|
7.36424
|
21.49970
|
| |
Yices2 |
Yices 2 for SMTCOMP 2023_default |
sat ✅
|
381.72000
|
381.67300
|
| |
Z3-Owl |
z3-Owl-Final_default |
unknown ❌
|
1200.02000
|
1199.87000
|
| |
|
z3-Owl-Final_default |
unknown ❌
|
1200.03000
|
1199.83000
|
|
SMT-COMP 2024
|
0.40 (3/5) |
Bitwuzla |
Bitwuzla |
sat ✅
|
118.44074
|
118.30322
|
| |
cvc5 |
cvc5 |
sat ✅
|
968.89125
|
968.69594
|
| |
SMTInterpol |
SMTInterpol |
unknown ❌
|
12.56247
|
39.07211
|
| |
Yices2 |
Yices2 |
sat ✅
|
233.63904
|
233.44795
|
| |
Z3alpha |
Z3-alpha |
unknown ❌
|
1201.74673
|
1201.30489
|