Benchmark

non-incremental/QF_UFLIA/20230314-Jaroslav-Bendik-Certora/93493_5990a6bf5f2740164f77_50_QF_UFLIA.smt2 

Publications: https://docs.certora.com/en/latest/docs/whitepaper/index.html
This benchmarkset was produced by the Certora Prover, i.e. a tool for
formal verification of Ethereum Smart Contracts.  The benchmarks encode
verification conditions for real Smart Contracts (programs) written by
Certora customers.

The Certora Prover uses various strategies and SMT encodings of the
underlying verification problem. In most cases, we use either LIA,
NIA or BV encodings, where:

1. LIA is typically an overapproximation of the underlying verification
   problem.
2. NIA is typically a precise encoding.
3. BV is required when the input contains non-trivial bitwise operations
   that we do not model precisely with NIA (i.e., in these cases, NIA
   is an overapproximation).

Note that our specification language allows unbounded integers
(i.e. mathints); this the reason why we need NIA and LIA instead of
using just BV.

We also use various encodings of "underlying hashing functions"; the
two main encodings we use rely on i) UF and ii) on UFDT. Therefore,
given a single input (a smart contract and a specification), we typically
produce 6 different encodings: QF_UFNIA, QF_UFLIA, QF_UFBV, QF_UFDTNIA,
QF_UFDTLIA, and QF_UFDTBV. The 462 benchmarks in this benchmark set
originate from 77 unique smart contracts and specifications (77*6 =
462) and can be mapped based on the common name-prefix of the files. For
instances:

./QF_UFBV/20230314-Jaroslav-Bendik-Certora/940_590f27b1c3c800d3243e_33_QF_UFBV.smt2
./QF_UFDTLIA/20230314-Jaroslav-Bendik-Certora/940_590f27b1c3c800d3243e_33_QF_UFDTLIA.smt2
./QF_UFLIA/20230314-Jaroslav-Bendik-Certora/940_590f27b1c3c800d3243e_33_QF_UFLIA.smt2
./QF_UFDTBV/20230314-Jaroslav-Bendik-Certora/940_590f27b1c3c800d3243e_33_QF_UFDTBV.smt2
./QF_UFDTNIA/20230314-Jaroslav-Bendik-Certora/940_590f27b1c3c800d3243e_33_QF_UFDTNIA.smt2
./QF_UFNIA/20230314-Jaroslav-Bendik-Certora/940_590f27b1c3c800d3243e_33_QF_UFNIA.smt2
Benchmark
Size7636151
Compressed Size887364
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2023-07-06
Generated ByJaroslav Bendik
Generated On2023-03-14 00:00:00
GeneratorCertora Prover
Dolmen OK1
strict Dolmen OK—
check-sat calls1
Query 1
Status unknown
Inferred Status None
Size 7636143
Compressed Size887372
Max. Term Depth23
Asserts 34159
Declared Functions49
Declared Constants1160
Declared Sorts 0
Defined Functions260
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true16 false5 Bool44 ite12536
not31892 or114 and1733 =>21335
=38530 Int216 +175987 -867
*103 <170 <=16147 >197
>=16300

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2023 0.80 (1/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.12000 1199.79000
OpenSMT OpenSMT a78dcf01_default unknown ❌ 1200.02000 1199.92000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default sat ✅ 631.93200 691.59200
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.02000 1199.75000
Z3 z3-4.8.17_default unknown ❌ 1200.12000 1199.99000
SMT-COMP 2024 0.75 (1/4) cvc5 cvc5 unknown ❌ 1201.72225 1200.56728
OpenSMT OpenSMT unknown ❌ 1201.26467 1201.04158
SMTInterpol SMTInterpol sat ✅ 446.25813 496.65314
Yices2 Yices2 unknown ❌ 1201.40117 1200.66314
SMT-COMP 2025 1.00 (0/4) cvc5 cvc5 unknown ❌ 1201.74865 1200.95216
OpenSMT OpenSMT unknown ❌ 1201.31493 1201.02936
SMTInterpol SMTInterpol unknown ❌ 1201.38649 1287.94579
Yices2 Yices2 unknown ❌ 1201.50771 1201.13187