Benchmark

non-incremental/QF_UFBV/20230314-Jaroslav-Bendik-Certora/17512_5c1021b0faa6b6e1791b_21_QF_UFBV.smt2

Publications: https://docs.certora.com/en/latest/docs/whitepaper/index.html
This benchmarkset was produced by the Certora Prover, i.e. a tool for
formal verification of Ethereum Smart Contracts.  The benchmarks encode
verification conditions for real Smart Contracts (programs) written by
Certora customers.

The Certora Prover uses various strategies and SMT encodings of the
underlying verification problem. In most cases, we use either LIA,
NIA or BV encodings, where:

1. LIA is typically an overapproximation of the underlying verification
   problem.
2. NIA is typically a precise encoding.
3. BV is required when the input contains non-trivial bitwise operations
   that we do not model precisely with NIA (i.e., in these cases, NIA
   is an overapproximation).

Note that our specification language allows unbounded integers
(i.e. mathints); this the reason why we need NIA and LIA instead of
using just BV.

We also use various encodings of "underlying hashing functions"; the
two main encodings we use rely on i) UF and ii) on UFDT. Therefore,
given a single input (a smart contract and a specification), we typically
produce 6 different encodings: QF_UFNIA, QF_UFLIA, QF_UFBV, QF_UFDTNIA,
QF_UFDTLIA, and QF_UFDTBV. The 462 benchmarks in this benchmark set
originate from 77 unique smart contracts and specifications (77*6 =
462) and can be mapped based on the common name-prefix of the files. For
instances:

./QF_UFBV/20230314-Jaroslav-Bendik-Certora/940_590f27b1c3c800d3243e_33_QF_UFBV.smt2
./QF_UFDTLIA/20230314-Jaroslav-Bendik-Certora/940_590f27b1c3c800d3243e_33_QF_UFDTLIA.smt2
./QF_UFLIA/20230314-Jaroslav-Bendik-Certora/940_590f27b1c3c800d3243e_33_QF_UFLIA.smt2
./QF_UFDTBV/20230314-Jaroslav-Bendik-Certora/940_590f27b1c3c800d3243e_33_QF_UFDTBV.smt2
./QF_UFDTNIA/20230314-Jaroslav-Bendik-Certora/940_590f27b1c3c800d3243e_33_QF_UFDTNIA.smt2
./QF_UFNIA/20230314-Jaroslav-Bendik-Certora/940_590f27b1c3c800d3243e_33_QF_UFNIA.smt2
Benchmark
Size117360
Compressed Size19196
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2023-07-06
Generated ByJaroslav Bendik
Generated On2023-03-14 00:00:00
GeneratorCertora Prover
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unknown
Inferred Status None
Size 117353
Compressed Size19229
Max. Term Depth21
Asserts 630
Declared Functions15
Declared Constants625
Declared Sorts 0
Defined Functions98
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true4 Bool3 ite109 not618
or42 and251 =>319 =1399
BitVec95 bvand18 bvneg34 bvadd58
bvmul20 bvudiv18 bvsdiv2 bvult64
bvule186 bvugt58 bvuge192 bvslt1
bvsgt2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2023 1.00 (0/5) Bitwuzla Bitwuzla-fixed_default unknown ❌ 1200.11000 1199.75000
cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.02000 1199.60000
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 5.01475 13.30810
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.02000 1199.90000
Z3-Owl z3-Owl-Final_default unknown ❌ 1200.04000 1199.95000
z3-Owl-Final_default unknown ❌ 1200.03000 820.92000
SMT-COMP 2024 1.00 (0/5) Bitwuzla Bitwuzla unknown ❌ 1201.35308 1201.22906
cvc5 cvc5 unknown ❌ 1202.21994 1201.78305
SMTInterpol SMTInterpol unknown ❌ 66.88534 93.64355
Yices2 Yices2 unknown ❌ 1201.33347 1201.21816
Z3alpha Z3-alpha unknown ❌ 1202.21918 1201.78587