Benchmark

non-incremental/UFBV/20230314-Jaroslav-Bendik-Certora/52759_b3ecd2335fd16ec2eee2_9_UFBV.smt2 

Publications: https://docs.certora.com/en/latest/docs/whitepaper/index.html
This benchmarkset was produced by the Certora Prover, i.e. a tool for
formal verification of Ethereum Smart Contracts.  The benchmarks encode
verification conditions for real Smart Contracts (programs) written by
Certora customers.

The Certora Prover uses various strategies and SMT encodings of the
underlying verification problem. In most cases, we use either LIA,
NIA or BV encodings, where:

1. LIA is typically an overapproximation of the underlying verification
   problem.
2. NIA is typically a precise encoding.
3. BV is required when the input contains non-trivial bitwise operations
   that we do not model precisely with NIA (i.e., in these cases, NIA
   is an overapproximation).

Note that our specification language allows unbounded integers
(i.e. mathints); this the reason why we need NIA and LIA instead of
using just BV.

We also use various encodings of "underlying hashing functions"; the
two main encodings we use rely on i) UF and ii) on UFDT. Therefore,
given a single input (a smart contract and a specification), we typically
produce 6 different encodings: QF_UFNIA, QF_UFLIA, QF_UFBV, QF_UFDTNIA,
QF_UFDTLIA, and QF_UFDTBV. The 462 benchmarks in this benchmark set
originate from 77 unique smart contracts and specifications (77*6 =
462) and can be mapped based on the common name-prefix of the files. For
instances:

./QF_UFBV/20230314-Jaroslav-Bendik-Certora/940_590f27b1c3c800d3243e_33_QF_UFBV.smt2
./QF_UFDTLIA/20230314-Jaroslav-Bendik-Certora/940_590f27b1c3c800d3243e_33_QF_UFDTLIA.smt2
./QF_UFLIA/20230314-Jaroslav-Bendik-Certora/940_590f27b1c3c800d3243e_33_QF_UFLIA.smt2
./QF_UFDTBV/20230314-Jaroslav-Bendik-Certora/940_590f27b1c3c800d3243e_33_QF_UFDTBV.smt2
./QF_UFDTNIA/20230314-Jaroslav-Bendik-Certora/940_590f27b1c3c800d3243e_33_QF_UFDTNIA.smt2
./QF_UFNIA/20230314-Jaroslav-Bendik-Certora/940_590f27b1c3c800d3243e_33_QF_UFNIA.smt2
Benchmark
Size131567
Compressed Size22939
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2023-07-06
Generated ByJaroslav Bendik
Generated On2023-03-14 00:00:00
GeneratorCertora Prover
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unknown
Inferred Status sat
Size 131560
Compressed Size22624
Max. Term Depth18
Asserts 982
Declared Functions24
Declared Constants619
Declared Sorts 0
Defined Functions59
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true2 false7 Bool3 ite88
not856 or30 and303 =>448
=1832 forall6 BitVec62 bvnot6
bvand21 bvor5 bvneg48 bvadd1017
bvmul18 bvudiv13 bvurem5 bvsdiv2
bvult34 bvule161 bvugt35 bvuge146
bvsgt1 bvshl7

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2023 0.25 (3/4) Bitwuzla Bitwuzla-fixed_default sat ✅ 67.36010 67.23000
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 253.43600 231.70400
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 1200.04000 1224.87000
UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1259.36000
Z3 z3-4.8.17_default sat ✅ 254.01600 253.93900
SMT-COMP 2024 0.33 (2/3) Bitwuzla Bitwuzla sat ✅ 7.07161 6.97142
cvc5 cvc5 sat ✅ 668.13128 667.99859
SMTInterpol SMTInterpol unknown ❌ 1201.74660 1240.55456
SMT-COMP 2025 0.50 (2/4) Bitwuzla Bitwuzla sat ✅ 8.29492 8.17217
cvc5 cvc5 sat ✅ 205.03913 204.86183
SMTInterpol SMTInterpol unknown ❌ 1201.78939 1239.77353
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1201.79152 1211.60019