Benchmark

non-incremental/QF_AUFBV/2019-Gonzalvez/opStructure_MBA_7.smt2

Benchmarks arising from a generator of opaque expressions.
These expressions are used to protect some constants against
reverse-engineering, but their robustness can be compromised by
SMT-solvers. More informations in "Effectiveness of synthesis in concolic
deobfuscation" - CS 2017.
Benchmark
Size2141726
Compressed Size358188
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2020-07-06
Generated ByAlexandre Gonzalvez
Generated On2019-02-28 00:00:00
GeneratorKLEE
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 2141718
Compressed Size358194
Max. Term Depth706
Asserts 1
Declared Functions0
Declared Constants7
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false1 =2 let11 concat21
bvand4 bvor4 bvxor5 bvadd89146
bvmul21004 bvsub5246 bvshl42 select28

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2020 0.20 (4/5) Bitwuzla Bitwuzla-fixed_default sat ✅ 222.88900 222.76800
CVC4 CVC4-sq-final_default unknown ❌ 1200.03000 975.69000
MathSAT MathSAT5_default.sh sat ✅ 124.30200 124.28500
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.37698 0.37687
Z3 z3-4.8.8_default sat ✅ 1.78882 1.78884
SMT-COMP 2021 MathSAT mathsat-5.6.6_default sat ✅ 131.87600 131.85000
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.37036 0.37021
Yices 2.6.2 for SMTCOMP2020_default sat ✅ 0.36173 0.36170
Z3 z3-4.8.11_default sat ✅ 1.82683 1.82674
SMT-COMP 2022 0.20 (4/5) Bitwuzla Bitwuzla-wrapped_default sat ✅ 228.24200 228.21400
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.03000 977.09000
MathSAT MathSAT-5.6.8_default sat ✅ 142.42600 142.41500
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.36361 0.36336
Z3 z3-4.8.17_default sat ✅ 1.82835 1.82990
SMT-COMP 2023 0.60 (2/5) Bitwuzla Bitwuzla-fixed_default sat ✅ 436.71300 436.71000
cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.05000 976.94000
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.11000 3362.70000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.37981 0.37971
Z3-Owl z3-Owl-Final_default unknown ❌ 1200.08000 1199.79000
z3-Owl-Final_default unknown ❌ 1200.01000 1199.85000
SMT-COMP 2024 0.60 (2/5) Bitwuzla Bitwuzla unknown ❌ 269.53221 270.97183
cvc5 cvc5 unknown ❌ 1202.74615 1201.74752
SMTInterpol SMTInterpol unknown ❌ 1202.71959 4040.00885
Yices2 Yices2 sat ✅ 0.51804 0.41840
Z3alpha Z3-alpha sat ✅ 1.07626 0.97642
SMT-COMP 2025 0.50 (3/6) Bitwuzla Bitwuzla sat ✅ 150.78590 150.63240
cvc5 cvc5 unknown ❌ 461.41500 463.10118
SMTInterpol SMTInterpol unknown ❌ 1201.84806 4218.62168
Yices2 Yices2 sat ✅ 0.47052 0.35453
Z3 Z3-Owl-base sat ✅ 4.54600 4.41326
Z3-Owl Z3-Owl unknown ❌ 366.84725 368.57806