Benchmark

non-incremental/QF_S/20230329-automatark-lu/instance11764.smt2

Description: Translated from a collection of real-world regex queries, AutomataArk, collected by Loris D’Antoni and Fang Wang: https://github.com/lorisdanto/automatark
Application: Evaluate solvers on real-world regex queries
Target solver: Z3str3RE, CVC4, OSTRICH, Z3seq, Z3str3, Z3-Trau
Publications: Berzish, M., Kulczynski, M., Mora, F., Manea, F., Day, J. D., Nowotka, D., & Ganesh, V. (2021, July). An SMT solver for regular expressions and linear arithmetic over string length. In CAV 2021.
Benchmark
Size3205
Compressed Size1003
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2023-07-06
Generated ByMurphy Berzish, Mitja Kulczynski, Federico Mora, Florin Manea, Joel Day, Dirk Nowotka, Vijay Ganesh, Zhengyang Lu
Generated On2020-10-01 00:00:00
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unknown
Inferred Status unsat
Size 3196
Compressed Size1009
Max. Term Depth8
Asserts 4
Declared Functions0
Declared Constants1
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not2 re.allchar7 str.to_re57 re.*8
re.+8 re.opt6 re.range28 re.++11
re.union15 re.loop3 str.in_re4

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2024 cvc5 cvc5 unsat ✅ 0.37638 0.27711
OSTRICH OSTRICH unsat ✅ 1.41875 2.38074
Z3alpha Z3-alpha unsat ✅ 0.44042 0.34055
Z3-Noodler Z3-Noodler unsat ✅ 0.25603 0.15636
SMT-COMP 2025 0.17 (5/6) cvc5 cvc5 unsat ✅ 0.41288 0.28684
OSTRICH OSTRICH unsat ✅ 1.28352 2.29133
Z3alpha Z3-alpha unsat ✅ 0.68725 1.12321
Z3 Z3-alpha-base unknown ❌ 1201.32591 1200.96117
Z3-Noodler-base unknown ❌ 1201.30149 1200.98308
Z3-Noodler Z3-Noodler unsat ✅ 0.31412 0.19041
Z3-Noodler-Mocha-base unsat ✅ 0.29872 0.17753
Z3-Noodler-Mocha Z3-Noodler-Mocha unsat ✅ 0.30094 0.17745