Benchmark

non-incremental/QF_SLIA/2015-Norn/StringReplace/norn-benchmark-124.smt2

Publication: "String constraints for verification" by P.A. Abdulla, M.F. Atig, Y.F. Chen, L. Holík, A. Rezine, P. Rümmer, and J. Stenman, CAV 2014.
Benchmark
Size1488
Compressed Size618
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2020-07-06
Generated ByParosh Aziz Abdulla, Mohamed Faouzi Atig, Yu-Fang Chen, Lukáš Holík, Ahmed Rezine, Philipp Rümmer, Jari Stenman
Generated On2015-03-09 00:00:00
GeneratorEldarica
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unknown
Inferred Status unsat
Size 1480
Compressed Size615
Max. Term Depth9
Asserts 4
Declared Functions0
Declared Constants13
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not1 str.++1 str.to_re11 re.*5
re.range2 re.++2 re.union7 str.in_re4

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2020 1.00 (0/2) CVC4 CVC4-sq-final_default unknown ❌ 1200.02000 1199.58000
Z3string Z3str4 SMTCOMP2020 v1.1_default unknown ❌ 1200.10000 1200.02000
SMT-COMP 2021 0.75 (1/4) CVC4 CVC4-sq-final_default unknown ❌ 1200.08000 1199.90000
cvc5 cvc5-fixed_default unknown ❌ 1200.02000 1196.00000
Z3 z3-4.8.11_default unknown ❌ 1200.02000 1199.89000
Z3string Z3str4 SMTCOMP 2021 v1.1_default unsat ✅ 1.66939 1.66958
SMT-COMP 2022 0.60 (2/5) CVC4 CVC4-sq-final_default unknown ❌ 1200.04000 1186.06000
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.02000 1199.59000
OSTRICH OSTRICH 1.2_def unsat ✅ 1.80902 3.30828
Z3 z3-4.8.17_default unknown ❌ 1200.02000 1199.58000
Z3string Z3str4_default unsat ✅ 23.78830 23.78680
SMT-COMP 2023 0.25 (3/4) cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.12000 1199.68000
cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.02000 1199.63000
OSTRICH OSTRICH 1.3 SMT-COMP fixed_def unsat ✅ 1.88686 3.48829
Z3alpha z3alpha_default unsat ✅ 23.91300 23.91020
Z3-Noodler Z3-Noodler_default unsat ✅ 0.03434 0.03430
Z3-Noodler_default unsat ✅ 0.03422 0.03417
SMT-COMP 2024 0.25 (3/4) cvc5 cvc5 unknown ❌ 1201.71625 1200.70418
OSTRICH OSTRICH unsat ✅ 1.86763 3.74313
Z3alpha Z3-alpha unsat ✅ 1076.76280 1076.56005
Z3-Noodler Z3-Noodler unsat ✅ 0.24037 0.14078
SMT-COMP 2025 0.50 (3/6) cvc5 cvc5 unknown ❌ 1201.79228 1201.06095
OSTRICH OSTRICH unsat ✅ 1.32148 2.21849
Z3alpha Z3-alpha unknown ❌ 1201.00499 4803.18485
Z3 Z3-alpha-base unknown ❌ 1201.55146 1201.29160
Z3-Noodler-base unknown ❌ 1201.87988 1201.60365
Z3-Noodler Z3-Noodler unsat ✅ 0.29978 0.17238
Z3-Noodler-Mocha-base unsat ✅ 0.25937 0.14187
Z3-Noodler-Mocha Z3-Noodler-Mocha unsat ✅ 0.27484 0.14807