Benchmark

non-incremental/QF_SLIA/2015-Norn/StringReplace/norn-benchmark-106.smt2

Publication: "String constraints for verification" by P.A. Abdulla, M.F. Atig, Y.F. Chen, L. Holík, A. Rezine, P. Rümmer, and J. Stenman, CAV 2014.
Benchmark
Size1376
Compressed Size596
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2020-07-06
Generated ByParosh Aziz Abdulla, Mohamed Faouzi Atig, Yu-Fang Chen, Lukáš Holík, Ahmed Rezine, Philipp Rümmer, Jari Stenman
Generated On2015-03-09 00:00:00
GeneratorEldarica
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unknown
Inferred Status unsat
Size 1368
Compressed Size582
Max. Term Depth6
Asserts 4
Declared Functions0
Declared Constants13
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not1 str.++1 str.to_re7 re.*4
re.range2 re.++1 re.union4 str.in_re4

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2021 1.00 (0/4) CVC4 CVC4-sq-final_default unknown ❌ 1200.02000 1199.30000
cvc5 cvc5-fixed_default unknown ❌ 1200.04000 1195.64000
Z3 z3-4.8.11_default unknown ❌ 1200.06000 1199.79000
Z3string Z3str4 SMTCOMP 2021 v1.1_default unknown ❌ 1200.02000 1199.89000
SMT-COMP 2022 0.80 (1/5) CVC4 CVC4-sq-final_default unknown ❌ 1200.07000 1067.66000
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.02000 1199.65000
OSTRICH OSTRICH 1.2_def unsat ✅ 1.74159 3.02996
Z3 z3-4.8.17_default unknown ❌ 1200.04000 1199.89000
Z3string Z3str4_default unknown ❌ 1200.03000 1199.84000
SMT-COMP 2023 0.25 (3/4) cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.03000 1199.86000
cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.02000 1199.72000
OSTRICH OSTRICH 1.3 SMT-COMP fixed_def unsat ✅ 1.81819 3.21089
Z3alpha z3alpha_default unsat ✅ 23.24250 23.24220
Z3-Noodler Z3-Noodler_default unsat ✅ 0.03392 0.03389
Z3-Noodler_default unsat ✅ 0.03407 0.03400
SMT-COMP 2024 0.25 (3/4) cvc5 cvc5 unknown ❌ 1201.71657 1201.08403
OSTRICH OSTRICH unsat ✅ 1.79821 3.41549
Z3alpha Z3-alpha unsat ✅ 1073.82014 1073.70431
Z3-Noodler Z3-Noodler unsat ✅ 0.24277 0.14247
SMT-COMP 2025 0.50 (3/6) cvc5 cvc5 unknown ❌ 1201.77401 1200.97679
OSTRICH OSTRICH unsat ✅ 1.28133 2.10465
Z3alpha Z3-alpha unknown ❌ 1201.00348 4801.62457
Z3 Z3-alpha-base unknown ❌ 1201.56195 1201.15585
Z3-Noodler-base unknown ❌ 1201.52609 1201.18511
Z3-Noodler Z3-Noodler unsat ✅ 0.28936 0.16805
Z3-Noodler-Mocha-base unsat ✅ 0.29278 0.16838
Z3-Noodler-Mocha Z3-Noodler-Mocha unsat ✅ 0.29800 0.17268