Benchmark

non-incremental/QF_SLIA/20180523-Reynolds/pyex/peterc-pyex-doc-cav17-zz/httplib2/httplib2-entry-disposition/fac1e9c1cc49eb4d4e498ca6ca77a1321fe98c6b4c4962bf0c9d0bc8.smt2

Publications: "Scaling Up DPLL(T) String Solvers Using Context-Dependent Simplification" by A. Reynolds, M. Woo, C. Barrett, D. Brumley, T. Liang, and C. Tinelli, CAV 2017.
Benchmark
Size33702
Compressed Size1345
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2018-07-14
Generated ByAndrew Reynolds
Generated On2018-04-25 00:00:00
GeneratorPyEx, converted to v2.6 by CVC4
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unknown
Inferred Status sat
Size 33693
Compressed Size1339
Max. Term Depth437
Asserts 1
Declared Functions0
Declared Constants4
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite110 not214 and427 =160
+214 -403 >=318 str.len113
str.++19 str.substr223 str.contains60 str.replace19
str.indexof473 str.at36

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.31774 0.31796
SMT-COMP 2020 0.50 (1/2) CVC4 CVC4-sq-final_default sat ✅ 0.32921 0.32955
Z3string Z3str4 SMTCOMP2020 v1.1_default unknown ❌ 1200.04000 1200.43000
SMT-COMP 2021 CVC4 CVC4-sq-final_default sat ✅ 0.33651 0.33687
cvc5 cvc5-fixed_default sat ✅ 0.30431 0.30472
Z3 z3-4.8.11_default sat ✅ 1.12391 1.12369
Z3string Z3str4 SMTCOMP 2021 v1.1_default sat ✅ 0.45106 0.45106
SMT-COMP 2022 0.20 (4/5) CVC4 CVC4-sq-final_default sat ✅ 0.33177 0.33201
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 0.47558 0.47518
OSTRICH OSTRICH 1.2_def unknown ❌ 1200.03000 1298.03000
Z3 z3-4.8.17_default sat ✅ 0.35573 0.35763
Z3string Z3str4_default sat ✅ 0.10365 0.10373
SMT-COMP 2024 0.25 (3/4) cvc5 cvc5 sat ✅ 0.36292 0.26306
OSTRICH OSTRICH unknown ❌ 1201.32346 1353.50998
Z3alpha Z3-alpha sat ✅ 0.32236 0.22231
Z3-Noodler Z3-Noodler sat ✅ 0.58756 0.48776
SMT-COMP 2025 cvc5 cvc5 sat ✅ 0.41946 0.30164
OSTRICH OSTRICH sat ✅ 4.55248 13.35710
Z3alpha Z3-alpha sat ✅ 0.59592 1.16656
Z3 Z3-alpha-base sat ✅ 0.42234 0.30802
Z3-Noodler-base sat ✅ 0.43088 0.30760
Z3-Noodler Z3-Noodler sat ✅ 0.54307 0.42370
Z3-Noodler-Mocha-base sat ✅ 0.55254 0.43669
Z3-Noodler-Mocha Z3-Noodler-Mocha sat ✅ 0.57864 0.45081