Benchmark

non-incremental/QF_SLIA/20180523-Reynolds/pyex/peterc-pyex-doc-cav17-td/httplib2/httplib2-entry-disposition/0e2e40ea89150200bc90d241bdfde3a3eafc9612ce1897cf85512963.smt2

Publications: "Scaling Up DPLL(T) String Solvers Using Context-Dependent Simplification" by A. Reynolds, M. Woo, C. Barrett, D. Brumley, T. Liang, and C. Tinelli, CAV 2017.
Benchmark
Size30039
Compressed Size1318
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2018-07-14
Generated ByAndrew Reynolds
Generated On2018-04-25 00:00:00
GeneratorPyEx, converted to v2.6 by CVC4
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unknown
Inferred Status sat
Size 30030
Compressed Size1310
Max. Term Depth364
Asserts 1
Declared Functions0
Declared Constants4
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite125 not245 and348 =175
+308 -269 >=224 str.len175
str.++4 str.substr136 str.contains75 str.replace4
str.indexof401 str.at36

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 5.50723 5.50091
SMT-COMP 2021 0.25 (3/4) CVC4 CVC4-sq-final_default sat ✅ 0.66657 0.66670
cvc5 cvc5-fixed_default sat ✅ 0.65950 0.65993
Z3 z3-4.8.11_default sat ✅ 5.35697 5.35687
Z3string Z3str4 SMTCOMP 2021 v1.1_default unknown ❌ 1200.04000 1200.00000
SMT-COMP 2023 0.50 (2/4) cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 0.27070 0.27059
cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 0.55500 0.55526
OSTRICH OSTRICH 1.3 SMT-COMP fixed_def unknown ❌ 1200.04000 3772.52000
Z3alpha z3alpha_default sat ✅ 0.34518 0.34523
Z3-Noodler Z3-Noodler_default unknown ❌ 381.93000 381.89000
Z3-Noodler_default unknown ❌ 517.52000 517.33000
SMT-COMP 2024 cvc5 cvc5 sat ✅ 0.42228 0.32279
OSTRICH OSTRICH sat ✅ 11.22661 35.13019
Z3alpha Z3-alpha sat ✅ 0.36824 0.26892
Z3-Noodler Z3-Noodler sat ✅ 0.50829 0.40817
SMT-COMP 2025 cvc5 cvc5 sat ✅ 0.40228 0.28436
OSTRICH OSTRICH sat ✅ 9.29789 24.73013
Z3alpha Z3-alpha sat ✅ 4.08618 13.38008
Z3 Z3-alpha-base sat ✅ 2.32922 2.21045
Z3-Noodler-base sat ✅ 1.98767 1.85993
Z3-Noodler Z3-Noodler sat ✅ 0.44696 0.32899
Z3-Noodler-Mocha-base sat ✅ 0.47661 0.34891
Z3-Noodler-Mocha Z3-Noodler-Mocha sat ✅ 0.47489 0.34833