English

Consistent Kernel Change-Point Detection under m-Dependence for Text Segmentation

Machine Learning 2026-01-27 v2 Computation and Language Machine Learning

Abstract

Kernel change-point detection (KCPD) has become a widely used tool for identifying structural changes in complex data. While existing theory establishes consistency under independence assumptions, real-world sequential data such as text exhibits strong dependencies. We establish new guarantees for KCPD under mm-dependent data: specifically, we prove consistency in the number of detected change points and weak consistency in their locations under mild additional assumptions. We perform an LLM-based simulation that generates synthetic mm-dependent text to validate the asymptotics. To complement these results, we present the first comprehensive empirical study of KCPD for text segmentation with modern embeddings. Across diverse text datasets, KCPD with text embeddings outperforms baselines in standard text segmentation metrics. We demonstrate through a case study on Taylor Swift's tweets that KCPD not only provides strong theoretical and simulated reliability but also practical effectiveness for text segmentation tasks.

Keywords

Cite

@article{arxiv.2510.03437,
  title  = {Consistent Kernel Change-Point Detection under m-Dependence for Text Segmentation},
  author = {Jairo Diaz-Rodriguez and Mumin Jia},
  journal= {arXiv preprint arXiv:2510.03437},
  year   = {2026}
}

Comments

This paper is withdrawn due to an error in the proof of Proposition 3, which is used to support Theorem 1

R2 v1 2026-07-01T06:16:10.060Z