English

Optimal Change-Point Detection with Training Sequences in the Large and Moderate Deviations Regimes

Information Theory 2021-10-05 v4 Machine Learning math.IT Statistics Theory Machine Learning Statistics Theory

Abstract

This paper investigates a novel offline change-point detection problem from an information-theoretic perspective. In contrast to most related works, we assume that the knowledge of the underlying pre- and post-change distributions are not known and can only be learned from the training sequences which are available. We further require the probability of the \emph{estimation error} to decay either exponentially or sub-exponentially fast (corresponding respectively to the large and moderate deviations regimes in information theory parlance). Based on the training sequences as well as the test sequence consisting of a single change-point, we design a change-point estimator and further show that this estimator is optimal by establishing matching (strong) converses. This leads to a full characterization of the optimal confidence width (i.e., half the width of the confidence interval within which the true change-point is located at with high probability) as a function of the undetected error, under both the large and moderate deviations regimes.

Keywords

Cite

@article{arxiv.2003.06511,
  title  = {Optimal Change-Point Detection with Training Sequences in the Large and Moderate Deviations Regimes},
  author = {Haiyun He and Qiaosheng Zhang and Vincent Y. F. Tan},
  journal= {arXiv preprint arXiv:2003.06511},
  year   = {2021}
}

Comments

27 pages, 11 figures

R2 v1 2026-06-23T14:14:30.884Z