Target-Oriented Statistical Compression: Sufficiency, Reverse Martingales, and Sequential Monitoring
Abstract
Statistical procedures rarely retain all features of the observed data. A sufficient statistic removes information irrelevant to a parameter; a maximum likelihood estimate compresses an empirical objective into an optimizing point; and a hidden state in a sequential model compresses past observations into a learned representation. This article develops these practices under the unified notion of \emph{target-oriented statistical compression}: a useful summary preserves what matters for an inferential, predictive, or decision-relevant target, rather than every detail of the realized data path. The central object is the conditional target process , where is the target and is the information retained by the compression map . When is a decreasing filtration, is a reverse martingale with limit . Exact sufficiency corresponds to lossless compression, while approximate summaries such as penalized estimators, principal components, and neural-network hidden states produce reverse quasi-martingale defects measuring coherence loss across compression levels. The diagnostic is treated as an observable stability proxy, not as an unbiased estimator of the theoretical defect. Boundary degeneracy in sequential binary problems is developed as a central application. Practical boundary claims require joint assessment of boundary closeness, uncertainty control, and trajectory stability. The companion paper \citet{chang2025rm} develops the corresponding stopping procedures, finite-sample bounds, and numerical evidence; the present paper provides the broader theoretical infrastructure and extends the framework to Gaussian, Poisson, and quasi-martingale monitoring problems.
Cite
@article{arxiv.2605.26568,
title = {Target-Oriented Statistical Compression: Sufficiency, Reverse Martingales, and Sequential Monitoring},
author = {Yuan-chin Ivan Chang},
journal= {arXiv preprint arXiv:2605.26568},
year = {2026}
}
Comments
28 pages, 9 figures