English

Target-Oriented Statistical Compression: Sufficiency, Reverse Martingales, and Sequential Monitoring

Methodology 2026-05-27 v1 Information Theory math.IT Statistics Theory Statistics Theory

Abstract

Statistical procedures rarely retain all features of the observed data. A sufficient statistic removes information irrelevant to a parameter; a maximum likelihood estimate compresses an empirical objective into an optimizing point; and a hidden state in a sequential model compresses past observations into a learned representation. This article develops these practices under the unified notion of \emph{target-oriented statistical compression}: a useful summary preserves what matters for an inferential, predictive, or decision-relevant target, rather than every detail of the realized data path. The central object is the conditional target process Mn=\E(Z\given\Gn)M_n=\E(Z\given\G_n), where ZZ is the target and \Gn=σ(Tn)\G_n=\sigma(T_n) is the information retained by the compression map TnT_n. When (\Gn)(\G_n) is a decreasing filtration, (Mn)(M_n) is a reverse martingale with limit M=\E(Z\given\G)M_\infty=\E(Z\given\G_\infty). Exact sufficiency corresponds to lossless compression, while approximate summaries such as penalized estimators, principal components, and neural-network hidden states produce reverse quasi-martingale defects measuring coherence loss across compression levels. The diagnostic rn=MnMn1r_n=|M_n-M_{n-1}| is treated as an observable stability proxy, not as an unbiased estimator of the theoretical defect. Boundary degeneracy in sequential binary problems is developed as a central application. Practical boundary claims require joint assessment of boundary closeness, uncertainty control, and trajectory stability. The companion paper \citet{chang2025rm} develops the corresponding stopping procedures, finite-sample bounds, and numerical evidence; the present paper provides the broader theoretical infrastructure and extends the framework to Gaussian, Poisson, and quasi-martingale monitoring problems.

Keywords

Cite

@article{arxiv.2605.26568,
  title  = {Target-Oriented Statistical Compression: Sufficiency, Reverse Martingales, and Sequential Monitoring},
  author = {Yuan-chin Ivan Chang},
  journal= {arXiv preprint arXiv:2605.26568},
  year   = {2026}
}

Comments

28 pages, 9 figures

R2 v1 2026-07-22T07:33:49.809Z