English

Generalized Hierarchical Bayesian Segmentation with Irregular Designs, Multi-Sequence Hierarchies, and Grouped/Latent-Group Designs

Machine Learning 2026-05-12 v2

Abstract

Bayesian change-point and segmentation models provide uncertainty-aware piecewise-constant representations of ordered data, but exact inference is often limited to narrow likelihood classes, single sequences, or index-uniform designs. We present \texttt{BayesBreak}, a modular offline Bayesian segmentation framework that separates local block scoring from global inference: each candidate block supplies a marginal likelihood and any needed moment numerators, while a dynamic program combines these scores to compute posteriors over segment counts, boundaries, and latent signals. For weighted exponential-family likelihoods with conjugate priors, block evidences and posterior moments are available in closed form from cumulative sufficient statistics, enabling exact sum-product inference for p(yk)p(y\mid k), p(ky)p(k\mid y), boundary marginals, and Bayes regression curves. We distinguish these summaries from the \emph{joint} MAP segmentation, recovered by a separate max-sum recursion. BayesBreak supports design-aware partition priors for irregular observations, exact pooling across replicates with shared boundaries, and latent-template mixtures with exact EM updates. For non-conjugate GLM blocks, the same DP layer can use deterministic local approximations such as Laplace, variational methods, EP, or quadrature. We prove a posterior-odds stability bound: uniform per-block log-evidence error ε\varepsilon perturbs kk-odds and boundary-odds by at most (k+k)ε(k+k')\varepsilon and 2kε2k\varepsilon. Validation includes synthetic recovery, calibration, and scaling experiments, plus four real-data illustrations: well-log geology, array-CGH copy number, equity-return volatility, and CpG-atlas methylation.

Keywords

Cite

@article{arxiv.2603.14681,
  title  = {Generalized Hierarchical Bayesian Segmentation with Irregular Designs, Multi-Sequence Hierarchies, and Grouped/Latent-Group Designs},
  author = {Omid Shams Solari},
  journal= {arXiv preprint arXiv:2603.14681},
  year   = {2026}
}
R2 v1 2026-07-01T11:21:10.496Z