English

Expectation-Maximization as a Spectrally Governed Relaxation Flow

Machine Learning 2026-05-11 v1 Statistics Theory Statistics Theory

Abstract

The expectation--maximization (EM) algorithm combines global monotonicity, local linear convergence, and strong practical robustness, but these features are usually analyzed separately. Global descent is nonlinear, whereas local convergence is governed by the spectrum of the linearized EM map. How these two levels fit into a single dynamical picture has remained less transparent. We make explicit the latent-variable operator that connects them. Along the EM trajectory, the likelihood increment admits a global energy decomposition in terms of posterior-relative entropy. Linearization at a nondegenerate maximizer θ\theta^\ast then reveals the local operator Gθ=IDT(θ), \mathcal G_{\theta^\ast}=I-DT(\theta^\ast), which coincides with both the missing-information ratio and the information-geometric Hessian of the observed likelihood. This operator provides a unified description of local contraction, posterior rigidity, and geometric curvature. Its spectrum yields a sharp characterization of local convergence and naturally leads to an optimal scalar relaxation rule for locally accelerated EM. These results place global descent, local spectral behavior, and optimal local relaxation within a common dynamical framework.

Keywords

Cite

@article{arxiv.2605.07818,
  title  = {Expectation-Maximization as a Spectrally Governed Relaxation Flow},
  author = {Qiao Wang},
  journal= {arXiv preprint arXiv:2605.07818},
  year   = {2026}
}

Comments

This is a continuous research following my work titled "Relaxation Kernel and Global Convergence of the Blahut-Arimoto Dynamics" at https://doi.org/10.48550/arXiv.2604.25106

R2 v1 2026-07-01T12:57:54.387Z