English

Polynomial-Time Optimal Group Selection via the Double-Commutator Eigenvalue Problem

Machine Learning 2026-05-11 v2 Computational Complexity Information Theory math.IT

Abstract

The algebraic diversity framework generalizes temporal averaging over multiple observations to algebraic group action on a single observation for second-order statistical estimation. The central open problem in this framework is group selection\textit{group selection}: given an MM-dimensional observation with unknown covariance structure, find the finite group whose spectral decomposition best matches the covariance. Naive enumeration of all subgroups of the symmetric group SMS_M requires exponential time in MM. We prove that this combinatorial problem reduces to a generalized eigenvalue problem derived from the double commutator of the covariance matrix, yielding a polynomial-time algorithm with complexity O(d2M2+d3)O(d^2M^2 + d^3), where dd is the dimension of a generator basis. The minimum eigenvector of the double-commutator matrix directly constructs the optimal group generator in closed form, with no iterative optimization. The reduction is exact: the double-commutator minimum eigenvalue is zero if and only if the optimal generator lies in the span of the basis, and its magnitude provides a certifiable optimality gap when it does not. This problem does not appear in the standard catalogs of computational complexity (Garey and Johnson, 1979) and represents a new class linking group theory, matrix analysis, and statistical estimation. We establish connections to independent component analysis (JADE), structured matrix nearness problems, and simultaneous matrix diagonalization, and we show that the double-commutator formulation is the unique approach that is simultaneously polynomial-time, closed-form, and certifiable. We extend the framework to non-Abelian symmetry recovery via a Sequential GEVP with deflation, and add two identifiability theorems characterizing the commutant-lattice ambiguity and the dichotomy on whether Aut(R)\mathrm{Aut}(\mathbf{R}) recovers a generative subgroup or only a supergroup.

Keywords

Cite

@article{arxiv.2605.00834,
  title  = {Polynomial-Time Optimal Group Selection via the Double-Commutator Eigenvalue Problem},
  author = {Mitchell A. Thornton},
  journal= {arXiv preprint arXiv:2605.00834},
  year   = {2026}
}

Comments

v2: 2 theorems, 4 open problems, {\S}X.A correction added; 1 reference added

R2 v1 2026-07-01T12:45:33.568Z