English

Gradient flow for finding E-optimal designs

Optimization and Control 2026-04-17 v2 Computation

Abstract

The EE-optimality criterion for a regression model maximizes the smallest eigenvalue of the information matrix and becomes non-differentiable when this eigenvalue has multiplicity greater than one. Working in the 22-Wasserstein space, we show that the Wasserstein gradient at an empirical measure coincides, up to a constant factor, with the Euclidean particle gradient for smooth criteria such as DD- and LL-optimality, and that the approximation gap for equal-weight NN-particle designs vanishes at an explicit rate. The main challenge is the nonsmooth EE-criterion, for which the Wasserstein gradient does not exist. We replace it with a constrained Wasserstein steepest-ascent field obtained by maximizing feasible directional derivatives over the tangent cone of the design space, and prove that the resulting flow satisfies an exact energy identity and that every limit point is first-order stationary. The particle ascent computation reduces to a convex semidefinite programme whose dimension equals the multiplicity of the smallest eigenvalue. In numerical comparisons on second-order response surface models and a seven-dimensional logistic regression model, the constrained Wasserstein steepest-ascent method attains near-optimal EE-criterion values and is markedly more reliable than particle swarm optimization in higher-dimensional settings. The framework applies more broadly to other nonsmooth minimax criteria in optimal design, and a numerical experiment on the minimax-single-parameter criterion confirms that the method attains the theoretical optimum.

Keywords

Cite

@article{arxiv.2601.14147,
  title  = {Gradient flow for finding E-optimal designs},
  author = {Jieling Shi and Kim-Chuan Toh and Xin T. Tong and Weng Kee Wong},
  journal= {arXiv preprint arXiv:2601.14147},
  year   = {2026}
}

Comments

44 pages, 3 figures