English

Neural Operators Can Discover Functional Clusters

Machine Learning 2026-03-02 v1 Computational Engineering, Finance, and Science Computation Machine Learning

Abstract

Operator learning is reshaping scientific computing by amortizing inference across infinite families of problems. While neural operators (NOs) are increasingly well understood for regression, far less is known for classification and its unsupervised analogue: clustering. We prove that sample-based neural operators can learn any finite collection of classes in an infinite-dimensional reproducing kernel Hilbert space, even when the classes are neither convex nor connected, under mild kernel sampling assumptions. Our universal clustering theorem shows that any KK closed classes can be approximated to arbitrary precision by NO-parameterized classes in the upper Kuratowski topology on closed sets, a notion that can be interpreted as disallowing false-positive misclassifications. Building on this, we develop an NO-powered clustering pipeline for functional data and apply it to unlabeled families of ordinary differential equation (ODE) trajectories. Discretized trajectories are lifted by a fixed pre-trained encoder into a continuous feature map and mapped to soft assignments by a lightweight trainable head. Experiments on diverse synthetic ODE benchmarks show that the resulting practical SNO recovers latent dynamical structure in regimes where classical methods fail, providing evidence consistent with our universal clustering theory.

Keywords

Cite

@article{arxiv.2602.23528,
  title  = {Neural Operators Can Discover Functional Clusters},
  author = {Yicen Li and Jose Antonio Lara Benitez and Ruiyang Hong and Anastasis Kratsios and Paul David McNicholas and Maarten Valentijn de Hoop},
  journal= {arXiv preprint arXiv:2602.23528},
  year   = {2026}
}
R2 v1 2026-07-01T10:54:39.998Z