English

Any-dimensional equivariant neural networks

Machine Learning 2024-05-01 v2 Representation Theory Machine Learning

Abstract

Traditional supervised learning aims to learn an unknown mapping by fitting a function to a set of input-output pairs with a fixed dimension. The fitted function is then defined on inputs of the same dimension. However, in many settings, the unknown mapping takes inputs in any dimension; examples include graph parameters defined on graphs of any size and physics quantities defined on an arbitrary number of particles. We leverage a newly-discovered phenomenon in algebraic topology, called representation stability, to define equivariant neural networks that can be trained with data in a fixed dimension and then extended to accept inputs in any dimension. Our approach is user-friendly, requiring only the network architecture and the groups for equivariance, and can be combined with any training procedure. We provide a simple open-source implementation of our methods and offer preliminary numerical experiments.

Keywords

Cite

@article{arxiv.2306.06327,
  title  = {Any-dimensional equivariant neural networks},
  author = {Eitan Levin and Mateo Díaz},
  journal= {arXiv preprint arXiv:2306.06327},
  year   = {2024}
}

Comments

21 pages, 2 figures

R2 v1 2026-06-28T11:01:45.434Z