English

Interrelation of equivariant Gaussian processes and convolutional neural networks

Machine Learning 2023-03-01 v1 Artificial Intelligence

Abstract

Currently there exists rather promising new trend in machine leaning (ML) based on the relationship between neural networks (NN) and Gaussian processes (GP), including many related subtopics, e.g., signal propagation in NNs, theoretical derivation of learning curve for NNs, QFT methods in ML, etc. An important feature of convolutional neural networks (CNN) is their equivariance (consistency) with respect to the symmetry transformations of the input data. In this work we establish a relationship between the many-channel limit for CNNs equivariant with respect to two-dimensional Euclidean group with vector-valued neuron activations and the corresponding independently introduced equivariant Gaussian processes (GP).

Keywords

Cite

@article{arxiv.2209.08371,
  title  = {Interrelation of equivariant Gaussian processes and convolutional neural networks},
  author = {Andrey Demichev and Alexander Kryukov},
  journal= {arXiv preprint arXiv:2209.08371},
  year   = {2023}
}

Comments

5 pages. Presented at the ACAT 2021: 20th International Workshop on Advanced Computing and Analysis Techniques in Physics Research, Daejeon, Kr, 29 Nov - 3 Dec 2021

R2 v1 2026-06-28T01:30:25.142Z