Interrelation of equivariant Gaussian processes and convolutional neural networks
Abstract
Currently there exists rather promising new trend in machine leaning (ML) based on the relationship between neural networks (NN) and Gaussian processes (GP), including many related subtopics, e.g., signal propagation in NNs, theoretical derivation of learning curve for NNs, QFT methods in ML, etc. An important feature of convolutional neural networks (CNN) is their equivariance (consistency) with respect to the symmetry transformations of the input data. In this work we establish a relationship between the many-channel limit for CNNs equivariant with respect to two-dimensional Euclidean group with vector-valued neuron activations and the corresponding independently introduced equivariant Gaussian processes (GP).
Cite
@article{arxiv.2209.08371,
title = {Interrelation of equivariant Gaussian processes and convolutional neural networks},
author = {Andrey Demichev and Alexander Kryukov},
journal= {arXiv preprint arXiv:2209.08371},
year = {2023}
}
Comments
5 pages. Presented at the ACAT 2021: 20th International Workshop on Advanced Computing and Analysis Techniques in Physics Research, Daejeon, Kr, 29 Nov - 3 Dec 2021