English
Related papers

Related papers: Universal Approximation Theorem for Equivariant Ma…

200 papers

Supervised learning with deep models has tremendous potential for applications in materials science. Recently, graph neural networks have been used in this context, drawing direct inspiration from models for molecules. However, materials…

Materials Science · Physics 2023-01-18 Sékou-Oumar Kaba , Siamak Ravanbakhsh

Convolutional neural networks or standard CNNs (StdCNNs) are translation-equivariant models that achieve translation invariance when trained on data augmented with sufficient translations. Recent work on equivariant models for a given group…

Machine Learning · Computer Science 2020-06-09 Sandesh Kamath , Amit Deshpande , K V Subrahmanyam

Convolutional neural networks (CNNs) have achieved state-of-the-art results on many visual recognition tasks. However, current CNN models still exhibit a poor ability to be invariant to spatial transformations of images. Intuitively, with…

Computer Vision and Pattern Recognition · Computer Science 2019-12-04 Xu Shen , Xinmei Tian , Anfeng He , Shaoyan Sun , Dacheng Tao

We review a novel neural network architecture called lattice gauge equivariant convolutional neural networks (L-CNNs), which can be applied to generic machine learning problems in lattice gauge theory while exactly preserving gauge…

High Energy Physics - Lattice · Physics 2021-11-09 Matteo Favoni , Andreas Ipp , David I. Müller , Daniel Schuh

Neural ordinary differential equations (NODEs) is an invertible neural network architecture promising for its free-form Jacobian and the availability of a tractable Jacobian determinant estimator. Recently, the representation power of NODEs…

Machine Learning · Computer Science 2020-12-07 Takeshi Teshima , Koichi Tojo , Masahiro Ikeda , Isao Ishikawa , Kenta Oono

PDE-based Group Convolutional Neural Networks (PDE-G-CNNs) use solvers of evolution PDEs as substitutes for the conventional components in G-CNNs. PDE-G-CNNs can offer several benefits simultaneously: fewer parameters, inherent…

Machine Learning · Computer Science 2024-11-21 Gijs Bellaard , Sei Sakata , Bart M. N. Smets , Remco Duits

Convolutional Neural Networks(CNNs) has achieved remarkable performance breakthrough in Euclidean structure data. Recently, aggregation-transformation based Graph Neural networks(GNNs) gradually produce a powerful performance on…

Machine Learning · Computer Science 2021-02-05 Jingzhao Hu , Xiaoqi Zhang , Qiaomei Jia , Chen Wang , Qirong Bu , Jun Feng

Lattice gauge equivariant convolutional neural networks (L-CNNs) are a framework for convolutional neural networks that can be applied to non-Abelian lattice gauge theories without violating gauge symmetry. We demonstrate how L-CNNs can be…

High Energy Physics - Lattice · Physics 2023-03-22 Jimmy Aronsson , David I. Müller , Daniel Schuh

Correspondence matching is a fundamental problem in computer vision and robotics applications. Solving correspondence matching problems using neural networks has been on the rise recently. Rotation-equivariance and scale-equivariance are…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Shuai Su , Zhongkai Zhao , Yixin Fei , Shuda Li , Qijun Chen , Rui Fan

Graph Neural Networks (GNNs), neural network architectures targeted to learning representations of graphs, have become a popular learning model for prediction tasks on nodes, graphs and configurations of points, with wide success in…

Machine Learning · Computer Science 2022-04-19 Stefanie Jegelka

Most equivariant neural networks rely on a single global symmetry, limiting their use in domains where symmetries are instead local. We introduce Torsor CNNs, a framework for learning on graphs with local symmetries encoded as edge…

Machine Learning · Computer Science 2025-10-28 Daiyuan Li , Shreya Arya , Robert Ghrist

Motivated by the Central Limit Theorem, in this paper, we study both universal and non-universal simulations of random variables with an arbitrary target distribution $Q_{Y}$ by general mappings, not limited to linear ones (as in the…

Probability · Mathematics 2018-12-05 Lei Yu

Group convolutions and cross-correlations, which are equivariant to the actions of group elements, are commonly used in mathematics to analyze or take advantage of symmetries inherent in a given problem setting. Here, we provide efficient…

Graph neural networks (GNNs) provide state-of-the-art results in a wide variety of tasks which typically involve predicting features at the vertices of a graph. They are built from layers of graph convolutions which serve as a powerful…

Machine Learning · Statistics 2024-11-08 Mauricio Velasco , Kaiying O'Hare , Bernardo Rychtenberg , Soledad Villar

Convolutional neural networks (CNNs) are widely used for image recognition and text analysis, and have been suggested for application on one-dimensional data as a way to reduce the need for pre-processing steps. Pre-processing is an…

Machine Learning · Computer Science 2020-05-18 Ine L. Jernelv , Dag Roar Hjelme , Yuji Matsuura , Astrid Aksnes

The ability of convolutional neural networks (CNNs) to recognize objects regardless of their position in the image is due to the translation-equivariance of the convolutional operation. Group-equivariant CNNs transfer this equivariance to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Thomas Wimmer , Vladimir Golkov , Hoai Nam Dang , Moritz Zaiss , Andreas Maier , Daniel Cremers

Graph Convolutional Neural Networks (Graph CNNs) are generalizations of classical CNNs to handle graph data such as molecular data, point could and social networks. Current filters in graph CNNs are built for fixed and shared graph…

Machine Learning · Computer Science 2018-01-11 Ruoyu Li , Sheng Wang , Feiyun Zhu , Junzhou Huang

Simplicial map neural networks (SMNNs) are topology-based neural networks with interesting properties such as universal approximation ability and robustness to adversarial examples under appropriate conditions. However, SMNNs present some…

Machine Learning · Computer Science 2024-03-22 Eduardo Paluzo-Hidalgo , Miguel A. Gutiérrez-Naranjo , Rocio Gonzalez-Diaz

We present a general framework for symmetrizing an arbitrary neural-network architecture and making it equivariant with respect to a given group. We build upon the proposals of Kim et al. (2023); Kaba et al. (2023) for symmetrization, and…

Machine Learning · Computer Science 2023-11-14 Tien Dat Nguyen , Jinwoo Kim , Hongseok Yang , Seunghoon Hong

Quantum neural networks (QNNs) are an analog of classical neural networks in the world of quantum computing, which are represented by a unitary matrix with trainable parameters. Inspired by the universal approximation property of classical…

Quantum Physics · Physics 2025-11-27 Ariel Neufeld , Philipp Schmocker , Viet Khoa Tran