English
Related papers

Related papers: Interrelation of equivariant Gaussian processes an…

200 papers

Convolutional neural networks (CNN) have been frequently used to extract subject-invariant features from electroencephalogram (EEG) for classification tasks. This approach holds the underlying assumption that electrodes are equidistant…

Machine Learning · Computer Science 2021-06-18 Andac Demir , Toshiaki Koike-Akino , Ye Wang , Masaki Haruna , Deniz Erdogmus

The interpretability of Convolutional Neural Networks (CNNs) is an important topic in the field of computer vision. In recent years, works in this field generally adopt a mature model to reveal the internal mechanism of CNNs, helping to…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 Hao Ge , Xiaoguang Tu , Yanxiang Gong , Mei Xie , Zheng Ma

To read the final version please go to IEEE TGRS on IEEE Xplore. Convolutional neural networks (CNNs) have been attracting increasing attention in hyperspectral (HS) image classification, owing to their ability to capture spatial-spectral…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Danfeng Hong , Lianru Gao , Jing Yao , Bing Zhang , Antonio Plaza , Jocelyn Chanussot

Most current deep learning models equivariant to $O(n)$ or $SO(n)$ either consider mostly scalar information such as distances and angles or have a very high computational complexity. In this work, we test a few novel message passing graph…

Machine Learning · Computer Science 2024-07-11 Cong Liu , David Ruhe , Patrick Forré

Convolutional Neural Networks (CNN) have been successful in processing data signals that are uniformly sampled in the spatial domain (e.g., images). However, most data signals do not natively exist on a grid, and in the process of being…

Computer Vision and Pattern Recognition · Computer Science 2019-01-09 Chiyu "Max" Jiang , Dequan Wang , Jingwei Huang , Philip Marcus , Matthias Nießner

Convolutional Neural Networks(CNN) are inherently equivariant under translations, however, they do not have an equivalent embedded mechanism to handle other transformations such as rotations and change in scale. Several approaches exist…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Naman Khetan , Tushar Arora , Samee Ur Rehman , Deepak K. Gupta

We propose Lattice gauge equivariant Convolutional Neural Networks (L-CNNs) for generic machine learning applications on lattice gauge theoretical problems. At the heart of this network structure is a novel convolutional layer that…

High Energy Physics - Lattice · Physics 2022-02-22 Matteo Favoni , Andreas Ipp , David I. Müller , Daniel Schuh

We present the group equivariant conditional neural process (EquivCNP), a meta-learning method with permutation invariance in a data set as in conventional conditional neural processes (CNPs), and it also has transformation equivariance in…

Machine Learning · Computer Science 2021-02-18 Makoto Kawano , Wataru Kumagai , Akiyoshi Sannai , Yusuke Iwasawa , Yutaka Matsuo

Graph Neural Network (GNN) is a powerful tool to perform standard machine learning on graphs. To have a Euclidean representation of every node in the Non-Euclidean graph-like data, GNN follows neighbourhood aggregation and combination of…

Machine Learning · Computer Science 2021-11-18 Sucheta Dawn , Sanghamitra Bandyopadhyay

We explain equivariant neural networks, a notion underlying breakthroughs in machine learning from deep convolutional neural networks for computer vision to AlphaFold 2 for protein structure prediction, without assuming knowledge of…

Machine Learning · Computer Science 2022-11-18 Lek-Heng Lim , Bradley J. Nelson

There has been a recent surge of interest in modeling neural networks (NNs) as Gaussian processes. In the limit of a NN of infinite width the NN becomes equivalent to a Gaussian process. Here we demonstrate that for an ensemble of large,…

Machine Learning · Computer Science 2019-08-28 Joseph M. Antognini

Deep Convolutional Neural Networks (CNNs) are capable of learning unprecedentedly effective features from images. Some researchers have struggled to enhance the parameters' efficiency using grouped convolution. However, the relation between…

Computer Vision and Pattern Recognition · Computer Science 2017-06-22 Yujia Chen , Ce Li

A recent line of works studied wide deep neural networks (DNNs) by approximating them as Gaussian Processes (GPs). A DNN trained with gradient flow was shown to map to a GP governed by the Neural Tangent Kernel (NTK), whereas earlier works…

Machine Learning · Statistics 2021-12-15 Gadi Naveh , Oded Ben-David , Haim Sompolinsky , Zohar Ringel

Credible forecasting and representation learning of dynamical systems are of ever-increasing importance for reliable decision-making. To that end, we propose a family of Gaussian processes (GP) for dynamical systems with linear…

Machine Learning · Computer Science 2025-02-11 Petar Bevanda , Max Beier , Armin Lederer , Alexandre Capone , Stefan Sosnowski , Sandra Hirche

Graph convolutional networks (GCNs) are \emph{discriminative models} that directly model the class posterior $p(y|\mathbf{x})$ for semi-supervised classification of graph data. While being effective, as a representation learning approach,…

Machine Learning · Computer Science 2023-05-30 Tianchun Wang , Farzaneh Mirzazadeh , Xiang Zhang , Jie Chen

Group equivariant convolutional neural networks (G-CNNs) are generalizations of convolutional neural networks (CNNs) which excel in a wide range of technical applications by explicitly encoding symmetries, such as rotations and…

Machine Learning · Computer Science 2022-09-14 Hannah Lawrence , Kristian Georgiev , Andrew Dienes , Bobak T. Kiani

Recently, a Gaussian Process Regression - neural network (GPRNN) hybrid machine learning method was proposed, which is based on additive-kernel GPR in redundant coordinates constructed by rules [J. Phys. Chem. A 127 (2023) 7823]. The method…

Machine Learning · Statistics 2025-12-29 Sergei Manzhos , Manabu Ihara

Graph Convolutional Networks (GCNs) have become a pivotal method in machine learning for modeling functions over graphs. Despite their widespread success across various applications, their statistical properties (e.g., consistency,…

Machine Learning · Computer Science 2025-04-17 Juntong Chen , Johannes Schmidt-Hieber , Claire Donnat , Olga Klopp

This paper introduces a generative model equivariant to Euclidean symmetries: E(n) Equivariant Normalizing Flows (E-NFs). To construct E-NFs, we take the discriminative E(n) graph neural networks and integrate them as a differential…

Machine Learning · Computer Science 2022-01-17 Victor Garcia Satorras , Emiel Hoogeboom , Fabian B. Fuchs , Ingmar Posner , Max Welling

Graph neural networks (GNNs) have demonstrated remarkable capabilities in learning from graph-structured data, often outperforming traditional Multilayer Perceptrons (MLPs) in numerous graph-based tasks. Although existing works have…

Machine Learning · Computer Science 2025-06-09 Wei Huang , Yuan Cao , Haonan Wang , Xin Cao , Taiji Suzuki