English
Related papers

Related papers: E(n) Equivariant Graph Neural Networks

200 papers

We explore the use of graph neural networks (GNNs) to model spatial processes in which there is no a priori graphical structure. Similar to finite element analysis, we assign nodes of a GNN to spatial locations and use a computational…

Machine Learning · Computer Science 2019-11-19 Ferran Alet , Adarsh K. Jeewajee , Maria Bauza , Alberto Rodriguez , Tomas Lozano-Perez , Leslie Pack Kaelbling

Various classes of Graph Neural Networks (GNN) have been proposed and shown to be successful in a wide range of applications with graph structured data. In this paper, we propose a theoretical framework able to compare the expressive power…

Machine Learning · Computer Science 2021-06-08 Waïss Azizian , Marc Lelarge

Graphs are one of the most important data structures for representing pairwise relations between objects. Specifically, a graph embedded in a Euclidean space is essential to solving real problems, such as physical simulations. A crucial…

Machine Learning · Computer Science 2021-03-11 Masanobu Horie , Naoki Morita , Toshiaki Hishinuma , Yu Ihara , Naoto Mitsume

Graph Neural Networks (GNNs) are widely used deep learning models that learn meaningful representations from graph-structured data. Due to the finite nature of the underlying recurrent structure, current GNN methods may struggle to capture…

Machine Learning · Computer Science 2021-06-02 Fangda Gu , Heng Chang , Wenwu Zhu , Somayeh Sojoudi , Laurent El Ghaoui

We present e3nn, a generalized framework for creating E(3) equivariant trainable functions, also known as Euclidean neural networks. e3nn naturally operates on geometry and geometric tensors that describe systems in 3D and transform…

Machine Learning · Computer Science 2022-07-21 Mario Geiger , Tess Smidt

Graph Neural Networks (GNNs) with equivariant properties have emerged as powerful tools for modeling complex dynamics of multi-object physical systems. However, their generalization ability is limited by the inadequate consideration of…

Machine Learning · Computer Science 2024-03-13 Yang Liu , Jiashun Cheng , Haihong Zhao , Tingyang Xu , Peilin Zhao , Fugee Tsung , Jia Li , Yu Rong

While (message-passing) graph neural networks have clear limitations in approximating permutation-equivariant functions over graphs or general relational data, more expressive, higher-order graph neural networks do not scale to large…

Machine Learning · Computer Science 2022-08-31 Christopher Morris , Gaurav Rattan , Sandra Kiefer , Siamak Ravanbakhsh

In this paper, we present a hypergraph neural networks (HGNN) framework for data representation learning, which can encode high-order data correlation in a hypergraph structure. Confronting the challenges of learning representation for…

Machine Learning · Computer Science 2019-02-26 Yifan Feng , Haoxuan You , Zizhao Zhang , Rongrong Ji , Yue Gao

Convolutional neural networks (CNN) have been frequently used to extract subject-invariant features from electroencephalogram (EEG) for classification tasks. This approach holds the underlying assumption that electrodes are equidistant…

Machine Learning · Computer Science 2021-06-18 Andac Demir , Toshiaki Koike-Akino , Ye Wang , Masaki Haruna , Deniz Erdogmus

We propose a general architecture that combines the coefficient learning scheme with a residual operator layer for learning mappings between continuous functions in the 3D Euclidean space. Our proposed model is guaranteed to achieve…

Machine Learning · Computer Science 2023-11-21 Chaoran Cheng , Jian Peng

Graph neural networks (GNNs) are powerful tools for handling graph-structured data. However, their design often limits them to learning only higher-order feature interactions, leaving low-order feature interactions overlooked. To address…

Machine Learning · Computer Science 2024-06-14 Minkyu Kim , Hyun-Soo Choi , Jinho Kim

Most existing neural networks for learning graphs address permutation invariance by conceiving of the network as a message passing scheme, where each node sums the feature vectors coming from its neighbors. We argue that this imposes a…

Machine Learning · Computer Science 2018-01-09 Risi Kondor , Hy Truong Son , Horace Pan , Brandon Anderson , Shubhendu Trivedi

Learning representations for graphs plays a critical role in a wide spectrum of downstream applications. In this paper, we summarize the limitations of the prior works in three folds: representation space, modeling dynamics and modeling…

Machine Learning · Computer Science 2021-04-07 Li Sun , Zhongbao Zhang , Jiawei Zhang , Feiyang Wang , Hao Peng , Sen Su , Philip S. Yu

Learning from graph-structured data is an important task in machine learning and artificial intelligence, for which Graph Neural Networks (GNNs) have shown great promise. Motivated by recent advances in geometric representation learning, we…

Machine Learning · Computer Science 2019-10-30 Qi Liu , Maximilian Nickel , Douwe Kiela

Recently a variety of methods have been developed to encode graphs into low-dimensional vectors that can be easily exploited by machine learning algorithms. The majority of these methods start by embedding the graph nodes into a…

Machine Learning · Computer Science 2018-09-13 Yu Jin , Joseph F. JaJa

The message-passing scheme is the core of graph representation learning. While most existing message-passing graph neural networks (MPNNs) are permutation-invariant in graph-level representation learning and permutation-equivariant in node-…

Machine Learning · Computer Science 2022-11-22 Chang Liu , Yuwen Yang , Yue Ding , Hongtao Lu

Previous work on symmetric group equivariant neural networks generally only considered the case where the group acts by permuting the elements of a single vector. In this paper we derive formulae for general permutation equivariant layers,…

Machine Learning · Computer Science 2020-04-09 Erik Henning Thiede , Truong Son Hy , Risi Kondor

Including covariant information, such as position, force, velocity or spin is important in many tasks in computational physics and chemistry. We introduce Steerable E(3) Equivariant Graph Neural Networks (SEGNNs) that generalise equivariant…

Machine Learning · Computer Science 2022-03-29 Johannes Brandstetter , Rob Hesselink , Elise van der Pol , Erik J Bekkers , Max Welling

This paper introduces a generative model equivariant to Euclidean symmetries: E(n) Equivariant Normalizing Flows (E-NFs). To construct E-NFs, we take the discriminative E(n) graph neural networks and integrate them as a differential…

Machine Learning · Computer Science 2022-01-17 Victor Garcia Satorras , Emiel Hoogeboom , Fabian B. Fuchs , Ingmar Posner , Max Welling

In this paper, we propose a novel edge-labeling graph neural network (EGNN), which adapts a deep neural network on the edge-labeling graph, for few-shot learning. The previous graph neural network (GNN) approaches in few-shot learning have…

Machine Learning · Computer Science 2019-05-07 Jongmin Kim , Taesup Kim , Sungwoong Kim , Chang D. Yoo