中文
相关论文

相关论文: The general theory of permutation equivarant neura…

200 篇论文

Neural networks that process the parameters of other neural networks find applications in domains as diverse as classifying implicit neural representations, generating neural network weights, and predicting generalization errors. However,…

Equivariant neural networks, whose hidden features transform according to representations of a group G acting on the data, exhibit training efficiency and an improved generalisation performance. In this work, we extend group invariant and…

机器学习 · 计算机科学 2024-04-15 Robin Winter , Marco Bertolini , Tuan Le , Frank Noé , Djork-Arné Clevert

Invariant and equivariant networks have been successfully used for learning images, sets, point clouds, and graphs. A basic challenge in developing such networks is finding the maximal collection of invariant and equivariant linear layers.…

机器学习 · 计算机科学 2019-05-01 Haggai Maron , Heli Ben-Hamu , Nadav Shamir , Yaron Lipman

In this draft paper, we introduce a novel architecture for graph networks which is equivariant to the Euclidean group in $n$-dimensions. The model is designed to work with graph networks in their general form and can be shown to include…

机器学习 · 计算机科学 2021-05-24 Emma Slade , Francesco Farina

While (message-passing) graph neural networks have clear limitations in approximating permutation-equivariant functions over graphs or general relational data, more expressive, higher-order graph neural networks do not scale to large…

机器学习 · 计算机科学 2022-08-31 Christopher Morris , Gaurav Rattan , Sandra Kiefer , Siamak Ravanbakhsh

Several recent papers have proposed increasing the expressive power of graph neural networks by exploiting subgraphs or other topological structures. In parallel, researchers have investigated higher order permutation equivariant networks.…

机器学习 · 统计学 2026-02-05 Andrew Hands , Tianyi Sun , Risi Kondor

Equivariance of linear neural network layers is well studied. In this work, we relax the equivariance condition to only be true in a projective sense. We propose a way to construct a projectively equivariant neural network through building…

计算机视觉与模式识别 · 计算机科学 2023-12-21 Georg Bökman , Axel Flinth , Fredrik Kahl

The introduction of convolutional layers greatly advanced the performance of neural networks on image tasks due to innately capturing a way of encoding and learning translation-invariant operations, matching one of the underlying symmetries…

计算机视觉与模式识别 · 计算机科学 2016-12-15 Nicholas Guttenberg , Nathaniel Virgo , Olaf Witkowski , Hidetoshi Aoki , Ryota Kanai

This paper introduces a new model to learn graph neural networks equivariant to rotations, translations, reflections and permutations called E(n)-Equivariant Graph Neural Networks (EGNNs). In contrast with existing methods, our work does…

机器学习 · 计算机科学 2022-02-17 Victor Garcia Satorras , Emiel Hoogeboom , Max Welling

Supervised learning with deep models has tremendous potential for applications in materials science. Recently, graph neural networks have been used in this context, drawing direct inspiration from models for molecules. However, materials…

材料科学 · 物理学 2023-01-18 Sékou-Oumar Kaba , Siamak Ravanbakhsh

Learning generative models for graph-structured data is challenging because graphs are discrete, combinatorial, and the underlying data distribution is invariant to the ordering of nodes. However, most of the existing generative models for…

机器学习 · 计算机科学 2020-03-03 Chenhao Niu , Yang Song , Jiaming Song , Shengjia Zhao , Aditya Grover , Stefano Ermon

Graph Neural Networks (GNN) come in many flavors, but should always be either invariant (permutation of the nodes of the input graph does not affect the output) or equivariant (permutation of the input permutes the output). In this paper,…

机器学习 · 计算机科学 2019-10-25 Nicolas Keriven , Gabriel Peyré

Graph neural networks (GNNs) are commonly described as being permutation equivariant with respect to node relabeling in the graph. This symmetry of GNNs is often compared to the translation equivariance of Euclidean convolution neural…

机器学习 · 统计学 2023-11-20 Ningyuan Huang , Ron Levie , Soledad Villar

The translation equivariance of convolutional layers enables convolutional neural networks to generalize well on image problems. While translation equivariance provides a powerful inductive bias for images, we often additionally desire…

机器学习 · 统计学 2020-09-25 Marc Finzi , Samuel Stanton , Pavel Izmailov , Andrew Gordon Wilson

In this paper we establish a bridge between Topological Data Analysis and Geometric Deep Learning, adapting the topological theory of group equivariant non-expansive operators (GENEOs) to act on the space of all graphs weighted on vertices…

组合数学 · 数学 2022-09-27 Faraz Ahmad , Massimo Ferri , Patrizio Frosini

Most existing neural networks for learning graphs address permutation invariance by conceiving of the network as a message passing scheme, where each node sums the feature vectors coming from its neighbors. We argue that this imposes a…

机器学习 · 计算机科学 2018-01-09 Risi Kondor , Hy Truong Son , Horace Pan , Brandon Anderson , Shubhendu Trivedi

The translation equivariance of convolutions can make convolutional neural networks translation equivariant or invariant. Equivariance to other transformations (e.g. rotations, affine transformations, scalings) may also be desirable as soon…

信号处理 · 电气工程与系统科学 2021-05-05 Mateus Sangalli , Samy Blusseau , Santiago Velasco-Forero , Jesus Angulo

The rising adoption of machine learning in high energy physics and lattice field theory necessitates the re-evaluation of common methods that are widely used in computer vision, which, when applied to problems in physics, can lead to…

高能物理 - 格点 · 物理学 2021-10-12 Srinath Bulusu , Matteo Favoni , Andreas Ipp , David I. Müller , Daniel Schuh

Many data symmetries can be described in terms of group equivariance and the most common way of encoding group equivariances in neural networks is by building linear layers that are group equivariant. In this work we investigate whether…

机器学习 · 计算机科学 2023-12-11 Georg Bökman , Fredrik Kahl

Recently, there has been great success in applying deep neural networks on graph structured data. Most work, however, focuses on either node- or graph-level supervised learning, such as node, link or graph classification or node-level…

机器学习 · 计算机科学 2021-12-15 Robin Winter , Frank Noé , Djork-Arné Clevert
‹ 上一页 1 2 3 10 下一页 ›