English
Related papers

Related papers: A General Framework for Robust G-Invariance in G-E…

200 papers

Recent works show that Graph Neural Networks (GNNs) are highly non-robust with respect to adversarial attacks on both the graph structure and the node attributes, making their outcomes unreliable. We propose the first method for certifiable…

Machine Learning · Computer Science 2019-07-01 Daniel Zügner , Stephan Günnemann

Group convolutional neural networks (G-CNNs) can be used to improve classical CNNs by equipping them with the geometric structure of groups. Central in the success of G-CNNs is the lifting of feature maps to higher dimensional disentangled…

Machine Learning · Computer Science 2021-03-23 Erik J Bekkers

Graph convolutional networks (GCNs) have recently achieved great empirical success in learning graph-structured data. To address its scalability issue due to the recursive embedding of neighboring features, graph topology sampling has been…

Machine Learning · Computer Science 2023-12-12 Hongkang Li , Meng Wang , Sijia Liu , Pin-Yu Chen , Jinjun Xiong

This paper presents a novel framework for non-linear equivariant neural network layers on homogeneous spaces. The seminal work of Cohen et al. on equivariant $G$-CNNs on homogeneous spaces characterized the representation theory of such…

Machine Learning · Computer Science 2025-04-30 Elias Nyholm , Oscar Carlsson , Maurice Weiler , Daniel Persson

Downsampling layers are crucial building blocks in CNN architectures, which help to increase the receptive field for learning high-level features and reduce the amount of memory/computation in the model. In this work, we study the…

Machine Learning · Computer Science 2025-04-25 Md Ashiqur Rahman , Raymond A. Yeh

Although theoretical properties such as expressive power and over-smoothing of graph neural networks (GNN) have been extensively studied recently, its convergence property is a relatively new direction. In this paper, we investigate the…

Machine Learning · Computer Science 2022-12-23 Chen Cai , Yusu Wang

$G$-equivariant convolutional neural networks (GCNNs) is a geometric deep learning model for data defined on a homogeneous $G$-space $\mathcal{M}$. GCNNs are designed to respect the global symmetry in $\mathcal{M}$, thereby facilitating…

Machine Learning · Computer Science 2022-07-27 Jimmy Aronsson

We show the universality of depth-2 group convolutional neural networks (GCNNs) in a unified and constructive manner based on the ridgelet theory. Despite widespread use in applications, the approximation property of (G)CNNs has not been…

Machine Learning · Computer Science 2022-10-14 Sho Sonoda , Isao Ishikawa , Masahiro Ikeda

Group convolutional neural networks (G-CNNs) have been shown to increase parameter efficiency and model accuracy by incorporating geometric inductive biases. In this work, we investigate the properties of representations learned by regular…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 David M. Knigge , David W. Romero , Erik J. Bekkers

Graph augmentation has received great attention in recent years for graph contrastive learning (GCL) to learn well-generalized node/graph representations. However, mainstream GCL methods often favor randomly disrupting graphs for…

Machine Learning · Computer Science 2024-05-03 Shiyin Tan , Dongyuan Li , Renhe Jiang , Ying Zhang , Manabu Okumura

The notion of group invariance helps neural networks in recognizing patterns and features under geometric transformations. Group convolutional neural networks enhance traditional convolutional neural networks by incorporating group-based…

Machine Learning · Computer Science 2025-04-15 Ali Mohaddes , Johannes Lederer

Graph data often contain noisy and spurious correlations that mask the true causal relationships, which are essential for enabling graph models to make predictions based on the underlying causal structure of the data. Dependence on spurious…

Machine Learning · Computer Science 2026-02-23 Simi Job , Xiaohui Tao , Taotao Cai , Haoran Xie , Jianming Yong

Group equivariant neural networks have been explored in the past few years and are interesting from theoretical and practical standpoints. They leverage concepts from group representation theory, non-commutative harmonic analysis and…

Machine Learning · Computer Science 2020-05-01 Carlos Esteves

Graph neural networks (GNN) have shown great advantages in many graph-based learning tasks but often fail to predict accurately for a task-based on sets of nodes such as link/motif prediction and so on. Many works have recently proposed to…

Machine Learning · Computer Science 2022-06-24 Haorui Wang , Haoteng Yin , Muhan Zhang , Pan Li

We address the problem of improving the performance and in particular the sample complexity of deep neural networks by enforcing and guaranteeing invariances to symmetry transformations rather than learning them from data. Group-equivariant…

Machine Learning · Computer Science 2023-03-06 Matthias Rath , Alexandru Paul Condurache

We present a PDE-based framework that generalizes Group equivariant Convolutional Neural Networks (G-CNNs). In this framework, a network layer is seen as a set of PDE-solvers where geometrically meaningful PDE-coefficients become the…

Machine Learning · Computer Science 2022-08-24 Bart Smets , Jim Portegies , Erik Bekkers , Remco Duits

Graph Convolutional Network (GCN) is an emerging technique for information retrieval (IR) applications. While GCN assumes the homophily property of a graph, real-world graphs are never perfect: the local structure of a node may contain…

Machine Learning · Computer Science 2021-06-08 Fuli Feng , Weiran Huang , Xiangnan He , Xin Xin , Qifan Wang , Tat-Seng Chua

The translation equivariance of convolutional layers enables convolutional neural networks to generalize well on image problems. While translation equivariance provides a powerful inductive bias for images, we often additionally desire…

Machine Learning · Statistics 2020-09-25 Marc Finzi , Samuel Stanton , Pavel Izmailov , Andrew Gordon Wilson

Many applications require the robustness, or ideally the invariance, of a neural network to certain transformations of input data. Most commonly, this requirement is addressed by either augmenting the training data, using adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Kanchana Vaishnavi Gandikota , Jonas Geiping , Zorah Lähner , Adam Czapliński , Michael Moeller

Graph Neural Networks (GNNs) are powerful machine learning prediction models on graph-structured data. However, GNNs lack rigorous uncertainty estimates, limiting their reliable deployment in settings where the cost of errors is…

Machine Learning · Computer Science 2023-11-01 Kexin Huang , Ying Jin , Emmanuel Candès , Jure Leskovec