English
Related papers

Related papers: Probing Graph Neural Network Activation Patterns T…

200 papers

Graph Neural Networks (GNNs) have made significant advances on several fundamental inference tasks. As a result, there is a surge of interest in using these models for making potentially important decisions in high-regret applications.…

Machine Learning · Computer Science 2020-02-26 Kaidi Xu , Sijia Liu , Pin-Yu Chen , Mengshu Sun , Caiwen Ding , Bhavya Kailkhura , Xue Lin

Graph neural networks aim to learn representations for graph-structured data and show impressive performance, particularly in node classification. Recently, many methods have studied the representations of GNNs from the perspective of…

Machine Learning · Computer Science 2023-05-30 Jiaqi Sun , Lin Zhang , Guangyi Chen , Kun Zhang , Peng XU , Yujiu Yang

This paper studies the interplay between learning algorithms and graph structure for graph neural networks (GNNs). Existing theoretical studies on the learning dynamics of GNNs primarily focus on the convergence rates of learning algorithms…

Machine Learning · Computer Science 2025-08-21 Junwei Su , Chuan Wu

Graph neural networks (GNNs) are powerful graph-based deep-learning models that have gained significant attention and demonstrated remarkable performance in various domains, including natural language processing, drug discovery, and…

Machine Learning · Computer Science 2023-06-06 Jaykumar Kakkad , Jaspal Jannu , Kartik Sharma , Charu Aggarwal , Sourav Medya

Interpreting graph neural networks (GNNs) is difficult because message passing mixes signals and internal channels rarely align with human concepts. We study superposition, the sharing of directions by multiple features, directly in the…

Machine Learning · Computer Science 2026-01-19 Lukas Pertl , Han Xuanyuan , Pietro Liò

In the field of deep learning, Graph Neural Networks (GNNs) and Graph Transformer models, with their outstanding performance and flexible architectural designs, have become leading technologies for processing structured data, especially…

Machine Learning · Computer Science 2025-02-04 Jiawei E , Yinglong Zhang , Xuewen Xia , Xing Xu

Graph neural networks (GNNs) are typically applied to static graphs that are assumed to be known upfront. This static input structure is often informed purely by insight of the machine learning practitioner, and might not be optimal for the…

The study of Graph Neural Networks has received considerable interest in the past few years. By extending deep learning to graph-structured data, GNNs can solve a diverse set of tasks in fields including social science, chemistry, and…

Machine Learning · Computer Science 2024-03-12 Ashwin Nalwade , Kelly Marshall , Axel Eladi , Umang Sharma

Training deep graph neural networks (GNNs) is notoriously hard. Besides the standard plights in training deep architectures such as vanishing gradients and overfitting, it also uniquely suffers from over-smoothing, information squashing,…

Machine Learning · Computer Science 2022-05-10 Tianlong Chen , Kaixiong Zhou , Keyu Duan , Wenqing Zheng , Peihao Wang , Xia Hu , Zhangyang Wang

Graph convolutional networks (GCNs) have recently achieved great empirical success in learning graph-structured data. To address its scalability issue due to the recursive embedding of neighboring features, graph topology sampling has been…

Machine Learning · Computer Science 2023-12-12 Hongkang Li , Meng Wang , Sijia Liu , Pin-Yu Chen , Jinjun Xiong

Graph neural networks (GNNs) which apply the deep neural networks to graph data have achieved significant performance for the task of semi-supervised node classification. However, only few work has addressed the adversarial robustness of…

Machine Learning · Computer Science 2019-10-16 Kaidi Xu , Hongge Chen , Sijia Liu , Pin-Yu Chen , Tsui-Wei Weng , Mingyi Hong , Xue Lin

Graph neural networks (GNNs) are quickly becoming the standard approach for learning on graph structured data across several domains, but they lack transparency in their decision-making. Several perturbation-based approaches have been…

Machine Learning · Computer Science 2021-11-29 Anna Himmelhuber , Mitchell Joblin , Martin Ringsquandl , Thomas Runkler

Graph Neural Networks (GNNs) are limited in their propagation operators. In many cases, these operators often contain non-negative elements only and are shared across channels, limiting the expressiveness of GNNs. Moreover, some GNNs suffer…

Machine Learning · Computer Science 2023-05-08 Moshe Eliasof , Lars Ruthotto , Eran Treister

Graph Neural Networks (GNNs), despite achieving remarkable performance across different tasks, are theoretically bounded by the 1-Weisfeiler-Lehman test, resulting in limitations in terms of graph expressivity. Even though prior works on…

Machine Learning · Computer Science 2024-04-02 Quang Truong , Peter Chin

Graphs serve as fundamental descriptors for systems composed of interacting elements, capturing a wide array of data types, from molecular interactions to social networks and knowledge graphs. In this paper, we present an exhaustive review…

Machine Learning · Computer Science 2024-11-13 Chenqing Hua

While Graph Neural Networks (GNNs) have achieved remarkable results in a variety of applications, recent studies exposed important shortcomings in their ability to capture the structure of the underlying graph. It has been shown that the…

Machine Learning · Computer Science 2023-09-26 Giorgos Bouritsas , Fabrizio Frasca , Stefanos Zafeiriou , Michael M. Bronstein

Graph neural networks have demonstrated excellent applicability to a wide range of domains, including social networks, biological systems, recommendation systems, and wireless communications. Yet a principled theoretical understanding of…

Machine Learning · Computer Science 2026-04-14 Xinping Yi

Constructing appropriate representations of molecules lies at the core of numerous tasks such as material science, chemistry and drug designs. Recent researches abstract molecules as attributed graphs and employ graph neural networks (GNN)…

Machine Learning · Computer Science 2021-07-29 Jianwen Chen , Shuangjia Zheng , Ying Song , Jiahua Rao , Yuedong Yang

A common issue in Graph Neural Networks (GNNs) is known as over-smoothing. By increasing the number of iterations within the message-passing of GNNs, the nodes' representations of the input graph align with each other and become…

Machine Learning · Computer Science 2021-10-22 Christian M. M. Frey , Yunpu Ma , Matthias Schubert

Knowledge Graphs are increasingly becoming popular for a variety of downstream tasks like Question Answering and Information Retrieval. However, the Knowledge Graphs are often incomplete, thus leading to poor performance. As a result, there…

Computation and Language · Computer Science 2020-07-27 Siddhant Arora