English
Related papers

Related papers: Understanding Attention and Generalization in Grap…

200 papers

Graph Neural Networks (GNNs) require a relatively large number of labeled nodes and a reliable/uncorrupted graph connectivity structure in order to obtain good performance on the semi-supervised node classification task. The performance of…

Machine Learning · Computer Science 2021-07-01 Abdullah Alchihabi , Yuhong Guo

Traditional convolutional neural networks are limited to handling Euclidean space data, overlooking the vast realm of real-life scenarios represented as graph data, including transportation networks, social networks, and reference networks.…

Machine Learning · Computer Science 2023-07-04 Xingyu Liu , Juan Chen , Quan Wen

Graph Neural Networks (GNNs) have been studied through the lens of expressive power and generalization. However, their optimization properties are less well understood. We take the first step towards analyzing GNN training by studying the…

Machine Learning · Computer Science 2021-05-27 Keyulu Xu , Mozhi Zhang , Stefanie Jegelka , Kenji Kawaguchi

This paper studies the interplay between learning algorithms and graph structure for graph neural networks (GNNs). Existing theoretical studies on the learning dynamics of GNNs primarily focus on the convergence rates of learning algorithms…

Machine Learning · Computer Science 2025-08-21 Junwei Su , Chuan Wu

Driven by the outstanding performance of neural networks in the structured Euclidean domain, recent years have seen a surge of interest in developing neural networks for graphs and data supported on graphs. The graph is leveraged at each…

Machine Learning · Computer Science 2021-07-28 Elvin Isufi , Fernando Gama , Alejandro Ribeiro

Attention-based graph neural networks (GNNs), such as graph attention networks (GATs), have become popular neural architectures for processing graph-structured data and learning node embeddings. Despite their empirical success, these models…

Machine Learning · Statistics 2023-06-07 Dexiong Chen , Paolo Pellizzoni , Karsten Borgwardt

Graphs are widely used to describe real-world objects and their interactions. Graph Neural Networks (GNNs) as a de facto model for analyzing graphstructured data, are highly sensitive to the quality of the given graph structures. Therefore,…

Machine Learning · Computer Science 2022-02-16 Yanqiao Zhu , Weizhi Xu , Jinghao Zhang , Yuanqi Du , Jieyu Zhang , Qiang Liu , Carl Yang , Shu Wu

Graph neural networks (GNNs) are a class of effective deep learning models for node classification tasks; yet their predictive capability may be severely compromised under adversarially designed unnoticeable perturbations to the graph…

Machine Learning · Computer Science 2023-01-05 Xiao Zang , Jie Chen , Bo Yuan

We aim to deepen the theoretical understanding of Graph Neural Networks (GNNs) on large graphs, with a focus on their expressive power. Existing analyses relate this notion to the graph isomorphism problem, which is mostly relevant for…

Machine Learning · Computer Science 2023-05-25 Nicolas Keriven , Samuel Vaiter

Graph Neural Networks (GNNs) achieve strong performance on node classification tasks but remain difficult to interpret, particularly with respect to which input features drive their predictions. Existing global GNN explainers operate at the…

Machine Learning · Computer Science 2026-05-06 Rishi Raj Sahoo , Subhankar Mishra

Graph Neural Networks (GNNs) are proposed without considering the agnostic distribution shifts between training and testing graphs, inducing the degeneration of the generalization ability of GNNs on Out-Of-Distribution (OOD) settings. The…

Machine Learning · Computer Science 2024-03-12 Shaohua Fan , Xiao Wang , Chuan Shi , Peng Cui , Bai Wang

The expressive power of message-passing graph neural networks (MPNNs) is reasonably well understood, primarily through combinatorial techniques from graph isomorphism testing. However, MPNNs' generalization abilities -- making meaningful…

Machine Learning · Computer Science 2024-12-11 Antonis Vasileiou , Ben Finkelshtein , Floris Geerts , Ron Levie , Christopher Morris

Graph Neural Networks (GNNs), neural network architectures targeted to learning representations of graphs, have become a popular learning model for prediction tasks on nodes, graphs and configurations of points, with wide success in…

Machine Learning · Computer Science 2022-04-19 Stefanie Jegelka

Graph Neural Networks (GNN) have shown remarkable performance in different tasks. However, there are a few studies about GNN on recommender systems. GCN as a type of GNNs can extract high-quality embeddings for different entities in a…

Information Retrieval · Computer Science 2022-01-17 Taher Hekmatfar , Saman Haratizadeh , Parsa Razban , Sama Goliaei

With the increased penetration of wind energy into the power grid, it has become increasingly important to be able to predict the expected power production for larger wind farms. Deep learning (DL) models can learn complex patterns in the…

Machine Learning · Computer Science 2022-06-07 Lars Ødegaard Bentsen , Narada Dilp Warakagoda , Roy Stenbro , Paal Engelstad

Graph Neural Networks (GNNs) exploit signals from node features and the input graph topology to improve node classification task performance. However, these models tend to perform poorly on heterophilic graphs, where connected nodes have…

Machine Learning · Computer Science 2021-12-08 Vijay Lingam , Chanakya Ekbote , Manan Sharma , Rahul Ragesh , Arun Iyer , Sundararajan Sellamanickam

Attention mechanism is contributing to the majority of recent advances in machine learning for natural language processing. Additionally, it results in an attention map that shows the proportional influence of each input in its decision.…

Computation and Language · Computer Science 2025-01-23 Duc Hau Nguyen , Cyrielle Mallart , Guillaume Gravier , Pascale Sébillot

Recent advances in Graph Neural Networks (GNNs) have explored the potential of random noise as an input feature to enhance expressivity across diverse tasks. However, naively incorporating noise can degrade performance, while architectures…

Machine Learning · Computer Science 2025-02-05 Xiyuan Wang , Muhan Zhang

Graph neural networks (GNNs) are emerging for machine learning research on graph-structured data. GNNs achieve state-of-the-art performance on many tasks, but they face scalability challenges when it comes to real-world applications that…

Machine Learning · Computer Science 2026-04-02 Shichang Zhang , Atefeh Sohrabizadeh , Cheng Wan , Zijie Huang , Ziniu Hu , Yewen Wang , Yingyan , Lin , Jason Cong , Yizhou Sun

In many important graph data processing applications the acquired information includes both node features and observations of the graph topology. Graph neural networks (GNNs) are designed to exploit both sources of evidence but they do not…

Machine Learning · Computer Science 2021-10-28 Eli Chien , Jianhao Peng , Pan Li , Olgica Milenkovic