English
Related papers

Related papers: Towards Deeper Graph Neural Networks with Differen…

200 papers

Message Passing Neural Networks (MPNNs) hold a key position in machine learning on graphs, but they struggle with unintended behaviors, such as over-smoothing and over-squashing, due to irregular data structures. The observation and…

Machine Learning · Computer Science 2025-08-26 Junhyun Lee , Veronika Thost , Bumsoo Kim , Jaewoo Kang , Tengfei Ma

Graph Neural Networks have recently become a prevailing paradigm for various high-impact graph analytical problems. Existing efforts can be mainly categorized as spectral-based and spatial-based methods. The major challenge for the former…

Machine Learning · Computer Science 2022-02-22 Yushun Dong , Kaize Ding , Brian Jalaian , Shuiwang Ji , Jundong Li

Graph Neural Networks (GNNs) have shown success in learning from graph structured data containing node/edge feature information, with application to social networks, recommendation, fraud detection and knowledge graph reasoning. In this…

Machine Learning · Computer Science 2021-11-24 Xiang Song , Runjie Ma , Jiahang Li , Muhan Zhang , David Paul Wipf

Graph Neural Networks (GNNs) are popular deep learning models designed to process graph-structured data through recursive neighborhood aggregations in the message passing process. When applied to semi-supervised node classification, the…

Machine Learning · Computer Science 2025-01-13 Kevin Mancini , Islem Rekik

Graph neural networks (GNNs) hold the promise of learning efficient representations of graph-structured data, and one of its most important applications is semi-supervised node classification. However, in this application, GNN frameworks…

Machine Learning · Computer Science 2023-05-04 Jiaqi Sun , Lin Zhang , Shenglin Zhao , Yujiu Yang

Graph neural networks (GNNs) have shown state-of-the-art performances in various applications. However, GNNs often struggle to capture long-range dependencies in graphs due to oversmoothing. In this paper, we generalize the concept of…

Machine Learning · Computer Science 2023-11-01 Sohir Maskey , Raffaele Paolino , Aras Bacho , Gitta Kutyniok

Graph Neural Network (GNN) based recommender systems have been attracting more and more attention in recent years due to their excellent performance in accuracy. Representing user-item interactions as a bipartite graph, a GNN model…

Information Retrieval · Computer Science 2022-11-29 Liangwei Yang , Shengjie Wang , Yunzhe Tao , Jiankai Sun , Xiaolong Liu , Philip S. Yu , Taiqing Wang

Graph neural networks (GNNs) have become compelling models designed to perform learning and inference on graph-structured data. However, little work has been done to understand the fundamental limitations of GNNs for scaling to larger…

Machine Learning · Computer Science 2023-10-27 Hyungeun Lee , Kijung Yoon

Graph neural networks (GNNs) are a popular class of parametric model for learning over graph-structured data. Recent work has argued that GNNs primarily use the graph for feature smoothing, and have shown competitive results on benchmark…

Machine Learning · Computer Science 2020-11-20 Lingfan Yu , Jiajun Shen , Jinyang Li , Adam Lerer

Despite Graph neural networks' significant performance gain over many classic techniques in various graph-related downstream tasks, their successes are restricted in shallow models due to over-smoothness and the difficulties of…

Machine Learning · Computer Science 2023-12-15 Jin Li , Qirong Zhang , Shuling Xu , Xinlong Chen , Longkun Guo , Yang-Geng Fu

Graph neural networks (GNNs) have shown remarkable performance on diverse graph mining tasks. Although different GNNs can be unified as the same message passing framework, they learn complementary knowledge from the same graph. Knowledge…

Machine Learning · Computer Science 2023-04-06 Zhichun Guo , Chunhui Zhang , Yujie Fan , Yijun Tian , Chuxu Zhang , Nitesh Chawla

Recommendation models utilizing Graph Convolutional Networks (GCNs) have achieved state-of-the-art performance, as they can integrate both the node information and the topological structure of the user-item interaction graph. However, these…

Information Retrieval · Computer Science 2022-11-28 Xin Zhou , Donghui Lin , Yong Liu , Chunyan Miao

Graph neural networks (GNNs) learn node representations by passing and aggregating messages between neighboring nodes. GNNs have been applied successfully in several application domains and achieved promising performance. However, GNNs…

Machine Learning · Computer Science 2021-12-14 Zeyu Zhang , Yulong Pei

Graph Neural Networks (GNNs) revolutionize machine learning for graph-structured data, effectively capturing complex relationships. They disseminate information through interconnected nodes, but long-range interactions face challenges known…

Artificial Intelligence · Computer Science 2025-03-18 Singh Akansha

Graph Neural Networks (GNNs) perform computations on graphs by routing the signal between graph regions using a graph shift operator or a message passing scheme. Often, the propagation of the signal leads to a loss of information, where the…

Machine Learning · Computer Science 2026-05-14 Eden Nagar , Ya-Wei Eileen Lin , Ron Levie

Graph Convolutional Networks (GCN) are Graph Neural Networks where the convolutions are applied over a graph. In contrast to Convolutional Neural Networks, GCN's are designed to perform inference on graphs, where the number of nodes can…

Machine Learning · Computer Science 2024-06-12 Adrian Moldovan , Angel Caţaron , Răzvan Andonie

While Graph Neural Networks (GNNs) have achieved enormous success in multiple graph analytical tasks, modern variants mostly rely on the strong inductive bias of homophily. However, real-world networks typically exhibit both homophilic and…

Machine Learning · Computer Science 2024-09-18 Jingwei Guo , Kaizhu Huang , Rui Zhang , Xinping Yi

Deep neural networks have enabled researchers to create powerful generalized frameworks, such as transformers, that can be used to solve well-studied problems in various application domains, such as text and image. However, such generalized…

Machine Learning · Computer Science 2025-02-12 Rudrajit Dawn , Madhusudan Ghosh , Partha Basuchowdhuri , Sudip Kumar Naskar

Consistency training is a popular method to improve deep learning models in computer vision and natural language processing. Graph neural networks (GNNs) have achieved remarkable performance in a variety of network science learning tasks,…

Machine Learning · Computer Science 2021-10-14 Cole Hawkins , Vassilis N. Ioannidis , Soji Adeshina , George Karypis

Graph neural networks (GNNs) have achieved strong performance across various real-world domains. Nevertheless, they suffer from oversquashing, where long-range information is distorted as it is compressed through limited message-passing…

Machine Learning · Computer Science 2026-04-03 Tanvir Hossain , Muhammad Ifte Khairul Islam , Lilia Chebbah , Charles Fanning , Esra Akbas