English
Related papers

Related papers: Exploring and Improving Initialization for Deep Gr…

200 papers

Graph neural networks are emerging as continuation of deep learning success w.r.t. graph data. Tens of different graph neural network variants have been proposed, most following a neighborhood aggregation scheme, where the node features are…

Machine Learning · Computer Science 2021-02-09 Dawei Leng , Jinjiang Guo , Lurong Pan , Jie Li , Xinyu Wang

Graph neural networks (GNNs) have evolved into one of the most popular deep learning architectures. However, GNNs suffer from over-smoothing node information and, therefore, struggle to solve tasks where global graph properties are…

Machine Learning · Computer Science 2023-08-31 Bernhard Schäfl , Lukas Gruber , Johannes Brandstetter , Sepp Hochreiter

Graph Neural Networks (GNNs) have emerged as powerful tools for various graph mining tasks, yet existing scalable solutions often struggle to balance execution efficiency with prediction accuracy. These difficulties stem from iterative…

Machine Learning · Computer Science 2026-04-02 Xu Cheng , Liang Yao , Feng He , Yukuo Cen , Yufei He , Chenhui Zhang , Wenzheng Feng , Hongyun Cai , Jie Tang

This paper explores sparsification methods as a form of regularization in Graph Neural Networks (GNNs) to address high memory usage and computational costs in large-scale graph applications. Using techniques from Network Science and Machine…

Machine Learning · Computer Science 2026-02-12 Charlotte Cambier van Nooten , Christos Aronis , Yuliya Shapovalova , Lucia Cavallaro

Graph Neural Networks (GNNs) are the subject of intense focus by the machine learning community for problems involving relational reasoning. GNNs can be broadly divided into spatial and spectral approaches. Spatial approaches use a form of…

Machine Learning · Statistics 2021-01-05 Kimberly Stachenfeld , Jonathan Godwin , Peter Battaglia

Graph-based and sequential methods are two popular recommendation paradigms, each excelling in its domain but lacking the ability to leverage signals from the other. To address this, we propose a novel method that integrates both approaches…

Information Retrieval · Computer Science 2025-01-30 Yuwei Cao , Liangwei Yang , Zhiwei Liu , Yuqing Liu , Chen Wang , Yueqing Liang , Hao Peng , Philip S. Yu

Graph Neural Networks (GNNs) have achieved significant success in addressing node classification tasks. However, the effectiveness of traditional GNNs degrades on heterophilic graphs, where connected nodes often belong to different labels…

Machine Learning · Computer Science 2025-11-11 Asela Hevapathige , Asiri Wijesinghe , Ahad N. Zehmakan

Graph neural networks (GNNs) learn the representation of graph-structured data, and their expressiveness can be further enhanced by inferring node relations for propagation. Attention-based GNNs infer neighbor importance to manipulate the…

Machine Learning · Computer Science 2023-06-06 Soo Yong Lee , Fanchen Bu , Jaemin Yoo , Kijung Shin

Graph Neural Networks (GNNs) have achieved great success in various graph mining tasks.However, drastic performance degradation is always observed when a GNN is stacked with many layers. As a result, most GNNs only have shallow…

Machine Learning · Computer Science 2022-06-10 Wentao Zhang , Zeang Sheng , Ziqi Yin , Yuezihan Jiang , Yikuan Xia , Jun Gao , Zhi Yang , Bin Cui

Graph Neural Networks have emerged as a useful tool to learn on the data by applying additional constraints based on the graph structure. These graphs are often created with assumed intrinsic relations between the entities. In recent years,…

Machine Learning · Statistics 2021-05-18 Sunil Kumar Maurya , Xin Liu , Tsuyoshi Murata

Graph Neural Networks (GNNs) have achieved remarkable success in various applications, but their performance can be sensitive to specific data properties of the graph datasets they operate on. Current literature on understanding the…

Machine Learning · Computer Science 2023-10-31 Ting Wei Li , Qiaozhu Mei , Jiaqi Ma

Message-passing Graph Neural Networks (GNNs) are often criticized for their limited expressiveness, issues like over-smoothing and over-squashing, and challenges in capturing long-range dependencies. Conversely, Graph Transformers (GTs) are…

Machine Learning · Computer Science 2025-11-04 Yuankai Luo , Lei Shi , Xiao-Ming Wu

Graph neural networks (GNNs) have been increasingly deployed in various applications that involve learning on non-Euclidean data. However, recent studies show that GNNs are vulnerable to graph adversarial attacks. Although there are several…

Machine Learning · Computer Science 2023-01-10 Chenhui Deng , Xiuyu Li , Zhuo Feng , Zhiru Zhang

Graph Neural Networks (GNNs) have received considerable attention on graph-structured data learning for a wide variety of tasks. The well-designed propagation mechanism which has been demonstrated effective is the most fundamental part of…

Machine Learning · Computer Science 2021-01-29 Meiqi Zhu , Xiao Wang , Chuan Shi , Houye Ji , Peng Cui

Scalable graph neural networks (GNNs) have emerged as a promising technique, which exhibits superior predictive performance and high running efficiency across numerous large-scale graph-based web applications. However, (i) Most scalable…

Machine Learning · Computer Science 2024-02-12 Xunkai Li , Jingyuan Ma , Zhengyu Wu , Daohan Su , Wentao Zhang , Rong-Hua Li , Guoren Wang

Graph Neural Networks (GNNs) are limited in their propagation operators. In many cases, these operators often contain non-negative elements only and are shared across channels, limiting the expressiveness of GNNs. Moreover, some GNNs suffer…

Machine Learning · Computer Science 2023-05-08 Moshe Eliasof , Lars Ruthotto , Eran Treister

Spatial Message Passing Graph Neural Networks (MPGNNs) are widely used for learning on graph-structured data. However, key limitations of l-step MPGNNs are that their "receptive field" is typically limited to the l-hop neighborhood of a…

Machine Learning · Computer Science 2024-06-04 Simon Geisler , Arthur Kosmala , Daniel Herbst , Stephan Günnemann

Graph neural networks (GNNs) have received tremendous attention due to their power in learning effective representations for graphs. Most GNNs follow a message-passing scheme where the node representations are updated by aggregating and…

Machine Learning · Computer Science 2021-05-11 Wei Jin , Xiaorui Liu , Yao Ma , Tyler Derr , Charu Aggarwal , Jiliang Tang

Graph Neural Networks (GNN) exhibit superior performance in graph representation learning, but their inference cost can be high, due to an aggregation operation that can require a memory fetch for a very large number of nodes. This…

Machine Learning · Computer Science 2025-03-18 Yaochen Hu , Mai Zeng , Ge Zhang , Pavel Rumiantsev , Liheng Ma , Yingxue Zhang , Mark Coates

Message-Passing Neural Networks (MPNNs), the most prominent Graph Neural Network (GNN) framework, celebrate much success in the analysis of graph-structured data. Concurrently, the sparsification of Neural Network models attracts a great…

Machine Learning · Computer Science 2022-04-18 Johannes F. Lutzeyer , Changmin Wu , Michalis Vazirgiannis