English
Related papers

Related papers: GNNs Meet Sequence Models Along the Shortest-Path:…

200 papers

Graph Neural Networks (GNNs) are exemplary deep models designed for graph data. Message passing mechanism enables GNNs to effectively capture graph topology and push the performance boundaries across various graph tasks. However, the trend…

Neural and Evolutionary Computing · Computer Science 2025-09-29 Huizhe Zhang , Jintang Li , Yuchang Zhu , Liang Chen , Li Kuang

Subgraph GNNs enhance message-passing GNNs expressivity by representing graphs as sets of subgraphs, demonstrating impressive performance across various tasks. However, their scalability is hindered by the need to process large numbers of…

Machine Learning · Computer Science 2025-06-02 Guy Bar-Shalom , Yam Eitan , Fabrizio Frasca , Haggai Maron

Graph neural networks (GNNs), as the de-facto model class for representation learning on graphs, are built upon the multi-layer perceptrons (MLP) architecture with additional message passing layers to allow features to flow across nodes.…

Machine Learning · Computer Science 2023-08-07 Chenxiao Yang , Qitian Wu , Jiahua Wang , Junchi Yan

Graph Neural Networks (GNNs) have emerged as powerful tools for predicting outcomes in graph-structured data. However, a notable limitation of GNNs is their inability to provide robust uncertainty estimates, which undermines their…

Machine Learning · Computer Science 2024-10-10 S. Akansha

Message Passing Neural Networks (MPNNs) have emerged as the {\em de facto} standard in graph representation learning. However, when it comes to link prediction, they often struggle, surpassed by simple heuristics such as Common Neighbor…

Machine Learning · Computer Science 2024-10-15 Kaiwen Dong , Zhichun Guo , Nitesh V. Chawla

Graph neural networks (GNNs) for link prediction can loosely be divided into two broad categories. First, \emph{node-wise} architectures pre-compute individual embeddings for each node that are later combined by a simple decoder to make…

Machine Learning · Computer Science 2024-12-31 Yuxin Wang , Xiannian Hu , Quan Gan , Xuanjing Huang , Xipeng Qiu , David Wipf

Link prediction is a classical problem in graph analysis with many practical applications. For directed graphs, recently developed deep learning approaches typically analyze node similarities through contrastive learning and aggregate…

Machine Learning · Computer Science 2025-06-26 Yuyang Zhang , Xu Shen , Yu Xie , Ka-Chun Wong , Weidun Xie , Chengbin Peng

While Graph Neural Networks (GNNs) have achieved remarkable results in a variety of applications, recent studies exposed important shortcomings in their ability to capture the structure of the underlying graph. It has been shown that the…

Machine Learning · Computer Science 2023-09-26 Giorgos Bouritsas , Fabrizio Frasca , Stefanos Zafeiriou , Michael M. Bronstein

Graph neural networks based on iterative one-hop message passing have been shown to struggle in harnessing the information from distant nodes effectively. Conversely, graph transformers allow each node to attend to all other nodes directly,…

Machine Learning · Computer Science 2024-06-06 Yuhui Ding , Antonio Orvieto , Bobby He , Thomas Hofmann

Graph neural networks (GNNs) can learn effective node representations that significantly improve link prediction accuracy. However, most GNN-based link prediction algorithms are incompetent to predict weak ties connecting different…

Social and Information Networks · Computer Science 2024-10-22 Weiwei Gu , Linbi Lv , Gang Lu , Ruiqi Li

Graph Neural Networks (GNNs) have been studied through the lens of expressive power and generalization. However, their optimization properties are less well understood. We take the first step towards analyzing GNN training by studying the…

Machine Learning · Computer Science 2021-05-27 Keyulu Xu , Mozhi Zhang , Stefanie Jegelka , Kenji Kawaguchi

Graph Neural Networks (GNNs) are powerful in learning semantics of graph data. Recently, a new paradigm "pre-train and prompt" has shown promising results in adapting GNNs to various tasks with less supervised data. The success of such…

Machine Learning · Computer Science 2024-06-04 Qingqing Ge , Zeyuan Zhao , Yiding Liu , Anfeng Cheng , Xiang Li , Shuaiqiang Wang , Dawei Yin

Graph Neural Networks (GNN) exhibit superior performance in graph representation learning, but their inference cost can be high, due to an aggregation operation that can require a memory fetch for a very large number of nodes. This…

Machine Learning · Computer Science 2025-03-18 Yaochen Hu , Mai Zeng , Ge Zhang , Pavel Rumiantsev , Liheng Ma , Yingxue Zhang , Mark Coates

Recently, graph neural networks (GNNs) have proved to be suitable in tasks on unstructured data. Particularly in tasks as community detection, node classification, and link prediction. However, most GNN models still operate with static…

Machine Learning · Computer Science 2019-06-07 Darwin Saire Pilco , Adín Ramírez Rivera

How to properly model graphs is a long-existing and important problem in NLP area, where several popular types of graphs are knowledge graphs, semantic graphs and dependency graphs. Comparing with other data structures, such as sequences…

Computation and Language · Computer Science 2019-07-16 Linfeng Song

Social learning networks (SLNs) are graphical representations that capture student interactions within educational settings (e.g., a classroom), with nodes representing students and edges denoting interactions. Accurately predicting future…

Social and Information Networks · Computer Science 2026-04-22 Ali Mohammadiasl , Bita Akram , Seyyedali Hosseinalipour , Rajeev Sahay

In recent years, graph neural networks (GNNs) combined with variants of recurrent neural networks (RNNs) have reached state-of-the-art performance in spatiotemporal forecasting tasks. This is particularly the case for traffic forecasting,…

Machine Learning · Computer Science 2022-09-09 Naghmeh Shafiee Roudbari , Zachary Patterson , Ursula Eicker , Charalambos Poullis

Graph Neural Networks (GNNs) have demonstrated impressive performance across diverse graph-based tasks by leveraging message passing to capture complex node relationships. However, on large-scale real-world graphs, GNNs face two major…

Machine Learning · Computer Science 2026-03-10 Xiang Li , Jianpeng Qi , Haobing Liu , Yuan Cao , Guoqing Chao , Zhongying Zhao , Junyu Dong , Xinwang Liu , Yanwei Yu

Link prediction, as a fundamental task for graph neural networks (GNNs), has boasted significant progress in varied domains. Its success is typically influenced by the expressive power of node representation, but recent developments reveal…

Machine Learning · Computer Science 2024-07-31 Yakun Wang , Daixin Wang , Hongrui Liu , Binbin Hu , Yingcui Yan , Qiyang Zhang , Zhiqiang Zhang

Graph Neural Networks (GNNs) have demonstrated remarkable success in various applications, yet they often struggle to capture long-range dependencies (LRD) effectively. This paper introduces GraphMinNet, a novel GNN architecture that…

Machine Learning · Computer Science 2025-02-04 Md Atik Ahamed , Andrew Cheng , Qiang Ye , Qiang Cheng