中文
相关论文

相关论文: Understanding Virtual Nodes: Oversquashing and Nod…

200 篇论文

Graph Neural Networks (GNNs) have achieved a lot of success with graph-structured data. However, it is observed that the performance of GNNs does not improve (or even worsen) as the number of layers increases. This effect has known as…

机器学习 · 计算机科学 2023-01-10 Yeskendir Koishekenov

Graph Neural Networks (GNNs) have demonstrated significant success in learning from graph-structured data across various domains. Despite their great successful, one critical challenge is often overlooked by existing works, i.e., the…

机器学习 · 计算机科学 2024-02-15 Tianxiang Zhao , Xiang Zhang , Suhang Wang

While Graph Neural Networks (GNNs) have achieved remarkable success, their design largely relies on empirical intuition rather than theoretical understanding. In this paper, we present a comprehensive analysis of GNN behavior through three…

机器学习 · 计算机科学 2025-02-04 Qin Jiang , Chengjia Wang , Michael Lones , Wei Pang

Learning useful node and graph representations with graph neural networks (GNNs) is a challenging task. It is known that deep GNNs suffer from over-smoothing where, as the number of layers increases, node representations become nearly…

机器学习 · 计算机科学 2022-02-28 Pantelis Elinas , Edwin V. Bonilla

Graph Neural Networks (GNNs) are popular deep learning models designed to process graph-structured data through recursive neighborhood aggregations in the message passing process. When applied to semi-supervised node classification, the…

机器学习 · 计算机科学 2025-01-13 Kevin Mancini , Islem Rekik

Graph Neural Networks (GNNs) have achieved remarkable success in diverse real-world applications. Traditional GNNs are designed based on homophily, which leads to poor performance under heterophily scenarios. Current solutions deal with…

社会与信息网络 · 计算机科学 2023-01-26 Fengzhao Shi , Ren Li , Yanan Cao , Yanmin Shang , Lanxue Zhang , Chuan Zhou , Jia Wu , Shirui Pan

The quality of signal propagation in message-passing graph neural networks (GNNs) strongly influences their expressivity as has been observed in recent works. In particular, for prediction tasks relying on long-range interactions, recursive…

机器学习 · 计算机科学 2022-08-09 Pradeep Kr. Banerjee , Kedar Karhadkar , Yu Guang Wang , Uri Alon , Guido Montúfar

A common problem in Message-Passing Neural Networks is oversquashing -- the limited ability to facilitate effective information flow between distant nodes. Oversquashing is attributed to the exponential decay in information transmission as…

机器学习 · 计算机科学 2025-03-03 Alessio Gravina , Moshe Eliasof , Claudio Gallicchio , Davide Bacciu , Carola-Bibiane Schönlieb

Graph neural networks for heterogeneous graph embedding is to project nodes into a low-dimensional space by exploring the heterogeneity and semantics of the heterogeneous graph. However, on the one hand, most of existing heterogeneous graph…

机器学习 · 计算机科学 2022-12-01 Zezhi Shao , Yongjun Xu , Wei Wei , Fei Wang , Zhao Zhang , Feida Zhu

Graph Convolutional Networks (GCNs) are powerful for processing graph-structured data and have achieved state-of-the-art performance in several tasks such as node classification, link prediction, and graph classification. However, it is…

机器学习 · 计算机科学 2021-10-19 Langzhang Liang , Cuiyun Gao , Shiyi Chen , Shishi Duan , Yu pan , Junjin Zheng , Lei Wang , Zenglin Xu

A hallmark of graph neural networks is their ability to distinguish the isomorphism class of their inputs. This study derives hardness results for the classification variant of graph isomorphism in the message-passing model (MPNN). MPNN…

机器学习 · 计算机科学 2020-10-19 Andreas Loukas

Virtual networks are an innovative abstraction that extends cloud computing concepts to the network: by supporting bandwidth reservations between compute nodes (e.g., virtual machines), virtual networks can provide a predictable performance…

计算复杂性 · 计算机科学 2023-11-10 Sergey Pankratov , Vitaly Aksenov , Stefan Schmid

Graph Neural Networks (GNNs) are powerful deep learning methods for Non-Euclidean data. Popular GNNs are message-passing algorithms (MPNNs) that aggregate and combine signals in a local graph neighborhood. However, shallow MPNNs tend to…

Graph neural networks (GNNs) based on message passing between neighboring nodes are known to be insufficient for capturing long-range interactions in graphs. In this project we study hierarchical message passing models that leverage a…

机器学习 · 计算机科学 2021-08-17 Ladislav Rampášek , Guy Wolf

Networks are a powerful tool to model complex systems, and the definition of many Graph Neural Networks (GNN), Deep Learning algorithms that can handle networks, has opened a new way to approach many real-world problems that would be hardly…

机器学习 · 计算机科学 2021-09-28 Marco Grassia , Manlio De Domenico , Giuseppe Mangioni

It has been observed that message-passing graph neural networks (GNN) sometimes struggle to maintain a healthy balance between the efficient/scalable modeling of long-range dependencies across nodes while avoiding unintended consequences…

机器学习 · 计算机科学 2025-05-21 Yongyi Yang , Tang Liu , Yangkun Wang , Zengfeng Huang , David Wipf

Message Passing Neural Networks (MPNNs) are a class of Graph Neural Networks (GNNs) that propagate information across the graph via local neighborhoods. The scheme gives rise to two key challenges: over-smoothing and over-squashing. While…

机器学习 · 计算机科学 2025-05-30 Jasraj Singh , Keyue Jiang , Brooks Paige , Laura Toni

Graph Neural Networks (GNNs) perform computations on graphs by routing the signal between graph regions using a graph shift operator or a message passing scheme. Often, the propagation of the signal leads to a loss of information, where the…

机器学习 · 计算机科学 2026-05-14 Eden Nagar , Ya-Wei Eileen Lin , Ron Levie

Graph neural networks (GNNs) have received tremendous attention due to their superiority in learning node representations. These models rely on message passing and feature transformation functions to encode the structural and feature…

机器学习 · 计算机科学 2021-12-02 Kai Guo , Kaixiong Zhou , Xia Hu , Yu Li , Yi Chang , Xin Wang

Message-passing graph neural networks (MPNNs) have emerged as the leading approach for machine learning on graphs, attracting significant attention in recent years. While a large set of works explored the expressivity of MPNNs, i.e., their…

机器学习 · 计算机科学 2025-03-21 Antonis Vasileiou , Stefanie Jegelka , Ron Levie , Christopher Morris