English
Related papers

Related papers: Accurate and Scalable Graph Neural Networks via Me…

200 papers

We propose Scalable Message Passing Neural Networks (SMPNNs) and demonstrate that, by integrating standard convolutional message passing into a Pre-Layer Normalization Transformer-style block instead of attention, we can produce…

Machine Learning · Computer Science 2026-03-11 Haitz Sáez de Ocáriz Borde , Artem Lukoianov , Anastasis Kratsios , Michael Bronstein , Xiaowen Dong

Despite recent advances in achieving fair representations and predictions through regularization, adversarial debiasing, and contrastive learning in graph neural networks (GNNs), the working mechanism (i.e., message passing) behind GNNs…

Machine Learning · Computer Science 2022-02-10 Zhimeng Jiang , Xiaotian Han , Chao Fan , Zirui Liu , Na Zou , Ali Mostafavi , Xia Hu

Message passing plays a vital role in graph neural networks (GNNs) for effective feature learning. However, the over-reliance on input topology diminishes the efficacy of message passing and restricts the ability of GNNs. Despite efforts to…

Machine Learning · Computer Science 2024-12-03 Junshu Sun , Chenxue Yang , Xiangyang Ji , Qingming Huang , Shuhui Wang

Graph Neural Networks (GNNs) have proven to be highly effective in various graph learning tasks. A key characteristic of GNNs is their use of a fixed number of message-passing steps for all nodes in the graph, regardless of each node's…

Machine Learning · Computer Science 2025-09-03 Yassine Abbahaddou , Fragkiskos D. Malliaros , Johannes F. Lutzeyer , Michalis Vazirgiannis

In recent studies, neural message passing has proved to be an effective way to design graph neural networks (GNNs), which have achieved state-of-the-art performance in many graph-based tasks. However, current neural-message passing…

Machine Learning · Computer Science 2021-04-21 Wentao Zhang , Yu Shen , Zheyu Lin , Yang Li , Xiaosen Li , Wen Ouyang , Yangyu Tao , Zhi Yang , Bin Cui

Graph neural networks (GNNs) are emerging machine learning models on graphs. Permutation-equivariance and proximity-awareness are two important properties highly desirable for GNNs. Both properties are needed to tackle some challenging…

Machine Learning · Computer Science 2022-02-23 Ziwei Zhang , Chenhao Niu , Peng Cui , Jian Pei , Bo Zhang , Wenwu Zhu

Message Passing Neural Networks (MPNNs) model local relations effectively but struggle to propagate information over long distances. Graph Transformers (GTs) mitigate this via global self-attention, yet their quadratic cost in the number of…

Machine Learning · Computer Science 2025-09-03 Shuo Wang , Ge Cheng , Yun Zhang

There has been tremendous success in the field of graph neural networks (GNNs) as a result of the development of the message-passing (MP) layer, which updates the representation of a node by combining it with its neighbors to address…

Machine Learning · Computer Science 2022-02-11 Hyeokjin Kwon , Jong-Min Lee

Existing Graph Neural Networks (GNNs) follow the message-passing mechanism that conducts information interaction among nodes iteratively. While considerable progress has been made, such node interaction paradigms still have the following…

Machine Learning · Computer Science 2023-04-14 Jie Chen , Zilong Li , Yin Zhu , Junping Zhang , Jian Pu

Constructing appropriate representations of molecules lies at the core of numerous tasks such as material science, chemistry and drug designs. Recent researches abstract molecules as attributed graphs and employ graph neural networks (GNN)…

Machine Learning · Computer Science 2021-07-29 Jianwen Chen , Shuangjia Zheng , Ying Song , Jiahua Rao , Yuedong Yang

Message passing neural networks have recently evolved into a state-of-the-art approach to representation learning on graphs. Existing methods perform synchronous message passing along all edges in multiple subsequent rounds and consequently…

Machine Learning · Computer Science 2020-12-21 Julian Busch , Jiaxing Pi , Thomas Seidl

Most Graph Neural Networks (GNNs) operate at the first-order scale, even though multi-scale representations are known to be crucial in domains such as image classification. In this work, we investigate whether GNNs can similarly benefit…

Machine Learning · Computer Science 2026-04-15 Qin Jiang , Chengjia Wang , Michael Lones , Dongdong Chen , Wei Pang

Temporal graph is an abstraction for modeling dynamic systems that consist of evolving interaction elements. In this paper, we aim to solve an important yet neglected problem -- how to learn information from high-order neighbors in temporal…

Machine Learning · Computer Science 2023-04-17 Zehong Wang , Qi Li , Donghua Yu

Graph neural networks (GNNs) have drawn increasing attention in recent years and achieved remarkable performance in many graph-based tasks, especially in semi-supervised learning on graphs. However, most existing GNNs are based on the…

Machine Learning · Computer Science 2024-01-24 Li Zhou , Wenyu Chen , Dingyi Zeng , Shaohuan Cheng , Wanlong Liu , Malu Zhang , Hong Qu

Researchers of temporal networks (e.g., social networks and transaction networks) have been interested in mining dynamic patterns of nodes from their diverse interactions. Inspired by recently powerful graph mining methods like skip-gram…

Information Retrieval · Computer Science 2023-04-18 Tongya Zheng , Zunlei Feng , Tianli Zhang , Yunzhi Hao , Mingli Song , Xingen Wang , Xinyu Wang , Ji Zhao , Chun Chen

Graph classification is an important learning task for graph-structured data. Graph neural networks (GNNs) have recently gained growing attention in graph learning and have shown significant improvements in many important graph problems.…

Machine Learning · Computer Science 2024-01-31 Tao Wen , Elynn Chen , Yuzhou Chen

Scalable graph neural networks (GNNs) have emerged as a promising technique, which exhibits superior predictive performance and high running efficiency across numerous large-scale graph-based web applications. However, (i) Most scalable…

Machine Learning · Computer Science 2024-02-12 Xunkai Li , Jingyuan Ma , Zhengyu Wu , Daohan Su , Wentao Zhang , Rong-Hua Li , Guoren Wang

The message passing-based graph neural networks (GNNs) have achieved great success in many real-world applications. However, training GNNs on large-scale graphs suffers from the well-known neighbor explosion problem, i.e., the exponentially…

Machine Learning · Computer Science 2025-03-18 Zhihao Shi , Xize Liang , Jie Wang

Graph Neural Networks (GNN) is an emerging field for learning on non-Euclidean data. Recently, there has been increased interest in designing GNN that scales to large graphs. Most existing methods use "graph sampling" or "layer-wise…

Machine Learning · Computer Science 2021-09-03 Ming Chen , Zhewei Wei , Bolin Ding , Yaliang Li , Ye Yuan , Xiaoyong Du , Ji-Rong Wen

Message passing neural networks (MPNNs) learn the representation of graph-structured data based on graph original information, including node features and graph structures, and have shown astonishing improvement in node classification…

Machine Learning · Computer Science 2023-01-30 Xiao Liu , Lijun Zhang , Hui Guan
‹ Prev 1 2 3 10 Next ›