English
Related papers

Related papers: Can strong structural encoding reduce the importan…

200 papers

In deep neural networks, better results can often be obtained by increasing the complexity of previously developed basic models. However, it is unclear whether there is a way to boost performance by decreasing the complexity of such models.…

Machine Learning · Computer Science 2021-09-07 Junran Wu , Jianhao Li , Yicheng Pan , Ke Xu

We present a novel edge-level ego-network encoding for learning on graphs that can boost Message Passing Graph Neural Networks (MP-GNNs) by providing additional node and edge features or extending message-passing formats. The proposed…

Machine Learning · Computer Science 2024-05-03 Nurudin Alvarez-Gonzalez , Andreas Kaltenbrunner , Vicenç Gómez

Message passing neural networks iteratively generate node embeddings by aggregating information from neighboring nodes. With increasing depth, information from more distant nodes is included. However, node embeddings may be unable to…

Machine Learning · Computer Science 2024-03-29 Franka Bause , Samir Moustafa , Johannes Langguth , Wilfried N. Gansterer , Nils M. Kriege

Dynamic interactions between entities are prevalent in domains like social platforms, financial systems, healthcare, and e-commerce. These interactions can be effectively represented as time-evolving graphs, where predicting future…

Machine Learning · Computer Science 2026-01-21 Sidharth Agarwal , Tanishq Dubey , Shubham Gupta , Srikanta Bedathur

The mining and exploitation of graph structural information have been the focal points in the study of complex networks. Traditional structural measures in Network Science focus on the analysis and modelling of complex networks from the…

Social and Information Networks · Computer Science 2023-06-21 Mingshan Jia , Bogdan Gabrys , Katarzyna Musial

Message passing is the core operation in graph neural networks, where each node updates its embeddings by aggregating information from its neighbors. However, in deep architectures, this process often leads to diminished expressiveness. A…

Machine Learning · Computer Science 2025-11-11 Mohammad Shirzadi , Ali Safarpoor Dehkordi , Ahad N. Zehmakan

Message passing has evolved as an effective tool for designing Graph Neural Networks (GNNs). However, most existing methods for message passing simply sum or average all the neighboring features to update node representations. They are…

Machine Learning · Computer Science 2022-06-17 Rui Yang , Wenrui Dai , Chenglin Li , Junni Zou , Hongkai Xiong

Recently, text classification model based on graph neural network (GNN) has attracted more and more attention. Most of these models adopt a similar network paradigm, that is, using pre-training node embedding initialization and two-layer…

Computation and Language · Computer Science 2023-01-26 Jiayuan Chen , Boyu Zhang , Yinfei Xu , Meng Wang

The algorithms based on message passing neural networks (MPNNs) on graphs have recently achieved great success for various graph applications. However, studies find that these methods always propagate the information to very limited…

Artificial Intelligence · Computer Science 2026-02-10 Mingcan Wang , Junchang Xin , Zhongming Yao , Kaifu Long , Zhiqiong Wang

The Transformer architecture has become a dominant choice in many domains, such as natural language processing and computer vision. Yet, it has not achieved competitive performance on popular leaderboards of graph-level prediction compared…

Machine Learning · Computer Science 2021-11-25 Chengxuan Ying , Tianle Cai , Shengjie Luo , Shuxin Zheng , Guolin Ke , Di He , Yanming Shen , Tie-Yan Liu

Message-passing graph neural networks (MPNNs) and structural features (SFs) are cornerstones for the link prediction task. However, as a common and intuitive mode of understanding, the potential of visual perception has been overlooked in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Yanbin Wei , Xuehao Wang , Zhan Zhuang , Yang Chen , Shuhao Chen , Yulong Zhang , Yu Zhang , James Kwok

Graph neural networks have recently emerged as a very effective framework for processing graph-structured data. These models have achieved state-of-the-art performance in many tasks. Most graph neural networks can be described in terms of…

Computation and Language · Computer Science 2019-11-25 Giannis Nikolentzos , Antoine J. -P. Tixier , Michalis Vazirgiannis

Message passing neural networks (MPNNs) are powerful models for node classification but suffer from performance limitations under heterophily (low same-class connectivity) and structural bottlenecks in the graph. We provide a unifying…

Machine Learning · Computer Science 2025-08-26 Jonathan Rubin , Sahil Loomba , Nick S. Jones

Graph neural networks (GNNs) have become the \textit{de facto} standard for representational learning in graphs, and have achieved state-of-the-art performance in many graph-related tasks; however, it has been shown that the expressive…

Machine Learning · Computer Science 2024-06-28 Tianjun Yao , Yiongxu Wang , Kun Zhang , Shangsong Liang

Learning representations of sets of nodes in a graph is crucial for applications ranging from node-role discovery to link prediction and molecule classification. Graph Neural Networks (GNNs) have achieved great success in graph…

Machine Learning · Computer Science 2020-10-30 Pan Li , Yanbang Wang , Hongwei Wang , Jure Leskovec

Graph neural networks (GNNs) have shown great success in learning from graph-based data. The key mechanism of current GNNs is message passing, where a node's feature is updated based on the information passing from its local neighbourhood.…

Machine Learning · Computer Science 2024-05-09 Yongze Wang , Haimin Zhang , Qiang Wu , Min Xu

Graph-structured data are ubiquitous. However, graphs encode diverse types of information and thus play different roles in data representation. In this paper, we distinguish the \textit{representational} and the \textit{correlational} roles…

Machine Learning · Computer Science 2021-03-22 Jiaqi Ma , Bo Chang , Xuefei Zhang , Qiaozhu Mei

Message-passing based approaches form the default backbone of most learning architectures on graph-structured data. However, the rapid progress of modern deep learning architectures in other domains, particularly sequence modeling, raises…

Machine Learning · Computer Science 2026-05-13 Joël Mathys , Basil Rohner , Saku Peltonen , Roger Wattenhofer

Temporal graph learning has applications in recommendation systems, traffic forecasting, and social network analysis. Although multiple architectures have been introduced, progress in positional encoding for temporal graphs remains limited.…

Machine Learning · Computer Science 2025-06-03 Yaniv Galron , Fabrizio Frasca , Haggai Maron , Eran Treister , Moshe Eliasof

Graph Neural Networks (GNNs) are widely used in graph data mining tasks. Traditional GNNs follow a message passing scheme that can effectively utilize local and structural information. However, the phenomena of over-smoothing and…

Machine Learning · Computer Science 2025-04-14 Zijie Zhou , Zhaoqi Lu , Xuekai Wei , Rongqin Chen , Shenghui Zhang , Pak Lon Ip , Leong Hou U