English
Related papers

Related papers: GEN: A Practical Alternative to Graph Transformers…

200 papers

Temporal graph is an abstraction for modeling dynamic systems that consist of evolving interaction elements. In this paper, we aim to solve an important yet neglected problem -- how to learn information from high-order neighbors in temporal…

Machine Learning · Computer Science 2023-04-17 Zehong Wang , Qi Li , Donghua Yu

Graph Neural Networks (GNNs) are powerful deep learning methods for Non-Euclidean data. Popular GNNs are message-passing algorithms (MPNNs) that aggregate and combine signals in a local graph neighborhood. However, shallow MPNNs tend to…

Machine Learning · Statistics 2022-11-08 Ningyuan Huang , Soledad Villar , Carey E. Priebe , Da Zheng , Chengyue Huang , Lin Yang , Vladimir Braverman

Graph neural networks (GNNs) have recently achieved state-of-the-art performance in many graph-based applications. Despite the high expressive power, they typically need to perform an expensive recursive neighborhood expansion in multiple…

Machine Learning · Computer Science 2022-06-10 Wentao Zhang , Ziqi Yin , Zeang Sheng , Wen Ouyang , Xiaosen Li , Yangyu Tao , Zhi Yang , Bin Cui

Graph Neural Networks (GNNs) have led to state-of-the-art performance on a variety of machine learning tasks such as recommendation, node classification and link prediction. Graph neural network models generate node embeddings by merging…

Machine Learning · Computer Science 2020-11-04 Yunpeng Weng , Xu Chen , Liang Chen , Wei Liu

Real-world graphs or networks are usually heterogeneous, involving multiple types of nodes and relationships. Heterogeneous graph neural networks (HGNNs) can effectively handle these diverse nodes and edges, capturing heterogeneous…

Neural and Evolutionary Computing · Computer Science 2026-01-07 Buqing Cao , Qian Peng , Xiang Xie , Liang Chen , Min Shi , Jianxun Liu

Graph Neural Networks (GNNs) are widely used in graph representation learning. However, most GNN methods are designed for either homogeneous or heterogeneous graphs. In this paper, we propose a new model, Hop-Hop Relation-aware Graph Neural…

Machine Learning · Computer Science 2020-12-22 Li Zhang , Yan Ge , Haiping Lu

Graph Convolutional Networks (GCNs) have become a crucial tool on learning representations of graph vertices. The main challenge of adapting GCNs on large-scale graphs is the scalability issue that it incurs heavy cost both in computation…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Wenbing Huang , Tong Zhang , Yu Rong , Junzhou Huang

Graph-structured data is ubiquitous in the real world, and Graph Neural Networks (GNNs) have become increasingly popular in various fields due to their ability to process such irregular data directly. However, as data scale, GNNs become…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-10 Xianfeng Song , Yi Zou , Zheng Shi

Graph Neural Networks (GNNs) are based on repeated aggregations of information across nodes' neighbors in a graph. However, because common neighbors are shared between different nodes, this leads to repeated and inefficient computations. We…

Machine Learning · Computer Science 2019-06-11 Zhihao Jia , Sina Lin , Rex Ying , Jiaxuan You , Jure Leskovec , Alex Aiken

Session-based recommendation systems suggest relevant items to users by modeling user behavior and preferences using short-term anonymous sessions. Existing methods leverage Graph Neural Networks (GNNs) that propagate and aggregate…

Information Retrieval · Computer Science 2022-01-10 Sai Mitheran , Abhinav Java , Surya Kant Sahu , Arshad Shaikh

While Graph Neural Networks (GNNs) are powerful models for learning representations on graphs, most state-of-the-art models do not have significant accuracy gain beyond two to three layers. Deep GNNs fundamentally need to address: 1).…

Message Passing Neural Networks (MPNNs) are a common type of Graph Neural Network (GNN), in which each node's representation is computed recursively by aggregating representations (messages) from its immediate neighbors akin to a…

Machine Learning · Computer Science 2022-04-22 Lingxiao Zhao , Wei Jin , Leman Akoglu , Neil Shah

Message Passing Neural Networks (MPNNs) are a class of Graph Neural Networks (GNNs) that propagate information across the graph via local neighborhoods. The scheme gives rise to two key challenges: over-smoothing and over-squashing. While…

Machine Learning · Computer Science 2025-05-30 Jasraj Singh , Keyue Jiang , Brooks Paige , Laura Toni

Minimizing transmission delay in wireless multi-hop networks is a fundamental yet challenging task due to the complex coupling among interference, queue dynamics, and distributed control. Traditional scheduling algorithms, such as…

Signal Processing · Electrical Eng. & Systems 2025-12-10 Boxuan Wen , Junyu Luo

It has been observed that message-passing graph neural networks (GNN) sometimes struggle to maintain a healthy balance between the efficient/scalable modeling of long-range dependencies across nodes while avoiding unintended consequences…

Machine Learning · Computer Science 2025-05-21 Yongyi Yang , Tang Liu , Yangkun Wang , Zengfeng Huang , David Wipf

We introduce an architecture for processing signals supported on hypergraphs via graph neural networks (GNNs), which we call a Hyper-graph Expansion Neural Network (HENN), and provide the first bounds on the stability and transferability…

Machine Learning · Computer Science 2022-12-14 Mikhail Hayhoe , Hans Riess , Victor M. Preciado , Alejandro Ribeiro

We propose an efficient framework that integrates distance-aware multi-hop message passing with dynamic topology refinement. Unlike standard GNNs that rely on shallow, fixed-hop aggregation, DRTR leverages both static preprocessing and…

Machine Learning · Computer Science 2025-12-01 Dong Liu , Yanxuan Yu

Automated liver segmentation from radiology scans (CT, MRI) can improve surgery and therapy planning and follow-up assessment in addition to conventional use for diagnosis and prognosis. Although convolutional neural networks (CNNs) have…

Image and Video Processing · Electrical Eng. & Systems 2022-05-31 Ugur Demir , Zheyuan Zhang , Bin Wang , Matthew Antalek , Elif Keles , Debesh Jha , Amir Borhani , Daniela Ladner , Ulas Bagci

Graph neural networks (GNNs) have demonstrated superior performance for semi-supervised node classification on graphs, as a result of their ability to exploit node features and topological information simultaneously. However, most GNNs…

Machine Learning · Computer Science 2022-06-24 Guoji Fu , Peilin Zhao , Yatao Bian

Message-passing Graph Neural Networks (GNNs) are often criticized for their limited expressiveness, issues like over-smoothing and over-squashing, and challenges in capturing long-range dependencies. Conversely, Graph Transformers (GTs) are…

Machine Learning · Computer Science 2025-11-04 Yuankai Luo , Lei Shi , Xiao-Ming Wu