English
Related papers

Related papers: Tackling Over-smoothing on Hypergraphs: A Ricci Fl…

200 papers

Numerous recent research on graph neural networks (GNNs) has focused on formulating GNN architectures as an optimization problem with the smoothness assumption. However, in node classification tasks, the smoothing effect induced by GNNs…

Machine Learning · Computer Science 2023-09-14 Jiayu Zhai , Lequan Lin , Dai Shi , Junbin Gao

Graph neural networks (GNNs) have received tremendous attention due to their superiority in learning node representations. These models rely on message passing and feature transformation functions to encode the structural and feature…

Machine Learning · Computer Science 2021-12-02 Kai Guo , Kaixiong Zhou , Xia Hu , Yu Li , Yi Chang , Xin Wang

Graphical forecasting models learn the structure of time series data via projecting onto a graph, with recent techniques capturing spatial-temporal associations between variables via edge weights. Hierarchical variants offer a distinct…

Machine Learning · Computer Science 2025-04-04 Thomas Bailie , Yun Sing Koh , S. Karthik Mukkavilli , Varvara Vetrova

Message Passing Neural Networks (MPNNs) hold a key position in machine learning on graphs, but they struggle with unintended behaviors, such as over-smoothing and over-squashing, due to irregular data structures. The observation and…

Machine Learning · Computer Science 2025-08-26 Junhyun Lee , Veronika Thost , Bumsoo Kim , Jaewoo Kang , Tengfei Ma

Graph neural networks (GNNs) with missing node features have recently received increasing interest. Such missing node features seriously hurt the performance of the existing GNNs. Some recent methods have been proposed to reconstruct the…

Machine Learning · Computer Science 2023-02-17 Chengxiang Lei , Sichao Fu , Yuetian Wang , Wenhao Qiu , Yachen Hu , Qinmu Peng , Xinge You

Graph Neural Network (GNN) achieves great success for node-level and graph-level tasks via encoding meaningful topological structures of networks in various domains, ranging from social to biological networks. However, repeated aggregation…

Machine Learning · Computer Science 2025-08-26 Tanvir Hossain , Khaled Mohammed Saifuddin , Muhammad Ifte Khairul Islam , Farhan Tanvir , Esra Akbas

Heterogeneous graphs, comprising diverse node and edge types connected through varied relations, are ubiquitous in real-world applications. Message-passing heterogeneous graph neural networks (HGNNs) have emerged as a powerful model class…

Machine Learning · Computer Science 2025-12-10 Junwei Su , Lingjun Mao , Zheng Da , Chuan Wu

Hypergraphs are a common model for multiway relationships in data, and hypergraph semi-supervised learning is the problem of assigning labels to all nodes in a hypergraph, given labels on just a few nodes. Diffusions and label spreading are…

Machine Learning · Computer Science 2022-02-14 Francesco Tudisco , Konstantin Prokopchik , Austin R. Benson

Hypergraph neural networks (HNNs) using neural networks to encode hypergraphs provide a promising way to model higher-order relations in data and further solve relevant prediction tasks built upon such higher-order relations. However,…

Machine Learning · Computer Science 2023-02-16 Peihao Wang , Shenghao Yang , Yunyu Liu , Zhangyang Wang , Pan Li

Graph Neural Networks (GNNs) are proficient in graph representation learning and achieve promising performance on versatile tasks such as node classification and link prediction. Usually, a comprehensive hyperparameter tuning is essential…

Machine Learning · Computer Science 2024-10-10 Lequan Lin , Dai Shi , Andi Han , Zhiyong Wang , Junbin Gao

Hypergraph neural networks (HGNNs) effectively model complex high-order relationships in domains like protein interactions and social networks by connecting multiple vertices through hyperedges, enhancing modeling capabilities, and reducing…

Machine Learning · Computer Science 2025-12-08 Yue Gao , Yifan Feng , Shiquan Liu , Xiangmin Han , Shaoyi Du , Zongze Wu , Han Hu

Many real-world interactions are group-based rather than pairwise such as papers with multiple co-authors and users jointly engaging with items. Hypergraph neural networks have shown great promise at modeling higher-order relations, but…

Machine Learning · Computer Science 2025-08-14 Xiaoyu Li , Guangyu Tang , Jiaojiao Jiang

We study the problem of semi-supervised learning on graphs, for which graph neural networks (GNNs) have been extensively explored. However, most existing GNNs inherently suffer from the limitations of over-smoothing, non-robustness, and…

Machine Learning · Computer Science 2021-09-22 Wenzheng Feng , Jie Zhang , Yuxiao Dong , Yu Han , Huanbo Luan , Qian Xu , Qiang Yang , Evgeny Kharlamov , Jie Tang

Oversmoothing has been recognized as a main obstacle to building deep Graph Neural Networks (GNNs), limiting the performance. This position paper argues that the influence of oversmoothing has been overstated and advocates for a further…

Machine Learning · Computer Science 2025-06-06 MoonJeong Park , Sunghyun Choi , Jaeseung Heo , Eunhyeok Park , Dongwoo Kim

In node classification tasks, graph convolutional neural networks (GCNs) have demonstrated competitive performance over traditional methods on diverse graph data. However, it is known that the performance of GCNs degrades with increasing…

Machine Learning · Computer Science 2022-11-29 Yujun Yan , Milad Hashemi , Kevin Swersky , Yaoqing Yang , Danai Koutra

Message-Passing Neural Networks (MPNNs) are extensively employed in graph learning tasks but suffer from limitations such as the restricted scope of information exchange, by being confined to neighboring nodes during each round of message…

Machine Learning · Computer Science 2024-08-30 Carlos Vonessen , Florian Grötschla , Roger Wattenhofer

Graph Neural Networks (GNNs) have shown superior performance for semi-supervised learning of numerous web applications, such as classification on web services and pages, analysis of online social networks, and recommendation in e-commerce.…

Social and Information Networks · Computer Science 2023-06-06 Keke Huang , Jing Tang , Juncheng Liu , Renchi Yang , Xiaokui Xiao

Oversmoothing is a fundamental challenge in graph neural networks (GNNs): as the number of layers increases, node embeddings become increasingly similar, and model performance drops sharply. Traditionally, oversmoothing has been quantified…

Machine Learning · Computer Science 2026-02-24 Kaicheng Zhang , Piero Deidda , Desmond Higham , Francesco Tudisco

In recent years, Graph Neural Networks (GNNs) have achieved remarkable success in many graph mining tasks. However, scaling them to large graphs is challenging due to the high computational and storage costs of repeated feature propagation…

Machine Learning · Computer Science 2025-04-11 Yuxuan Liang , Wentao Zhang , Zeang Sheng , Ling Yang , Quanqing Xu , Jiawei Jiang , Yunhai Tong , Bin Cui

Graph neural networks (GNNs) have achieved strong performance across various real-world domains. Nevertheless, they suffer from oversquashing, where long-range information is distorted as it is compressed through limited message-passing…

Machine Learning · Computer Science 2026-04-03 Tanvir Hossain , Muhammad Ifte Khairul Islam , Lilia Chebbah , Charles Fanning , Esra Akbas