English
Related papers

Related papers: Joint Diffusion Processes as an Inductive Bias in …

200 papers

Graph Neural Networks (GNNs) are models that leverage the graph structure to transmit information between nodes, typically through the message-passing operation. While widely successful, this approach is well known to suffer from the…

Despite Graph Neural Networks demonstrating considerable promise in graph representation learning tasks, GNNs predominantly face significant issues with over-fitting and over-smoothing as they go deeper as models of computer vision realm.…

Machine Learning · Computer Science 2023-08-22 Kun Wang , Guohao Li , Shilong Wang , Guibin Zhang , Kai Wang , Yang You , Xiaojiang Peng , Yuxuan Liang , Yang Wang

Graph neural networks (GNNs) model nonlinear representations in graph data with applications in distributed agent coordination, control, and planning among others. Current GNN architectures assume ideal scenarios and ignore link…

Signal Processing · Electrical Eng. & Systems 2021-09-01 Zhan Gao , Elvin Isufi , Alejandro Ribeiro

Graph neural networks (GNNs) have achieved strong performance in various applications. In the real world, network data is usually formed in a streaming fashion. The distributions of patterns that refer to neighborhood information of nodes…

Machine Learning · Computer Science 2020-12-07 Junshan Wang , Guojie Song , Yi Wu , Liang Wang

Combinatorial and topological structures, such as graphs, simplicial complexes, and cell complexes, form the foundation of geometric and topological deep learning (GDL and TDL) architectures. These models aggregate signals over such…

Machine Learning · Computer Science 2026-05-28 Chuan-Shen Hu

Implicit Graph Neural Networks (GNNs) have achieved significant success in addressing graph learning problems recently. However, poorly designed implicit GNN layers may have limited adaptability to learn graph metrics, experience…

Machine Learning · Computer Science 2024-02-16 Guoji Fu , Mohammed Haroon Dupty , Yanfei Dong , Lee Wee Sun

Graph Neural Networks (GNNs) have become pivotal tools for a range of graph-based learning tasks. Notably, most current GNN architectures operate under the assumption of homophily, whether explicitly or implicitly. While this underlying…

Machine Learning · Computer Science 2024-06-19 Kun Wang , Guibin Zhang , Xinnan Zhang , Junfeng Fang , Xun Wu , Guohao Li , Shirui Pan , Wei Huang , Yuxuan Liang

Graph Neural Networks (GNNs) have demonstrated remarkable efficacy in tackling a wide array of graph-related tasks across diverse domains. However, a significant challenge lies in their propensity to generate biased predictions,…

Machine Learning · Computer Science 2025-01-03 Abdullah Alchihabi , Yuhong Guo

Graph Neural Networks (GNNs) are exemplary deep models designed for graph data. Message passing mechanism enables GNNs to effectively capture graph topology and push the performance boundaries across various graph tasks. However, the trend…

Neural and Evolutionary Computing · Computer Science 2025-09-29 Huizhe Zhang , Jintang Li , Yuchang Zhu , Liang Chen , Li Kuang

The absence of intrinsic adjacency relations and orientation systems in hypergraphs creates fundamental challenges for constructing sheaf Laplacians of arbitrary degrees. We resolve these limitations through symmetric simplicial sets…

Machine Learning · Computer Science 2025-08-01 Seongjin Choi , Gahee Kim , Yong-Geun Oh

We target open-world feature extrapolation problem where the feature space of input data goes through expansion and a model trained on partially observed features needs to handle new features in test data without further retraining. The…

Machine Learning · Computer Science 2023-06-14 Qitian Wu , Chenxiao Yang , Junchi Yan

This paper presents a novel graph-based deep learning model for tasks involving relations between two nodes (edge-centric tasks), where the focus lies on predicting relationships and interactions between pairs of nodes rather than node…

Machine Learning · Computer Science 2025-07-08 Eugenio Borzone , Leandro Di Persia , Matias Gerard

Graph Neural Network (GNN) resembles the diffusion process, leading to the over-smoothing of learned representations when stacking many layers. Hence, the reverse process of message passing can produce the distinguishable node…

Social and Information Networks · Computer Science 2024-06-12 MoonJeong Park , Jaeseung Heo , Dongwoo Kim

Heterophilic Graph Neural Networks (HGNNs) have shown promising results for semi-supervised learning tasks on graphs. Notably, most real-world heterophilic graphs are composed of a mixture of nodes with different neighbor patterns,…

Machine Learning · Computer Science 2025-02-26 Jinluan Yang , Zhengyu Chen , Teng Xiao , Wenqiao Zhang , Yong Lin , Kun Kuang

This paper explores the applications and challenges of graph neural networks (GNNs) in processing complex graph data brought about by the rapid development of the Internet. Given the heterogeneity and redundancy problems that graph data…

Machine Learning · Computer Science 2024-10-24 Jianjun Wei , Yue Liu , Xin Huang , Xin Zhang , Wenyi Liu , Xu Yan

In this paper, we study the factors that contribute to the effect of oversmoothing in deep Graph Neural Networks (GNNs). Specifically, our analysis is based on a new metric (Mean Average Squared Distance - $MASED$) to quantify the extent of…

Machine Learning · Computer Science 2025-10-08 Dimitrios Kelesis , Dimitris Fotakis , Georgios Paliouras

Graph neural networks (GNNs) are a powerful solution for various structure learning applications due to their strong representation capabilities for graph data. However, traditional GNNs, relying on message-passing mechanisms that gather…

Machine Learning · Computer Science 2024-03-19 Wei Duan , Jie Lu , Yu Guang Wang , Junyu Xuan

Graph neural networks (GNNs) have become a workhorse approach for learning from data defined over irregular domains, typically by implicitly assuming that the data structure is represented by a homophilic graph. However, recent works have…

Machine Learning · Computer Science 2024-09-16 Samuel Rey , Madeline Navarro , Victor M. Tenorio , Santiago Segarra , Antonio G. Marques

Graphs with heterophily, where adjacent nodes carry different labels, are prevalent in real-world applications, from social networks to molecular interactions. However, existing spectral Graph Neural Network (GNN) approaches tailored for…

Machine Learning · Computer Science 2026-05-13 Md Sazzad Hossen , Avimanyu Sahoo

Despite the recent success of graph neural networks (GNN), common architectures often exhibit significant limitations, including sensitivity to oversmoothing, long-range dependencies, and spurious edges, e.g., as can occur as a result of…

Machine Learning · Computer Science 2021-12-06 Yongyi Yang , Tang Liu , Yangkun Wang , Jinjing Zhou , Quan Gan , Zhewei Wei , Zheng Zhang , Zengfeng Huang , David Wipf