English
Related papers

Related papers: Reducing Oversmoothing through Informed Weight Ini…

200 papers

Graph neural networks (GNNs) have achieved strong performance across various real-world domains. Nevertheless, they suffer from oversquashing, where long-range information is distorted as it is compressed through limited message-passing…

Machine Learning · Computer Science 2026-04-03 Tanvir Hossain , Muhammad Ifte Khairul Islam , Lilia Chebbah , Charles Fanning , Esra Akbas

Financial fraud is always a major problem in the field of finance, as it can cause significant consequences. As a result, many approaches have been designed to detect it, and lately Graph Neural Networks (GNNs) have been demonstrated as a…

Machine Learning · Computer Science 2026-01-13 Hoang Hiep Trieu

The recent development of high-throughput sequencing creates a large collection of multi-omics data, which enables researchers to better investigate cancer molecular profiles and cancer taxonomy based on molecular subtypes. Integrating…

Genomics · Quantitative Biology 2024-01-25 Bingjun Li , Sheida Nabavi

Graph neural network (GNN) has shown convincing performance in learning powerful node representations that preserve both node attributes and graph structural information. However, many GNNs encounter problems in effectiveness and efficiency…

Machine Learning · Computer Science 2022-01-03 Jiyang Bai , Yuxiang Ren , Jiawei Zhang

This paper presents an analytical study of the oversmoothing issue in diffusion-based Graph Neural Networks (GNNs). Generalizing beyond extant approaches grounded in random walk analysis or particle systems, we approach this problem through…

Machine Learning · Computer Science 2025-03-25 Weichen Zhao , Chenguang Wang , Xinyan Wang , Congying Han , Tiande Guo , Tianshu Yu

Owing to the remarkable capability of extracting effective graph embeddings, graph convolutional network (GCN) and its variants have been successfully applied to a broad range of tasks, such as node classification, link prediction, and…

Machine Learning · Computer Science 2021-07-13 Ronghang Zhu , Zhiqiang Tao , Yaliang Li , Sheng Li

Graph Neural Networks (GNNs) have enjoyed wide spread applications in graph-structured data. However, existing graph based applications commonly lack annotated data. GNNs are required to learn latent patterns from a limited amount of…

Machine Learning · Computer Science 2023-03-22 Wenqi Wei , Mu Qiao , Divyesh Jadav

Node classification is an important research topic in graph learning. Graph neural networks (GNNs) have achieved state-of-the-art performance of node classification. However, existing GNNs address the problem where node samples for…

Machine Learning · Computer Science 2021-03-17 Tianxiang Zhao , Xiang Zhang , Suhang Wang

Matrix completion is a classic problem underlying recommender systems. It is traditionally tackled with matrix factorization. Recently, deep learning based methods, especially graph neural networks, have made impressive progress on this…

Information Retrieval · Computer Science 2021-03-01 Tieyun Qian , Yile Liang , Qing Li

Graph prediction problems prevail in data analysis and machine learning. The inverse prediction problem, namely to infer input data from given output labels, is of emerging interest in various applications. In this work, we develop…

Machine Learning · Statistics 2022-11-22 Chen Xu , Xiuyuan Cheng , Yao Xie

Inspired by the extensive success of deep learning, graph neural networks (GNNs) have been proposed to learn expressive node representations and demonstrated promising performance in various graph learning tasks. However, existing endeavors…

Machine Learning · Computer Science 2022-04-05 Kaize Ding , Jianling Wang , James Caverlee , Huan Liu

The recent rapid growth in mobile data traffic entails a pressing demand for improving the throughput of the underlying wireless communication networks. Network node deployment has been considered as an effective approach for throughput…

Networking and Internet Architecture · Computer Science 2022-09-16 Yifei Yang , Dongmian Zou , Xiaofan He

We comment on Cai and Wang (2020, arXiv:2006.13318), who analyze over-smoothing in GNNs via Dirichlet energy. We show that under mild spectral conditions (including with Leaky-ReLU), the Dirichlet energy of node embeddings decreases…

Machine Learning · Computer Science 2025-09-05 Razi Hasson , Reuven Guetta

Current Graph Neural Networks (GNNs) suffer from the over-smoothing problem, which results in indistinguishable node representations and low model performance with more GNN layers. Many methods have been put forward to tackle this problem…

Machine Learning · Computer Science 2022-10-25 Xinshun Feng , Herun Wan , Shangbin Feng , Hongrui Wang , Jun Zhou , Qinghua Zheng , Minnan Luo

Prompt tuning methods for Graph Neural Networks (GNNs) have become popular to address the semantic gap between pre-training and fine-tuning steps. However, existing GNN prompting methods rely on labeled data and involve lightweight…

Machine Learning · Computer Science 2025-05-23 Peyman Baghershahi , Sourav Medya

Graph Neural Networks (GNN) exhibit superior performance in graph representation learning, but their inference cost can be high, due to an aggregation operation that can require a memory fetch for a very large number of nodes. This…

Machine Learning · Computer Science 2025-03-18 Yaochen Hu , Mai Zeng , Ge Zhang , Pavel Rumiantsev , Liheng Ma , Yingxue Zhang , Mark Coates

In recent years, Graph Neural Networks (GNNs) have been popular in the graph classification task. Currently, shallow GNNs are more common due to the well-known over-smoothing problem facing deeper GNNs. However, they are sub-optimal without…

Machine Learning · Computer Science 2023-02-20 Lanning Wei , Zhiqiang He , Huan Zhao , Quanming Yao

Graph Neural Networks (GNNs) have emerged as a powerful category of learning architecture for handling graph-structured data. However, existing GNNs typically ignore crucial structural characteristics in node-induced subgraphs, which thus…

Machine Learning · Computer Science 2023-06-13 Kaixuan Chen , Shunyu Liu , Tongtian Zhu , Tongya Zheng , Haofei Zhang , Zunlei Feng , Jingwen Ye , Mingli Song

Current GNN-oriented NAS methods focus on the search for different layer aggregate components with shallow and simple architectures, which are limited by the 'over-smooth' problem. To further explore the benefits from structural diversity…

Machine Learning · Computer Science 2021-09-22 Guosheng Feng , Chunnan Wang , Hongzhi Wang

Graph Neural Networks (GNNs) have achieved state-of-the-art results for semi-supervised node classification on graphs. Nevertheless, the challenge of how to effectively learn GNNs with very few labels is still under-explored. As one of the…

Machine Learning · Computer Science 2022-01-21 Yayong Li , Jie Yin , Ling Chen