English
Related papers

Related papers: SmoothGNN: Smoothing-aware GNN for Unsupervised No…

200 papers

Learning useful node and graph representations with graph neural networks (GNNs) is a challenging task. It is known that deep GNNs suffer from over-smoothing where, as the number of layers increases, node representations become nearly…

Machine Learning · Computer Science 2022-02-28 Pantelis Elinas , Edwin V. Bonilla

Graph neural networks (GNNs), which learn the representation of a node by aggregating its neighbors, have become an effective computational tool in downstream applications. Over-smoothing is one of the key issues which limit the performance…

Machine Learning · Computer Science 2020-06-15 Kaixiong Zhou , Xiao Huang , Yuening Li , Daochen Zha , Rui Chen , Xia Hu

Graph Neural Networks (GNNs) have achieved promising performance on a wide range of graph-based tasks. Despite their success, one severe limitation of GNNs is the over-smoothing issue (indistinguishable representations of nodes in different…

Machine Learning · Computer Science 2019-11-19 Deli Chen , Yankai Lin , Wei Li , Peng Li , Jie Zhou , Xu Sun

Recently, graph neural networks (GNNs) have shown prominent performance in graph representation learning by leveraging knowledge from both graph structure and node features. However, most of them have two major limitations. First, GNNs can…

Machine Learning · Computer Science 2022-06-20 Wentao Zhang , Zeang Sheng , Mingyu Yang , Yang Li , Yu Shen , Zhi Yang , Bin Cui

Unsupervised graph anomaly detection aims at identifying rare patterns that deviate from the majority in a graph without the aid of labels, which is important for a variety of real-world applications. Recent advances have utilized Graph…

Machine Learning · Computer Science 2025-05-27 Yuanchen Bei , Sheng Zhou , Jinke Shi , Yao Ma , Haishuai Wang , Jiajun Bu

Node Anomaly Detection (NAD) has gained significant attention in the deep learning community due to its diverse applications in real-world scenarios. Existing NAD methods primarily embed graphs within a single Euclidean space, while…

Machine Learning · Computer Science 2025-02-06 Xiangyu Dong , Xingyi Zhang , Lei Chen , Mingxuan Yuan , Sibo Wang

Graph Convolutional Networks (GCNs) are powerful for processing graph-structured data and have achieved state-of-the-art performance in several tasks such as node classification, link prediction, and graph classification. However, it is…

Machine Learning · Computer Science 2021-10-19 Langzhang Liang , Cuiyun Gao , Shiyi Chen , Shishi Duan , Yu pan , Junjin Zheng , Lei Wang , Zenglin Xu

Node features of graph neural networks (GNNs) tend to become more similar with the increase of the network depth. This effect is known as over-smoothing, which we axiomatically define as the exponential convergence of suitable similarity…

Machine Learning · Computer Science 2023-03-21 T. Konstantin Rusch , Michael M. Bronstein , Siddhartha Mishra

Linearized Graph Neural Networks (GNNs) have attracted great attention in recent years for graph representation learning. Compared with nonlinear Graph Neural Network (GNN) models, linearized GNNs are much more time-efficient and can…

Machine Learning · Computer Science 2023-02-02 Yulin Zhu , Xing Ai , Qimai Li , Xiao-Ming Wu , Kai Zhou

Graph Neural Networks (GNNs), a type of neural network that can learn from graph-structured data through neighborhood information aggregation, have shown superior performance in various downstream tasks. However, as the number of layers…

Machine Learning · Computer Science 2024-11-01 Jingbo Zhou , Yixuan Du , Ruqiong Zhang , Jun Xia , Zhizhi Yu , Zelin Zang , Di Jin , Carl Yang , Rui Zhang , Stan Z. Li

Recent works reveal that feature or label smoothing lies at the core of Graph Neural Networks (GNNs). Concretely, they show feature smoothing combined with simple linear regression achieves comparable performance with the carefully designed…

Machine Learning · Computer Science 2021-10-28 Wentao Zhang , Mingyu Yang , Zeang Sheng , Yang Li , Wen Ouyang , Yangyu Tao , Zhi Yang , Bin Cui

Oversmoothing is a common challenge in learning graph neural networks (GNN), where, as layers increase, embedding features learned from GNNs quickly become similar or indistinguishable, making them incapable of differentiating network…

Machine Learning · Computer Science 2025-07-22 Yufei Jin , Xingquan Zhu

Graph Neural Networks (GNNs) have achieved a lot of success with graph-structured data. However, it is observed that the performance of GNNs does not improve (or even worsen) as the number of layers increases. This effect has known as…

Machine Learning · Computer Science 2023-01-10 Yeskendir Koishekenov

We analyze graph smoothing with \emph{mean aggregation}, where each node successively receives the average of the features of its neighbors. Indeed, it has quickly been observed that Graph Neural Networks (GNNs), which generally follow some…

Machine Learning · Statistics 2022-10-11 Nicolas Keriven

Implicit Graph Neural Networks (GNNs) have achieved significant success in addressing graph learning problems recently. However, poorly designed implicit GNN layers may have limited adaptability to learn graph metrics, experience…

Machine Learning · Computer Science 2024-02-16 Guoji Fu , Mohammed Haroon Dupty , Yanfei Dong , Lee Wee Sun

Clustering techniques attempt to group objects with similar properties into a cluster. Clustering the nodes of an attributed graph, in which each node is associated with a set of feature attributes, has attracted significant attention.…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Chaojie Ji , Hongwei Chen , Ruxin Wang , Yunpeng Cai , Hongyan Wu

While Graph Neural Networks (GNNs) are powerful models for learning representations on graphs, most state-of-the-art models do not have significant accuracy gain beyond two to three layers. Deep GNNs fundamentally need to address: 1).…

Graph machine learning has been widely explored in various domains, such as community detection, transaction analysis, and recommendation systems. In these applications, anomaly detection plays an important role. Recently, studies have…

Machine Learning · Computer Science 2025-11-21 Wei Herng Choong , Jixing Liu , Ching-Yu Kao , Philip Sperl

Graphs are used widely to model complex systems, and detecting anomalies in a graph is an important task in the analysis of complex systems. Graph anomalies are patterns in a graph that do not conform to normal patterns expected of the…

Machine Learning · Computer Science 2022-10-05 Hwan Kim , Byung Suk Lee , Won-Yong Shin , Sungsu Lim

Graph Neural Networks (GNNs) have shown great potential in graph data analysis due to their powerful representation capabilities. However, as the network depth increases, the issue of over-smoothing becomes more severe, causing node…

Machine Learning · Computer Science 2025-07-09 Kaichen Ouyang
‹ Prev 1 2 3 10 Next ›