English
Related papers

Related papers: Smoothness Sensor: Adaptive Smoothness-Transition …

200 papers

Modern neural networks have shown promise for solving partial differential equations over surfaces, often by discretizing the surface as a mesh and learning with a mesh-aware graph neural network. However, graph neural networks suffer from…

Machine Learning · Computer Science 2026-05-13 Edward Berman , Luisa Li , Jung Yeon Park , Robin Walters

Deep self-expressiveness-based subspace clustering methods have demonstrated effectiveness. However, existing works only consider the attribute information to conduct the self-expressiveness, which may limit the clustering performance. In…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Zhihao Peng , Hui Liu , Yuheng Jia , Junhui Hou

Graph neural networks (GNNs), which learn the node representations by recursively aggregating information from its neighbors, have become a predominant computational tool in many domains. To handle large-scale graphs, most of the existing…

Machine Learning · Computer Science 2021-09-01 Kaixiong Zhou , Ninghao Liu , Fan Yang , Zirui Liu , Rui Chen , Li Li , Soo-Hyun Choi , Xia Hu

The smoothing issue in graph learning leads to indistinguishable node representations, posing significant challenges for graph-related tasks. However, our experiments reveal that this problem can uncover underlying properties of node…

Machine Learning · Computer Science 2024-10-18 Xiangyu Dong , Xingyi Zhang , Yanni Sun , Lei Chen , Mingxuan Yuan , Sibo Wang

Graph Convolutional Network (GCN) has achieved great success and has been applied in various fields including recommender systems. However, GCN still suffers from many issues such as training difficulties, over-smoothing, vulnerable to…

Information Retrieval · Computer Science 2020-05-01 Shaowen Peng , Tsunenori Mine

It has been discovered that Graph Convolutional Networks (GCNs) encounter a remarkable drop in performance when multiple layers are piled up. The main factor that accounts for why deep GCNs fail lies in over-smoothing, which isolates the…

Machine Learning · Computer Science 2023-06-22 Jiaqi Han , Wenbing Huang , Yu Rong , Tingyang Xu , Fuchun Sun , Junzhou Huang

Unsupervised graph representation learning aims to learn low-dimensional node embeddings without supervision while preserving graph topological structures and node attributive features. Previous graph neural networks (GNN) require a large…

Machine Learning · Computer Science 2020-09-04 Yanqiao Zhu , Yichen Xu , Feng Yu , Shu Wu , Liang Wang

Despite plentiful successes achieved by graph representation learning in various domains, the training of graph neural networks (GNNs) still remains tenaciously challenging due to the tremendous computational overhead needed for sizable…

Machine Learning · Computer Science 2025-05-28 Yurui Lai , Taiyan Zhang , Renchi Yang

Graph-based semi-supervised learning (GSSL) has long been a hot research topic. Traditional methods are generally shallow learners, based on the cluster assumption. Recently, graph convolutional networks (GCNs) have become the predominant…

Machine Learning · Computer Science 2025-08-07 Zheng Wang , Hongming Ding , Li Pan , Jianhua Li , Zhiguo Gong , Philip S. Yu

Oversmoothing has been assumed to be the major cause of performance drop in deep graph convolutional networks (GCNs). In this paper, we propose a new view that deep GCNs can actually learn to anti-oversmooth during training. This work…

Machine Learning · Computer Science 2020-06-19 Chaoqi Yang , Ruijie Wang , Shuochao Yao , Shengzhong Liu , Tarek Abdelzaher

In node classification tasks, graph convolutional neural networks (GCNs) have demonstrated competitive performance over traditional methods on diverse graph data. However, it is known that the performance of GCNs degrades with increasing…

Machine Learning · Computer Science 2022-11-29 Yujun Yan , Milad Hashemi , Kevin Swersky , Yaoqing Yang , Danai Koutra

Graph Neural Networks (GNNs) have demonstrated impressive performance across diverse graph-based tasks by leveraging message passing to capture complex node relationships. However, on large-scale real-world graphs, GNNs face two major…

Machine Learning · Computer Science 2026-03-10 Xiang Li , Jianpeng Qi , Haobing Liu , Yuan Cao , Guoqing Chao , Zhongying Zhao , Junyu Dong , Xinwang Liu , Yanwei Yu

Graph neural networks have shown significant success in the field of graph representation learning. Graph convolutions perform neighborhood aggregation and represent one of the most important graph operations. Nevertheless, one layer of…

Machine Learning · Computer Science 2020-07-21 Meng Liu , Hongyang Gao , Shuiwang Ji

Graph clustering aims to partition nodes into distinct clusters based on their similarity, thereby revealing relationships among nodes. Nevertheless, most existing methods do not fully utilize these edge weights. Leveraging edge weights in…

Machine Learning · Computer Science 2026-02-03 Haobing Liu , Yinuo Zhang , Tingting Wang , Ruobing Jiang , Yanwei Yu

Dynamic graphs arise in a plethora of practical scenarios such as social networks, communication networks, and financial transaction networks. Given a dynamic graph, it is fundamental and essential to learn a graph representation that is…

Machine Learning · Computer Science 2021-06-15 Menglin Yang , Ziqiao Meng , Irwin King

Graph neural networks (GNNs) have emerged as powerful tools for processing relational data in applications. However, GNNs suffer from the problem of oversmoothing, the property that the features of all nodes exponentially converge to the…

Machine Learning · Statistics 2025-05-22 Bastian Epping , Alexandre René , Moritz Helias , Michael T. Schaub

\emph{Over-fitting} and \emph{over-smoothing} are two main obstacles of developing deep Graph Convolutional Networks (GCNs) for node classification. In particular, over-fitting weakens the generalization ability on small dataset, while…

Machine Learning · Computer Science 2020-03-13 Yu Rong , Wenbing Huang , Tingyang Xu , Junzhou Huang

We study the problem of clustering nodes in a dynamic graph, where the connections between nodes and nodes' cluster memberships may change over time, e.g., due to community migration. We first propose a dynamic stochastic block model that…

Machine Learning · Computer Science 2021-06-24 Yuhang Yao , Carlee Joe-Wong

Graph neural networks (GNNs), which learn the representation of a node by aggregating its neighbors, have become an effective computational tool in downstream applications. Over-smoothing is one of the key issues which limit the performance…

Machine Learning · Computer Science 2020-06-15 Kaixiong Zhou , Xiao Huang , Yuening Li , Daochen Zha , Rui Chen , Xia Hu

Face clustering is an essential tool for exploiting the unlabeled face data, and has a wide range of applications including face annotation and retrieval. Recent works show that supervised clustering can result in noticeable performance…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Lei Yang , Dapeng Chen , Xiaohang Zhan , Rui Zhao , Chen Change Loy , Dahua Lin