中文
相关论文

相关论文: Dirichlet Energy Constrained Learning for Deep Gra…

200 篇论文

Linearized Graph Neural Networks (GNNs) have attracted great attention in recent years for graph representation learning. Compared with nonlinear Graph Neural Network (GNN) models, linearized GNNs are much more time-efficient and can…

机器学习 · 计算机科学 2023-02-02 Yulin Zhu , Xing Ai , Qimai Li , Xiao-Ming Wu , Kai Zhou

Graph neural networks (GNNs) have extended the success of deep neural networks (DNNs) to non-Euclidean graph data, achieving ground-breaking performance on various tasks such as node classification and graph property prediction.…

机器学习 · 计算机科学 2021-12-17 Tianfeng Liu , Yangrui Chen , Dan Li , Chuan Wu , Yibo Zhu , Jun He , Yanghua Peng , Hongzheng Chen , Hongzhi Chen , Chuanxiong Guo

Current GNN-oriented NAS methods focus on the search for different layer aggregate components with shallow and simple architectures, which are limited by the 'over-smooth' problem. To further explore the benefits from structural diversity…

机器学习 · 计算机科学 2021-09-22 Guosheng Feng , Chunnan Wang , Hongzhi Wang

Graph neural networks (GNNs) are a type of deep learning models that are trained on graphs and have been successfully applied in various domains. Despite the effectiveness of GNNs, it is still challenging for GNNs to efficiently scale to…

机器学习 · 计算机科学 2023-08-28 Yingxia Shao , Hongzheng Li , Xizhi Gu , Hongbo Yin , Yawen Li , Xupeng Miao , Wentao Zhang , Bin Cui , Lei Chen

Deep graph neural networks (GNNs) have achieved excellent results on various tasks on increasingly large graph datasets with millions of nodes and edges. However, memory complexity has become a major obstacle when training deep GNNs for…

机器学习 · 计算机科学 2022-04-12 Guohao Li , Matthias Müller , Bernard Ghanem , Vladlen Koltun

Graph Neural Networks (GNNs) are a promising deep learning approach for circumventing many real-world problems on graph-structured data. However, these models usually have at least one of four fundamental limitations: over-smoothing,…

机器学习 · 计算机科学 2022-10-03 Xun Liu , Alex Hay-Man Ng , Fangyuan Lei , Yikuan Zhang , Zhengmin Li

Presently with technology node scaling, an accurate prediction model at early design stages can significantly reduce the design cycle. Especially during logic synthesis, predicting cell congestion due to improper logic combination can…

机器学习 · 计算机科学 2021-11-12 Amur Ghose , Vincent Zhang , Yingxue Zhang , Dong Li , Wulong Liu , Mark Coates

Oversmoothing has long been identified as a major limitation of Graph Neural Networks (GNNs): input node features are smoothed at each layer and converge to a non-informative representation, if the weights of the GNN are sufficiently…

机器学习 · 计算机科学 2026-03-16 Nicolas Keriven

Deep learning has consistently defied state-of-the-art techniques in many fields over the last decade. However, we are just beginning to understand the capabilities of neural learning in symbolic domains. Deep learning architectures that…

机器学习 · 计算机科学 2020-03-10 Henrique Lemos , Marcelo Prates , Pedro Avelar , Luis Lamb

Graph Neural Networks (GNNs) require a relatively large number of labeled nodes and a reliable/uncorrupted graph connectivity structure in order to obtain good performance on the semi-supervised node classification task. The performance of…

机器学习 · 计算机科学 2021-07-01 Abdullah Alchihabi , Yuhong Guo

Graph neural networks (GNNs) learn the representation of graph-structured data, and their expressiveness can be further enhanced by inferring node relations for propagation. Attention-based GNNs infer neighbor importance to manipulate the…

机器学习 · 计算机科学 2023-06-06 Soo Yong Lee , Fanchen Bu , Jaemin Yoo , Kijung Shin

Graph Convolutional Networks (GCNs) have been drawing significant attention with the power of representation learning on graphs. Unlike Convolutional Neural Networks (CNNs), which are able to take advantage of stacking very deep layers,…

机器学习 · 计算机科学 2020-06-16 Guohao Li , Chenxin Xiong , Ali Thabet , Bernard Ghanem

Despite the wide application of Graph Convolutional Network (GCN), one major limitation is that it does not benefit from the increasing depth and suffers from the oversmoothing problem. In this work, we first characterize this phenomenon…

Among the many variants of graph neural network (GNN) architectures capable of modeling data with cross-instance relations, an important subclass involves layers designed such that the forward pass iteratively reduces a graph-regularized…

机器学习 · 计算机科学 2025-03-03 Haitian Jiang , Renjie Liu , Zengfeng Huang , Yichuan Wang , Xiao Yan , Zhenkun Cai , Minjie Wang , David Wipf

Oversmoothing has been assumed to be the major cause of performance drop in deep graph convolutional networks (GCNs). In this paper, we propose a new view that deep GCNs can actually learn to anti-oversmooth during training. This work…

机器学习 · 计算机科学 2020-06-19 Chaoqi Yang , Ruijie Wang , Shuochao Yao , Shengzhong Liu , Tarek Abdelzaher

Recently, motivated by real applications, a major research direction in graph neural networks (GNNs) is to explore deeper structures. For instance, the graph connectivity is not always consistent with the label distribution (e.g., the…

机器学习 · 计算机科学 2022-10-26 Lecheng Zheng , Dongqi Fu , Ross Maciejewski , Jingrui He

Graph Neural Networks (GNNs) are an emerging research field. This specialized Deep Neural Network (DNN) architecture is capable of processing graph structured data and bridges the gap between graph processing and Deep Learning (DL). As…

分布式、并行与集群计算 · 计算机科学 2023-05-24 Jana Vatter , Ruben Mayer , Hans-Arno Jacobsen

Graph Neural Networks (GNNs) have emerged as a cornerstone of deep learning, with most existing methods rooted in graph signal processing and diffusion equations to model message passing. However, these approaches inherently suffer from the…

机器学习 · 计算机科学 2026-05-26 Zexing Zhao , Guangsi Shi , Yu Gong , Tianyu Wang , Shirui Pan , Hongye Cheng , Yuxiao Li

The recent introduction of Graph Neural Networks (GNNs) and their growing popularity in the past few years has enabled the application of deep learning algorithms to non-Euclidean, graph-structured data. GNNs have achieved state-of-the-art…

机器学习 · 计算机科学 2020-10-27 Tuomas P. Oikarinen , Daniel C. Hannah , Sohrob Kazerounian

Graph Neural Networks (GNNs) have led to state-of-the-art performance on a variety of machine learning tasks such as recommendation, node classification and link prediction. Graph neural network models generate node embeddings by merging…

机器学习 · 计算机科学 2020-11-04 Yunpeng Weng , Xu Chen , Liang Chen , Wei Liu