中文
相关论文

相关论文: Generalization bounds for graph convolutional neur…

200 篇论文

We investigate efficient learning from higher-order graph convolution and learning directly from adjacency matrices for node classification. We revisit the scaled graph residual network and remove ReLU activation from residual layers and…

机器学习 · 计算机科学 2022-09-13 Kishan Wimalawarne , Taiji Suzuki

Recent studies have indicated that Graph Convolutional Networks (GCNs) act as a \emph{low pass} filter in spectral domain and encode smoothed node representations. In this paper, we consider their opposite, namely Graph Deconvolutional…

机器学习 · 计算机科学 2020-12-23 Jia Li , Tomas Yu , Da-Cheng Juan , Arjun Gopalan , Hong Cheng , Andrew Tomkins

Generalization error bounds for deep neural networks trained by stochastic gradient descent (SGD) are derived by combining a dynamical control of an appropriate parameter norm and the Rademacher complexity estimate based on parameter norms.…

机器学习 · 计算机科学 2023-05-30 Mingze Wang , Chao Ma

This paper studies the relationship between a graph neural network (GNN) and a manifold neural network (MNN) when the graph is constructed from a set of points sampled from the manifold, thus encoding geometric information. We consider…

机器学习 · 计算机科学 2023-06-29 Zhiyang Wang , Luana Ruiz , Alejandro Ribeiro

The decoupled Graph Convolutional Network (GCN), a recent development of GCN that decouples the neighborhood aggregation and feature transformation in each convolutional layer, has shown promising performance for graph representation…

机器学习 · 计算机科学 2022-11-16 Jinsong Chen , Boyu Li , Kun He

Graph convolutional networks are becoming indispensable for deep learning from graph-structured data. Most of the existing graph convolutional networks share two big shortcomings. First, they are essentially low-pass filters, thus the…

机器学习 · 计算机科学 2022-06-23 Zonghan Wu , Shirui Pan , Guodong Long , Jing Jiang , Chengqi Zhang

Graph convolution networks (GCNs) are currently mainstream in learning with irregular data. These models rely on message passing and attention mechanisms that capture context and node-to-node relationships. With multi-head attention, GCNs…

机器学习 · 计算机科学 2022-03-28 Hichem Sahbi

Graph Neural Nets (GNNs) have received increasing attentions, partially due to their superior performance in many node and graph classification tasks. However, there is a lack of understanding on what they are learning and how sophisticated…

机器学习 · 计算机科学 2020-06-11 Ting Chen , Song Bian , Yizhou Sun

Graph Convolutional Networks (GCNs) are a class of general models that can learn from graph structured data. Despite being general, GCNs are admittedly inferior to convolutional neural networks (CNNs) when applied to vision tasks, mainly…

计算机视觉与模式识别 · 计算机科学 2019-07-23 Boris Knyazev , Xiao Lin , Mohamed R. Amer , Graham W. Taylor

Convolution Neural Networks on Graphs are important generalization and extension of classical CNNs. While previous works generally assumed that the graph structures of samples are regular with unified dimensions, in many applications, they…

机器学习 · 计算机科学 2017-08-17 Ruoyu Li , Junzhou Huang

Graph convolutional neural networks (GCNN) have numerous applications in different graph based learning tasks. Although the techniques obtain impressive results, they often fall short in accounting for the uncertainty associated with the…

机器学习 · 计算机科学 2019-11-13 Soumyasundar Pal , Florence Regol , Mark Coates

We introduce a family of multilayer graph kernels and establish new links between graph convolutional neural networks and kernel methods. Our approach generalizes convolutional kernel networks to graph-structured data, by representing…

机器学习 · 统计学 2020-06-30 Dexiong Chen , Laurent Jacob , Julien Mairal

Great successes of deep neural networks have been witnessed in various real applications. Many algorithmic and implementation techniques have been developed, however, theoretical understanding of many aspects of deep neural networks is far…

神经与进化计算 · 计算机科学 2020-07-07 Wei Gao , Zhi-Hua Zhou

Graph Neural Networks (GNNs) have attracted considerable attention and have emerged as a new promising paradigm to process graph-structured data. GNNs are usually stacked to multiple layers and the node representations in each layer are…

机器学习 · 计算机科学 2020-09-25 Yihao Chen , Xin Tang , Xianbiao Qi , Chun-Guang Li , Rong Xiao

Graph Convolutional Networks (GCNs) have been widely applied in various fields due to their significant power on processing graph-structured data. Typical GCN and its variants work under a homophily assumption (i.e., nodes with same class…

机器学习 · 计算机科学 2021-12-28 Tao Wang , Rui Wang , Di Jin , Dongxiao He , Yuxiao Huang

Graph Convolution Network (GCN) has attracted significant attention and become the most popular method for learning graph representations. In recent years, many efforts have been focused on integrating GCN into the recommender tasks and…

机器学习 · 计算机科学 2020-07-14 Kang Liu , Feng Xue , Richang Hong

Graph Neural Networks (GNNs), despite achieving remarkable performance across different tasks, are theoretically bounded by the 1-Weisfeiler-Lehman test, resulting in limitations in terms of graph expressivity. Even though prior works on…

机器学习 · 计算机科学 2024-04-02 Quang Truong , Peter Chin

We derive a new Rademacher complexity bound for deep neural networks using Koopman operators, group representations, and reproducing kernel Hilbert spaces (RKHSs). The proposed bound describes why the models with high-rank weight matrices…

机器学习 · 计算机科学 2026-02-25 Yuka Hashimoto , Sho Sonoda , Isao Ishikawa , Masahiro Ikeda

Graph Convolutional Networks (GCNs) have emerged as the state-of-the-art method for graph-based learning tasks. However, training GCNs at scale is still challenging, hindering both the exploration of more sophisticated GCN architectures and…

机器学习 · 计算机科学 2022-03-29 Cheng Wan , Youjie Li , Ang Li , Nam Sung Kim , Yingyan Lin

Graph Convolutional Neural Networks (GCNNs) are generalizations of CNNs to graph-structured data, in which convolution is guided by the graph topology. In many cases where graphs are unavailable, existing methods manually construct graphs…

机器学习 · 计算机科学 2019-09-17 Xiang Gao , Wei Hu , Zongming Guo