English
Related papers

Related papers: New Insights into Graph Convolutional Networks usi…

200 papers

The Neural Tangent Kernel (NTK) is an important milestone in the ongoing effort to build a theory for deep learning. Its prediction that sufficiently wide neural networks behave as kernel methods, or equivalently as random feature models,…

Machine Learning · Computer Science 2020-06-25 Maxim Samarin , Volker Roth , David Belius

Many machine learning techniques have been proposed in the last few years to process data represented in graph-structured form. Graphs can be used to model several scenarios, from molecules and materials to RNA secondary structures. Several…

Machine Learning · Computer Science 2018-11-19 Nicolò Navarin , Dinh V. Tran , Alessandro Sperduti

Skeleton-based human action recognition has attracted much attention with the prevalence of accessible depth sensors. Recently, graph convolutional networks (GCNs) have been widely used for this task due to their powerful capability to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Zhen Huang , Xu Shen , Xinmei Tian , Houqiang Li , Jianqiang Huang , Xian-Sheng Hua

In this paper, we aim at improving the computational efficiency of graph convolutional networks (GCNs) for learning on point clouds. The basic graph convolution that is typically composed of a $K$-nearest neighbor (KNN) search and a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Yawei Li , He Chen , Zhaopeng Cui , Radu Timofte , Marc Pollefeys , Gregory Chirikjian , Luc Van Gool

Graph convolutional networks (GCNs) are a powerful deep learning approach for graph-structured data. Recently, GCNs and subsequent variants have shown superior performance in various application areas on real-world datasets. Despite their…

Machine Learning · Computer Science 2020-07-07 Ming Chen , Zhewei Wei , Zengfeng Huang , Bolin Ding , Yaliang Li

The mining and exploitation of graph structural information have been the focal points in the study of complex networks. Traditional structural measures in Network Science focus on the analysis and modelling of complex networks from the…

Social and Information Networks · Computer Science 2023-06-21 Mingshan Jia , Bogdan Gabrys , Katarzyna Musial

Graph Convolutional Networks (GCNs) have recently become the primary choice for learning from graph-structured data, superseding hash fingerprints in representing chemical compounds. However, GCNs lack the ability to take into account the…

Machine Learning · Computer Science 2020-07-03 Tomasz Danel , Przemysław Spurek , Jacek Tabor , Marek Śmieja , Łukasz Struski , Agnieszka Słowik , Łukasz Maziarka

Graph Convolutional Networks (GCNs) have received increasing attention in the machine learning community for effectively leveraging both the content features of nodes and the linkage patterns across graphs in various applications. As…

Machine Learning · Computer Science 2021-01-01 Donghan Yu , Ruohong Zhang , Zhengbao Jiang , Yuexin Wu , Yiming Yang

The Neural Tangent Kernel (NTK) characterizes the behavior of infinitely-wide neural networks trained under least squares loss by gradient descent. Recent works also report that NTK regression can outperform finitely-wide neural networks…

Machine Learning · Computer Science 2021-12-09 Amir Zandieh , Insu Han , Haim Avron , Neta Shoham , Chaewon Kim , Jinwoo Shin

Graphs play an important role in many applications. Recently, Graph Neural Networks (GNNs) have achieved promising results in graph analysis tasks. Some state-of-the-art GNN models have been proposed, e.g., Graph Convolutional Networks…

Machine Learning · Computer Science 2021-09-29 Yaoman Li , Irwin King

Graph Neural Networks (GNNs) have recently become increasingly popular due to their ability to learn complex systems of relations or interactions arising in a broad spectrum of problems ranging from biology and particle physics to social…

Machine Learning · Computer Science 2020-10-12 Emanuele Rossi , Ben Chamberlain , Fabrizio Frasca , Davide Eynard , Federico Monti , Michael Bronstein

The ``Neural Tangent Kernel'' (NTK) (Jacot et al 2018), and its empirical variants have been proposed as a proxy to capture certain behaviors of real neural networks. In this work, we study NTKs through the lens of scaling laws, and…

Machine Learning · Computer Science 2022-06-22 Nikhil Vyas , Yamini Bansal , Preetum Nakkiran

Graph Convolutional Networks (GCNs) are powerful for processing graph-structured data and have achieved state-of-the-art performance in several tasks such as node classification, link prediction, and graph classification. However, it is…

Machine Learning · Computer Science 2021-10-19 Langzhang Liang , Cuiyun Gao , Shiyi Chen , Shishi Duan , Yu pan , Junjin Zheng , Lei Wang , Zenglin Xu

Graph convolutional neural networks (GCNs) generalize tradition convolutional neural networks (CNNs) from low-dimensional regular graphs (e.g., image) to high dimensional irregular graphs (e.g., text documents on word embeddings). Due to…

Machine Learning · Computer Science 2021-03-30 Mehrnaz Najafi , Philip S. Yu

Graph Convolutional Networks (GCNs) have emerged as the state-of-the-art method for graph-based learning tasks. However, training GCNs at scale is still challenging, hindering both the exploration of more sophisticated GCN architectures and…

Machine Learning · Computer Science 2022-03-29 Cheng Wan , Youjie Li , Ang Li , Nam Sung Kim , Yingyan Lin

Graph learning is currently dominated by graph kernels, which, while powerful, suffer some significant limitations. Convolutional Neural Networks (CNNs) offer a very appealing alternative, but processing graphs with CNNs is not trivial. To…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Antoine Jean-Pierre Tixier , Giannis Nikolentzos , Polykarpos Meladianos , Michalis Vazirgiannis

Graph Neural Networks (GNNs) have attracted increasing attention in recent years and have achieved excellent performance in semi-supervised node classification tasks. The success of most GNNs relies on one fundamental assumption, i.e., the…

Machine Learning · Computer Science 2024-12-03 Junchao Lin , Yuan Wan , Jingwen Xu , Xingchen Qi

Graph Convolutional Network (GCN) has experienced great success in graph analysis tasks. It works by smoothing the node features across the graph. The current GCN models overwhelmingly assume that the node feature information is complete.…

Machine Learning · Computer Science 2020-12-08 Hibiki Taguchi , Xin Liu , Tsuyoshi Murata

Recent research shows that for training with $\ell_2$ loss, convolutional neural networks (CNNs) whose width (number of channels in convolutional layers) goes to infinity correspond to regression with respect to the CNN Gaussian Process…

Machine Learning · Computer Science 2019-11-05 Zhiyuan Li , Ruosong Wang , Dingli Yu , Simon S. Du , Wei Hu , Ruslan Salakhutdinov , Sanjeev Arora

Graph convolutional networks (GCNs) -- which are effective in modeling graph structures -- have been increasingly popular in knowledge graph completion (KGC). GCN-based KGC models first use GCNs to generate expressive entity representations…

Artificial Intelligence · Computer Science 2022-02-14 Zhanqiu Zhang , Jie Wang , Jieping Ye , Feng Wu