English
Related papers

Related papers: L$^2$-GCN: Layer-Wise and Learned Efficient Traini…

200 papers

The Graph Convolutional Network (GCN) has been successfully applied to many graph-based applications. Training a large-scale GCN model, however, is still challenging: Due to the node dependency and layer dependency of the GCN architecture,…

Machine Learning · Computer Science 2021-12-20 Hongyi Li , Junxiang Wang , Yongchao Wang , Yue Cheng , Liang Zhao

Graph neural networks (GNNs) have demonstrated remarkable capabilities in learning from graph-structured data, often outperforming traditional Multilayer Perceptrons (MLPs) in numerous graph-based tasks. Although existing works have…

Machine Learning · Computer Science 2025-06-09 Wei Huang , Yuan Cao , Haonan Wang , Xin Cao , Taiji Suzuki

In practical applications, multi-view data depicting objectives from assorted perspectives can facilitate the accuracy increase of learning algorithms. However, given multi-view data, there is limited work for learning discriminative node…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Zhaoliang Chen , Lele Fu , Jie Yao , Wenzhong Guo , Claudia Plant , Shiping Wang

Graph convolutional networks (GCNs) have recently received wide attentions, due to their successful applications in different graph tasks and different domains. Training GCNs for a large graph, however, is still a challenge. Original…

Machine Learning · Computer Science 2019-11-19 Difan Zou , Ziniu Hu , Yewen Wang , Song Jiang , Yizhou Sun , Quanquan Gu

The graph convolution network (GCN) is a widely-used facility to realize graph-based semi-supervised learning, which usually integrates node features and graph topologic information to build learning models. However, as for multi-label…

Machine Learning · Computer Science 2019-07-15 Kaisheng Gao , Jing Zhang , Cangqi Zhou

Graph neural networks (GNN) are powerful models for many graph-structured tasks. Existing models often assume that the complete structure of the graph is available during training. In practice, however, graph-structured data is usually…

Machine Learning · Computer Science 2022-03-29 Chen Wang , Yuheng Qiu , Dasong Gao , Sebastian Scherer

The era of "data deluge" has sparked renewed interest in graph-based learning methods and their widespread applications ranging from sociology and biology to transportation and communications. In this context of graph-aware methods, the…

Machine Learning · Computer Science 2020-12-30 Vassilis N. Ioannidis , Antonio G. Marques , Georgios B. Giannakis

Graph Convolutional Networks (GCNs) have become a pivotal method in machine learning for modeling functions over graphs. Despite their widespread success across various applications, their statistical properties (e.g., consistency,…

Machine Learning · Computer Science 2025-04-17 Juntong Chen , Johannes Schmidt-Hieber , Claire Donnat , Olga Klopp

Graph neural network (GNN) is a popular tool to learn the lower-dimensional representation of a graph. It facilitates the applicability of machine learning tasks on graphs by incorporating domain-specific features. There are various options…

Machine Learning · Computer Science 2020-08-21 Md. Khaledur Rahman

Graph Neural Networks (GNNs) are widely applied to graph learning problems such as node classification. When scaling up the underlying graphs of GNNs to a larger size, we are forced to either train on the complete graph and keep the full…

Machine Learning · Computer Science 2024-06-25 Mucong Ding , Tahseen Rabbani , Bang An , Evan Z Wang , Furong Huang

Graph Neural Networks (GNNs) have made significant advances on several fundamental inference tasks. As a result, there is a surge of interest in using these models for making potentially important decisions in high-regret applications.…

Machine Learning · Computer Science 2020-02-26 Kaidi Xu , Sijia Liu , Pin-Yu Chen , Mengshu Sun , Caiwen Ding , Bhavya Kailkhura , Xue Lin

Graph neural networks (GNN) suffer from severe inefficiency. It is mainly caused by the exponential growth of node dependency with the increase of layers. It extremely limits the application of stochastic optimization algorithms so that the…

Machine Learning · Computer Science 2024-04-23 Hongyuan Zhang , Yanan Zhu , Xuelong Li

In recent years, Graph Convolutional Networks (GCNs) have achieved great success in learning from graph-structured data. With the growing tendency of graph nodes and edges, GCN training by single processor cannot meet the demand for time…

Machine Learning · Computer Science 2021-10-08 Taige Zhao , Xiangyu Song , Jianxin Li , Wei Luo , Imran Razzak

Graph neural networks (GNNs) have achieved great success in many scenarios with graph-structured data. However, in many real applications, there are three issues when applying GNNs: graphs are unknown, nodes have noisy features, and graphs…

Machine Learning · Computer Science 2022-10-11 Yixiang Shan , Jielong Yang , Xing Liu , Yixing Gao , Hechang Chen , Shuzhi Sam Ge

Although graph convolutional networks exhibit promising performance in 3D human pose estimation, their reliance on one-hop neighbors limits their ability to capture high-order dependencies among body joints, crucial for mitigating…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Abu Taib Mohammed Shahjahan , A. Ben Hamza

By leveraging recent progress of stochastic gradient descent methods, several works have shown that graphs could be efficiently laid out through the optimization of a tailored objective function. In the meantime, Deep Learning (DL)…

Machine Learning · Computer Science 2021-08-11 Loann Giovannangeli , Frederic Lalanne , David Auber , Romain Giot , Romain Bourqui

Graph convolutional networks (GCNs) have recently enabled a popular class of algorithms for collaborative filtering (CF). Nevertheless, the theoretical underpinnings of their empirical successes remain elusive. In this paper, we endeavor to…

Information Retrieval · Computer Science 2021-08-18 Yifei Shen , Yongji Wu , Yao Zhang , Caihua Shan , Jun Zhang , Khaled B. Letaief , Dongsheng Li

Graph neural networks (GNNs) have extended the success of deep neural networks (DNNs) to non-Euclidean graph data, achieving ground-breaking performance on various tasks such as node classification and graph property prediction.…

Machine Learning · Computer Science 2021-12-17 Tianfeng Liu , Yangrui Chen , Dan Li , Chuan Wu , Yibo Zhu , Jun He , Yanghua Peng , Hongzheng Chen , Hongzhi Chen , Chuanxiong Guo

Graph Convolutional Networks (GCNs) are a class of general models that can learn from graph structured data. Despite being general, GCNs are admittedly inferior to convolutional neural networks (CNNs) when applied to vision tasks, mainly…

Computer Vision and Pattern Recognition · Computer Science 2019-07-23 Boris Knyazev , Xiao Lin , Mohamed R. Amer , Graham W. Taylor

Graph neural networks (GNNs) are a popular class of machine learning models whose major advantage is their ability to incorporate a sparse and discrete dependency structure between data points. Unfortunately, GNNs can only be used when such…

Machine Learning · Computer Science 2020-06-22 Luca Franceschi , Mathias Niepert , Massimiliano Pontil , Xiao He