English
Related papers

Related papers: DeepGCNs: Making GCNs Go as Deep as CNNs

200 papers

Convolutional Neural Network (CNN) is one of the most important architectures in deep learning. The fundamental building block of a CNN is a trainable filter, represented as a discrete grid, used to perform convolution on discrete input…

Machine Learning · Computer Science 2023-05-26 Dario Coscia , Laura Meneghetti , Nicola Demo , Giovanni Stabile , Gianluigi Rozza

Message-passing neural networks (MPNNs) have been successfully applied to representation learning on graphs in a variety of real-world applications. However, two fundamental weaknesses of MPNNs' aggregators limit their ability to represent…

Machine Learning · Computer Science 2020-02-17 Hongbin Pei , Bingzhe Wei , Kevin Chen-Chuan Chang , Yu Lei , Bo Yang

Linear Graph Convolutional Networks (GCNs) are used to classify the node in the graph data. However, we note that most existing linear GCN models perform neural network operations in Euclidean space, which do not explicitly capture the…

Machine Learning · Computer Science 2024-06-17 Qiuyu Liang , Weihua Wang , Feilong Bao , Guanglai Gao

Graph Convolutional Networks (GCNs) is the state-of-the-art method for learning graph-structured data, and training large-scale GCNs requires distributed training across multiple accelerators such that each accelerator is able to hold a…

Machine Learning · Computer Science 2022-03-22 Cheng Wan , Youjie Li , Cameron R. Wolfe , Anastasios Kyrillidis , Nam Sung Kim , Yingyan Lin

Graph Neural Networks (GNNs) have exploded onto the machine learning scene in recent years owing to their capability to model and learn from graph-structured data. Such an ability has strong implications in a wide variety of fields whose…

Machine Learning · Computer Science 2021-07-26 Sergi Abadal , Akshay Jain , Robert Guirado , Jorge López-Alonso , Eduard Alarcón

Traditional convolutional neural networks are limited to handling Euclidean space data, overlooking the vast realm of real-life scenarios represented as graph data, including transportation networks, social networks, and reference networks.…

Machine Learning · Computer Science 2023-07-04 Xingyu Liu , Juan Chen , Quan Wen

Graph Convolutional Networks (GCNs) are specialized neural networks for feature extraction from graph-structured data. In contrast to traditional convolutional networks, GCNs offer distinct advantages when processing irregular data, which…

Quantum Physics · Physics 2025-03-11 Zi Ye , Kai Yu , Song Lin

Graph Convolutional Networks (GCNs) have emerged as the state-of-the-art graph learning model. However, it can be notoriously challenging to inference GCNs over large graph datasets, limiting their application to large real-world graphs and…

Hardware Architecture · Computer Science 2025-03-11 Haoran You , Tong Geng , Yongan Zhang , Ang Li , Yingyan Celine Lin

CNNs and computational models of biological vision share some fundamental principles, which opened new avenues of research. However, fruitful cross-field research is hampered by conventional CNN architectures being based on spatially and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Nergis Tomen , Silvia L. Pintea , Jan C. van Gemert

Steerable properties dominate the design of traditional filters, e.g., Gabor filters, and endow features the capability of dealing with spatial transformations. However, such excellent properties have not been well explored in the popular…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Shangzhen Luan , Baochang Zhang , Chen Chen , Xianbin Cao , Jungong Han , Jianzhuang Liu

Graph convolutional neural networks (GCNs) have achieved state-of-the-art performance on graph-structured data analysis. Like traditional neural networks, training and inference of GCNs are accelerated with GPUs. Therefore, characterizing…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-29 Mingyu Yan , Zhaodong Chen , Lei Deng , Xiaochun Ye , Zhimin Zhang , Dongrui Fan , Yuan Xie

Graph convolutional networks (GCNs) are powerful frameworks for learning embeddings of graph-structured data. GCNs are traditionally studied through the lens of Euclidean geometry. Recent works find that non-Euclidean Riemannian manifolds…

Machine Learning · Computer Science 2022-11-10 Bo Xiong , Shichao Zhu , Nico Potyka , Shirui Pan , Chuan Zhou , Steffen Staab

Deep Convolutional Neural Networks (DCNNs) is currently the method of choice both for generative, as well as for discriminative learning in computer vision and machine learning. The success of DCNNs can be attributed to the careful…

Graph Neural Networks (GNNs) are a promising deep learning approach for circumventing many real-world problems on graph-structured data. However, these models usually have at least one of four fundamental limitations: over-smoothing,…

Machine Learning · Computer Science 2022-10-03 Xun Liu , Alex Hay-Man Ng , Fangyuan Lei , Yikuan Zhang , Zhengmin Li

While convolutional neural networks (CNNs) have recently made great strides in supervised classification of data structured on a grid (e.g. images composed of pixel grids), in several interesting datasets, the relations between features can…

Machine Learning · Computer Science 2018-11-02 Shrey Gadiya , Deepak Anand , Amit Sethi

Deep neural networks have revolutionized many machine learning tasks in power systems, ranging from pattern recognition to signal processing. The data in these tasks is typically represented in Euclidean domains. Nevertheless, there is an…

Machine Learning · Computer Science 2021-06-15 Wenlong Liao , Birgitte Bak-Jensen , Jayakrishnan Radhakrishna Pillai , Yuelong Wang , Yusen Wang

The fundamental principle of Graph Neural Networks (GNNs) is to exploit the structural information of the data by aggregating the neighboring nodes using a `graph convolution' in conjunction with a suitable choice for the network…

Machine Learning · Computer Science 2023-11-01 Mahalakshmi Sabanayagam , Pascal Esser , Debarghya Ghoshdastidar

Graph convolutional neural networks (GCNN) have numerous applications in different graph based learning tasks. Although the techniques obtain impressive results, they often fall short in accounting for the uncertainty associated with the…

Machine Learning · Computer Science 2019-11-13 Soumyasundar Pal , Florence Regol , Mark Coates

Convoulutional Neural Networks (CNNs) exhibit extraordinary performance on a variety of machine learning tasks. However, their mathematical properties and behavior are quite poorly understood. There is some work, in the form of a framework,…

Other Statistics · Statistics 2016-10-30 Jayanth Koushik

Graph convolutional networks (GCNs) are currently the most promising paradigm for dealing with graph-structure data, while recent studies have also shown that GCNs are vulnerable to adversarial attacks. Thus developing GCN models that are…

Machine Learning · Computer Science 2023-02-17 Jincheng Huang , Lun Du , Xu Chen , Qiang Fu , Shi Han , Dongmei Zhang