English
Related papers

Related papers: Partially Trained Graph Convolutional Networks Res…

200 papers

Oversmoothing in Graph Neural Networks (GNNs) refers to the phenomenon where increasing network depth leads to homogeneous node representations. While previous work has established that Graph Convolutional Networks (GCNs) exponentially lose…

Machine Learning · Computer Science 2024-06-05 Xinyi Wu , Amir Ajorlou , Zihui Wu , Ali Jadbabaie

Jumping connections enable Graph Convolutional Networks (GCNs) to overcome over-smoothing, while graph sparsification reduces computational demands by selecting a sub-matrix of the graph adjacency matrix during neighborhood aggregation.…

Machine Learning · Computer Science 2025-07-09 Jiawei Sun , Hongkang Li , Meng Wang

Convolutional Neural Networks (CNNs) achieve impressive performance in a wide variety of fields. Their success benefited from a massive boost when very deep CNN models were able to be reliably trained. Despite their merits, CNNs fail to…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Guohao Li , Matthias Müller , Ali Thabet , Bernard Ghanem

Discovering distinct features and their relations from data can help us uncover valuable knowledge crucial for various tasks, e.g., classification. In neuroimaging, these features could help to understand, classify, and possibly prevent…

Machine Learning · Computer Science 2022-02-15 Usman Mahmood , Zening Fu , Vince Calhoun , Sergey Plis

Graph neural networks (GNNs) are deep learning models designed specifically for graph data, and they typically rely on node features as the input to the first layer. When applying such a type of network on the graph without node features,…

\emph{Over-fitting} and \emph{over-smoothing} are two main obstacles of developing deep Graph Convolutional Networks (GCNs) for node classification. In particular, over-fitting weakens the generalization ability on small dataset, while…

Machine Learning · Computer Science 2020-03-13 Yu Rong , Wenbing Huang , Tingyang Xu , Junzhou Huang

In node classification tasks, graph convolutional neural networks (GCNs) have demonstrated competitive performance over traditional methods on diverse graph data. However, it is known that the performance of GCNs degrades with increasing…

Machine Learning · Computer Science 2022-11-29 Yujun Yan , Milad Hashemi , Kevin Swersky , Yaoqing Yang , Danai Koutra

Graph Convolutional Networks (GCNs) are one of the most popular architectures that are used to solve classification problems accompanied by graphical information. We present a rigorous theoretical understanding of the effects of graph…

Machine Learning · Computer Science 2022-08-03 Aseem Baranwal , Kimon Fountoulakis , Aukosh Jagannath

Graph Convolutional Networks (GCNs) have achieved impressive empirical advancement across a wide variety of semi-supervised node classification tasks. Despite their great success, training GCNs on large graphs suffers from computational and…

Machine Learning · Computer Science 2021-11-02 Weilin Cong , Morteza Ramezani , Mehrdad Mahdavi

GNNs are widely used to solve various tasks including node classification and link prediction. Most of the GNN architectures assume the initial embedding to be random or generated from popular distributions. These initial embeddings require…

Machine Learning · Computer Science 2024-01-31 Shraban Kumar Chatterjee , Suman Kundu

Graph Neural Networks (GNN) rely on graph convolutions to learn features from network data. GNNs are stable to different types of perturbations of the underlying graph, a property that they inherit from graph filters. In this paper we…

Machine Learning · Computer Science 2022-02-11 Juan Cervino , Luana Ruiz , Alejandro Ribeiro

Graph Convolutional Networks (GCN) have been effective at tasks that have rich relational structure and can preserve global structure information of a dataset in graph embeddings. Recently, many researchers focused on examining whether GCNs…

Computation and Language · Computer Science 2022-03-31 Soyeon Caren Han , Zihan Yuan , Kunze Wang , Siqu Long , Josiah Poon

We demonstrate that graphs embedded on surfaces are a powerful and practical tool to generate, characterize and simulate networks with a broad range of properties. Remarkably, the study of topologically embedded graphs is non-restrictive…

Other Condensed Matter · Physics 2015-03-19 Tomaso Aste , Ruggero Gramatica , T. Di Matteo

Despite much research, Graph Neural Networks (GNNs) still do not display the favorable scaling properties of other deep neural networks such as Convolutional Neural Networks and Transformers. Previous work has identified issues such as…

Machine Learning · Computer Science 2023-12-19 Ameen Ali , Hakan Cevikalp , Lior Wolf

Graph Convolutional Network (GCN) has been widely used in graph learning tasks. However, GCN-based models (GCNs) is an inherently coupled training framework repetitively conducting the complex neighboring aggregation, which leads to the…

Machine Learning · Computer Science 2020-07-23 Dalong Yang , Chuan Chen , Youhao Zheng , Zibin Zheng , Shih-wei Liao

Graph convolutional neural networks~(GCNs) have recently demonstrated promising results on graph-based semi-supervised classification, but little work has been done to explore their theoretical properties. Recently, several deep neural…

Machine Learning · Computer Science 2020-02-28 Jilin Hu , Jianbing Shen , Bin Yang , Ling Shao

Graph neural networks (GNNs) have achieved strong performance across various real-world domains. Nevertheless, they suffer from oversquashing, where long-range information is distorted as it is compressed through limited message-passing…

Machine Learning · Computer Science 2026-04-03 Tanvir Hossain , Muhammad Ifte Khairul Islam , Lilia Chebbah , Charles Fanning , Esra Akbas

We study Graph Convolutional Networks (GCN) from the graph signal processing viewpoint by addressing a difference between learning graph filters with fully connected weights versus trainable polynomial coefficients. We find that by stacking…

Machine Learning · Computer Science 2020-11-24 Hoang NT , Takanori Maehara , Tsuyoshi Murata

Graph convolutional networks (GCNs) have been employed as a kind of significant tool on many graph-based applications recently. Inspired by convolutional neural networks (CNNs), GCNs generate the embeddings of nodes by aggregating the…

Machine Learning · Computer Science 2020-11-20 Tao Huang , Yihan Zhang , Jiajing Wu , Junyuan Fang , Zibin Zheng

In this work, we propose to train a graph neural network via resampling from a graphon estimate obtained from the underlying network data. More specifically, the graphon or the link probability matrix of the underlying network is first…

Machine Learning · Computer Science 2021-09-07 Ziqing Hu , Yihao Fang , Lizhen Lin