English
Related papers

Related papers: Stability and Generalization of lp-Regularized Sto…

200 papers

Representation learning over graph structure data has been widely studied due to its wide application prospects. However, previous methods mainly focus on static graphs while many real-world graphs evolve over time. Modeling such evolution…

Machine Learning · Statistics 2020-09-02 Tijin Yan , Hongwei Zhang , Zirui Li , Yuanqing Xia

The expressivity of Graph Neural Networks (GNNs) has been studied broadly in recent years to reveal the design principles for more powerful GNNs. Graph canonization is known as a typical approach to distinguish non-isomorphic graphs, yet…

Machine Learning · Computer Science 2024-02-12 Zehao Dong , Muhan Zhang , Philip R. O. Payne , Michael A Province , Carlos Cruchaga , Tianyu Zhao , Fuhai Li , Yixin Chen

Graph convolutional neural networks (GCNs) generalize tradition convolutional neural networks (CNNs) from low-dimensional regular graphs (e.g., image) to high dimensional irregular graphs (e.g., text documents on word embeddings). Due to…

Machine Learning · Computer Science 2021-03-30 Mehrnaz Najafi , Philip S. Yu

We present the SCR framework for enhancing the training of graph neural networks (GNNs) with consistency regularization. Regularization is a set of strategies used in Machine Learning to reduce overfitting and improve the generalization…

Social and Information Networks · Computer Science 2022-06-14 Chenhui Zhang , Yufei He , Yukuo Cen , Zhenyu Hou , Wenzheng Feng , Yuxiao Dong , Xu Cheng , Hongyun Cai , Feng He , Jie Tang

Graph convolutional networks (GCNs) have shown promising results in processing graph data by extracting structure-aware features. This gave rise to extensive work in geometric deep learning, focusing on designing network architectures that…

Machine Learning · Computer Science 2022-01-20 Yimeng Min , Frederik Wenkel , Guy Wolf

Understanding the dynamic processes of the glassy system continues to be challenging. Recent advances have shown the power of graph neural networks (GNNs) for determining the correlation between structure and dynamics in the glassy system.…

Disordered Systems and Neural Networks · Physics 2023-10-18 Xiao Jiang , Zean Tian , Kenli Li

In representation learning on the graph-structured data, under heterophily (or low homophily), many popular GNNs may fail to capture long-range dependencies, which leads to their performance degradation. To solve the above-mentioned issue,…

Machine Learning · Computer Science 2021-06-29 Mengying Jiang , Guizhong Liu , Yuanchao Su , Xinliang Wu

Graph convolutional networks (GCNs) have achieved remarkable learning ability for dealing with various graph structural data recently. In general, deep GCNs do not work well since graph convolution in conventional GCNs is a special form of…

Machine Learning · Computer Science 2021-12-08 Zhilong Xiong , Jia Cai

In this paper, we study the implicit regularization of stochastic gradient descent (SGD) through the lens of {\em dynamical stability} (Wu et al., 2018). We start by revising existing stability analyses of SGD, showing how the Frobenius…

Machine Learning · Statistics 2023-06-02 Lei Wu , Weijie J. Su

Graph convolution operator of the GCN model is originally motivated from a localized first-order approximation of spectral graph convolutions. This work stands on a different view; establishing a \textit{mathematical connection between…

Machine Learning · Computer Science 2021-03-03 Lingxiao Zhao , Leman Akoglu

Graph neural networks (GNNs) are a popular class of machine learning models whose major advantage is their ability to incorporate a sparse and discrete dependency structure between data points. Unfortunately, GNNs can only be used when such…

Machine Learning · Computer Science 2020-06-22 Luca Franceschi , Mathias Niepert , Massimiliano Pontil , Xiao He

Graph convolutional networks (GCNs) have well-documented performance in various graph learning tasks, but their analysis is still at its infancy. Graph scattering transforms (GSTs) offer training-free deep GCN models that extract features…

Signal Processing · Electrical Eng. & Systems 2020-01-28 Vassilis N. Ioannidis , Siheng Chen , Georgios B. Giannakis

Graph neural networks (GNNs) are the most widely adopted model in graph-structured data oriented learning and representation. Despite their extraordinary success in real-world applications, understanding their working mechanism by theory is…

Machine Learning · Computer Science 2023-05-16 Huayi Tang , Yong Liu

Graph Convolutional Networks (GCNs) are extensively utilized for deep learning on graphs. The large data sizes of graphs and their vertex features make scalable training algorithms and distributed memory systems necessary. Since the…

Machine Learning · Computer Science 2022-12-14 Gunduz Vehbi Demirci , Aparajita Haldar , Hakan Ferhatosmanoglu

Graph Convolutional Networks (GCNs) have become a pivotal method in machine learning for modeling functions over graphs. Despite their widespread success across various applications, their statistical properties (e.g., consistency,…

Machine Learning · Computer Science 2025-04-17 Juntong Chen , Johannes Schmidt-Hieber , Claire Donnat , Olga Klopp

Spectral Graph Convolutional Networks (GCNs) have gained popularity in graph machine learning applications due, in part, to their flexibility in specification of network propagation rules. These propagation rules are often constructed as…

Machine Learning · Computer Science 2024-10-02 Mustafa Coşkun , Ananth Grama , Mehmet Koyutürk

Graph Convolutional Networks (GCNs) have emerged as the state-of-the-art method for graph-based learning tasks. However, training GCNs at scale is still challenging, hindering both the exploration of more sophisticated GCN architectures and…

Machine Learning · Computer Science 2022-03-29 Cheng Wan , Youjie Li , Ang Li , Nam Sung Kim , Yingyan Lin

Graph Convolutional Networks (GCNs) have shown very powerful for graph data representation and learning tasks. Existing GCNs usually conduct feature aggregation on a fixed neighborhood graph in which each node computes its representation by…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Bo Jiang , Beibei Wang , Jin Tang , Bin Luo

Graph Convolutional Networks (GCNs) have been drawing significant attention with the power of representation learning on graphs. Unlike Convolutional Neural Networks (CNNs), which are able to take advantage of stacking very deep layers,…

Machine Learning · Computer Science 2020-06-16 Guohao Li , Chenxin Xiong , Ali Thabet , Bernard Ghanem

Graph Convolutional Networks (GCNs) and their variants have experienced significant attention and have become the de facto methods for learning graph representations. GCNs derive inspiration primarily from recent deep learning approaches,…

Machine Learning · Computer Science 2019-06-21 Felix Wu , Tianyi Zhang , Amauri Holanda de Souza , Christopher Fifty , Tao Yu , Kilian Q. Weinberger