English
Related papers

Related papers: Graph Neural Tangent Kernel: Fusing Graph Neural N…

200 papers

Convolutional Neural Networks (CNNs) have been very successful at solving a variety of computer vision tasks such as object classification and detection, semantic segmentation, activity understanding, to name just a few. One key enabling…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Guohao Li , Matthias Müller , Guocheng Qian , Itzel C. Delgadillo , Abdulellah Abualshour , Ali Thabet , Bernard Ghanem

Lots of learning tasks require dealing with graph data which contains rich relation information among elements. Modeling physics systems, learning molecular fingerprints, predicting protein interface, and classifying diseases demand a model…

Machine Learning · Computer Science 2021-10-07 Jie Zhou , Ganqu Cui , Shengding Hu , Zhengyan Zhang , Cheng Yang , Zhiyuan Liu , Lifeng Wang , Changcheng Li , Maosong Sun

Message-passing Graph Neural Networks (GNNs) are often criticized for their limited expressiveness, issues like over-smoothing and over-squashing, and challenges in capturing long-range dependencies. Conversely, Graph Transformers (GTs) are…

Machine Learning · Computer Science 2025-11-04 Yuankai Luo , Lei Shi , Xiao-Ming Wu

Graph Neural Networks (GNNs) are exemplary deep models designed for graph data. Message passing mechanism enables GNNs to effectively capture graph topology and push the performance boundaries across various graph tasks. However, the trend…

Neural and Evolutionary Computing · Computer Science 2025-09-29 Huizhe Zhang , Jintang Li , Yuchang Zhu , Liang Chen , Li Kuang

Although graph neural networks (GNNs) have made great progress recently on learning from graph-structured data in practice, their theoretical guarantee on generalizability remains elusive in the literature. In this paper, we provide a…

Machine Learning · Computer Science 2020-06-26 Shuai Zhang , Meng Wang , Sijia Liu , Pin-Yu Chen , Jinjun Xiong

Inferring properties of graph-structured data, e.g., the solubility of molecules, essentially involves learning the implicit mapping from graphs to their properties. This learning process is often costly for graph property learners like…

Machine Learning · Computer Science 2025-05-22 Chen Zhang , Weixin Bu , Zeyi Ren , Zhengwu Liu , Yik-Chung Wu , Ngai Wong

The application of graph neural networks (GNNs) to the domain of electrical power grids has high potential impact on smart grid monitoring. Even though there is a natural correspondence of power flow to message-passing in GNNs, their…

Graph Neural Networks (GNNs) have emerged as powerful representation learning tools for capturing complex dependencies within diverse graph-structured data. Despite their success in a wide range of graph mining tasks, GNNs have raised…

Machine Learning · Computer Science 2024-06-19 Wenzhao Jiang , Hao Liu , Hui Xiong

Rule learning is critical to improving knowledge graph (KG) reasoning due to their ability to provide logical and interpretable explanations. Recently, Graph Neural Networks (GNNs) with tail entity scoring achieve the state-of-the-art…

Machine Learning · Computer Science 2024-04-11 Haiquan Qiu , Yongqi Zhang , Yong Li , Quanming Yao

While deep learning has achieved remarkable success across a wide range of applications, its theoretical understanding of representation learning remains limited. Deep neural kernels provide a principled framework to interpret…

Machine Learning · Computer Science 2025-11-11 Yong-Ming Tian , Shuang Liang , Shao-Qun Zhang , Feng-Lei Fan

Graph Neural Networks (GNNs) are information processing architectures for signals supported on graphs. They are presented here as generalizations of convolutional neural networks (CNNs) in which individual layers contain banks of graph…

Machine Learning · Computer Science 2021-02-01 Luana Ruiz , Fernando Gama , Alejandro Ribeiro

Graph neural networks (GNNs) have demonstrated a significant boost in prediction performance on graph data. At the same time, the predictions made by these models are often hard to interpret. In that regard, many efforts have been made to…

Machine Learning · Computer Science 2023-05-24 Yiqiao Li , Jianlong Zhou , Sunny Verma , Fang Chen

Graph neural networks (GNNs) have gained traction over the past few years for their superior performance in numerous machine learning tasks. Graph Convolutional Neural Networks (GCN) are a common variant of GNNs that are known to have high…

Machine Learning · Computer Science 2022-07-06 Sannat Singh Bhasin , Vaibhav Holani , Divij Sanjanwala

Many physical systems can be best understood as sets of discrete data with associated relationships. Where previously these sets of data have been formulated as series or image data to match the available machine learning architectures,…

Graph Neural Networks (GNNs) are a powerful representational tool for solving problems on graph-structured inputs. In almost all cases so far, however, they have been applied to directly recovering a final solution from raw inputs, without…

Machine Learning · Statistics 2020-01-16 Petar Veličković , Rex Ying , Matilde Padovano , Raia Hadsell , Charles Blundell

Neural networks have achieved remarkable empirical performance, while the current theoretical analysis is not adequate for understanding their success, e.g., the Neural Tangent Kernel approach fails to capture their key feature learning…

Machine Learning · Computer Science 2023-10-20 Zhenmei Shi , Junyi Wei , Yingyu Liang

Graph neural networks (GNNs) are emerging for machine learning research on graph-structured data. GNNs achieve state-of-the-art performance on many tasks, but they face scalability challenges when it comes to real-world applications that…

Machine Learning · Computer Science 2026-04-02 Shichang Zhang , Atefeh Sohrabizadeh , Cheng Wan , Zijie Huang , Ziniu Hu , Yewen Wang , Yingyan , Lin , Jason Cong , Yizhou Sun

The training dynamics and generalization properties of neural networks (NN) can be precisely characterized in function space via the neural tangent kernel (NTK). Structural changes to the NTK during training reflect feature learning and…

Machine Learning · Statistics 2022-02-11 Haozhe Shan , Blake Bordelon

Graph learning is currently dominated by graph kernels, which, while powerful, suffer some significant limitations. Convolutional Neural Networks (CNNs) offer a very appealing alternative, but processing graphs with CNNs is not trivial. To…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Antoine Jean-Pierre Tixier , Giannis Nikolentzos , Polykarpos Meladianos , Michalis Vazirgiannis

This paper studies four Graph Neural Network architectures (GNNs) for a graph classification task on a synthetic dataset created using classic generative models of Network Science. Since the synthetic networks do not contain (node or edge)…

Social and Information Networks · Computer Science 2024-01-12 Walid Guettala , László Gulyás