English
Related papers

Related papers: Survey on Generalization Theory for Graph Neural N…

200 papers

This paper studies the problem of learning message propagation strategies for graph neural networks (GNNs). One of the challenges for graph neural networks is that of defining the propagation strategy. For instance, the choices of…

Machine Learning · Computer Science 2023-10-03 Teng Xiao , Zhengyu Chen , Donglin Wang , Suhang Wang

Graph convolutional neural networks (GCNNs) have received much attention recently, owing to their capability in handling graph-structured data. Among the existing GCNNs, many methods can be viewed as instances of a neural message passing…

Machine Learning · Computer Science 2021-03-19 Tien Huu Do , Duc Minh Nguyen , Giannis Bekoulis , Adrian Munteanu , Nikos Deligiannis

We analyze the universality and generalization of graph neural networks (GNNs) on attributed graphs, i.e., with node attributes. To this end, we propose pseudometrics over the space of all attributed graphs that describe the fine-grained…

Machine Learning · Computer Science 2025-08-27 Levi Rauchwerger , Stefanie Jegelka , Ron Levie

Current graph neural networks (GNNs) lack generalizability with respect to scales (graph sizes, graph diameters, edge weights, etc..) when solving many graph analysis problems. Taking the perspective of synthesizing graph theory programs,…

Machine Learning · Computer Science 2020-10-27 Hao Tang , Zhiao Huang , Jiayuan Gu , Bao-Liang Lu , Hao Su

Graph Neural Nets (GNNs) have received increasing attentions, partially due to their superior performance in many node and graph classification tasks. However, there is a lack of understanding on what they are learning and how sophisticated…

Machine Learning · Computer Science 2020-06-11 Ting Chen , Song Bian , Yizhou Sun

Since the proposal of the graph neural network (GNN) by Gori et al. (2005) and Scarselli et al. (2008), one of the major problems in training GNNs was their struggle to propagate information between distant nodes in the graph. We propose a…

Machine Learning · Computer Science 2021-03-10 Uri Alon , Eran Yahav

Graph-based Neural Networks (GNNs) are recent models created for learning representations of nodes (and graphs), which have achieved promising results when detecting patterns that occur in large-scale data relating different entities. Among…

Machine Learning · Computer Science 2021-08-20 Ronald D. R. Pereira , Fabrício Murai

In the last decade or so, we have witnessed deep learning reinvigorating the machine learning field. It has solved many problems in the domains of computer vision, speech recognition, natural language processing, and various other tasks…

Machine Learning · Computer Science 2021-09-09 Lilapati Waikhom , Ripon Patgiri

Graph neural networks (GNNs) and message passing neural networks (MPNNs) have been proven to be expressive for subgraph structures in many applications. Some applications in heterogeneous graphs require explicit edge modeling, such as…

Machine Learning · Computer Science 2021-12-17 Xin Liu , Yangqiu Song

Deep learning methods are achieving ever-increasing performance on many artificial intelligence tasks. A major limitation of deep models is that they are not amenable to interpretability. This limitation can be circumvented by developing…

Machine Learning · Computer Science 2022-07-05 Hao Yuan , Haiyang Yu , Shurui Gui , Shuiwang Ji

Since the onset of the COVID-19 pandemic, there has been a growing interest in studying epidemiological models. Traditional mechanistic models mathematically describe the transmission mechanisms of infectious diseases. However, they often…

Machine Learning · Computer Science 2024-09-10 Zewen Liu , Guancheng Wan , B. Aditya Prakash , Max S. Y. Lau , Wei Jin

Graph Neural Networks (GNNs) have emerged as a powerful tool to learn from graph-structured data. A paramount example of such data is the brain, which operates as a network, from the micro-scale of neurons, to the macro-scale of regions.…

Machine Learning · Computer Science 2022-11-17 Ahmed ElGazzar , Rajat Thomas , Guido van Wingen

Graph neural networks (GNNs) are among the most powerful tools in deep learning. They routinely solve complex problems on unstructured networks, such as node classification, graph classification, or link prediction, with high accuracy.…

Machine Learning · Computer Science 2023-08-21 Maciej Besta , Torsten Hoefler

In this paper we cast neural networks defined on graphs as message-passing neural networks (MPNNs) in order to study the distinguishing power of different classes of such models. We are interested in whether certain architectures are able…

Machine Learning · Computer Science 2020-04-07 Floris Geerts , Filip Mazowiecki , Guillermo A. Pérez

Graph Neural Networks (GNNs), especially message-passing neural networks (MPNNs), have emerged as powerful architectures for learning on graphs in diverse applications. However, MPNNs face challenges when modeling non-local interactions in…

Machine Learning · Statistics 2024-01-31 Ilyes Batatia , Lars L. Schaaf , Huajie Chen , Gábor Csányi , Christoph Ortner , Felix A. Faber

In recent years, Graph Neural Networks (GNNs) have made significant advances in processing structured data. However, most of them primarily adopted a model-centric approach, which simplifies graphs by converting them into undirected formats…

Machine Learning · Computer Science 2024-12-12 Henan Sun , Xunkai Li , Daohan Su , Junyi Han , Rong-Hua Li , Guoren Wang

A long-standing goal in deep learning has been to characterize the learning behavior of black-box models in a more interpretable manner. For graph neural networks (GNNs), considerable advances have been made in formalizing what functions…

Machine Learning · Computer Science 2024-06-19 Chenxiao Yang , Qitian Wu , David Wipf , Ruoyu Sun , Junchi Yan

Graph neural networks (GNNs) are shown to be successful in modeling applications with graph structures. However, training an accurate GNN model requires a large collection of labeled data and expressive features, which might be inaccessible…

Machine Learning · Computer Science 2019-06-03 Ziniu Hu , Changjun Fan , Ting Chen , Kai-Wei Chang , Yizhou Sun

Wireless networks are inherently graph-structured, which can be utilized in graph representation learning to solve complex wireless network optimization problems. In graph representation learning, feature vectors for each entity in the…

Information Theory · Computer Science 2024-10-28 Maryam Mohsenivatani , Samad Ali , Vismika Ranasinghe , Nandana Rajatheva , Matti Latva-Aho

Graph neural networks (GNNs), which are capable of learning representations from graphical data, are naturally suitable for modeling molecular systems. This review introduces GNNs and their various applications for small organic molecules.…

Machine Learning · Computer Science 2023-10-10 Yuyang Wang , Zijie Li , Amir Barati Farimani