English
Related papers

Related papers: Graph Representational Learning: When Does More Ex…

200 papers

We analyze the performance of graph neural network (GNN) architectures from the perspective of random graph theory. Our approach promises to complement existing lenses on GNN analysis, such as combinatorial expressive power and worst-case…

Machine Learning · Computer Science 2023-10-12 Drake Brown , Trevor Garrity , Kaden Parker , Jason Oliphant , Stone Carson , Cole Hanson , Zachary Boyd

Graph neural networks (GNNs) have received great attention due to their success in various graph-related learning tasks. Several GNN frameworks have then been developed for fast and easy implementation of GNN models. Despite their…

Machine Learning · Computer Science 2022-11-08 Xin Huang , Jongryool Kim , Bradley Rees , Chul-Ho Lee

Graph Neural Networks (GNNs) and Graph Transformers (GTs) are now a fundamental paradigm for graph learning, combining the representation-learning capabilities of deep models with the sample efficiency induced by their inductive biases.…

Machine Learning · Computer Science 2026-05-19 Stefano Carotti , Marco Pacini , Alessio Gravina , Davide Bacciu , Bruno Lepri , Sebastiano Bontorin

Time series forecasting is an extensively studied subject in statistics, economics, and computer science. Exploration of the correlation and causation among the variables in a multivariate time series shows promise in enhancing the…

Machine Learning · Computer Science 2021-04-22 Chao Shang , Jie Chen , Jinbo Bi

Graph Neural Networks (GNNs) have emerged as prominent models for representation learning on graph structured data. GNNs follow an approach of message passing analogous to 1-dimensional Weisfeiler Lehman (1-WL) test for graph isomorphism…

Machine Learning · Computer Science 2022-03-18 Mohammed Haroon Dupty , Wee Sun Lee

Lots of learning tasks require dealing with graph data which contains rich relation information among elements. Modeling physics systems, learning molecular fingerprints, predicting protein interface, and classifying diseases demand a model…

Machine Learning · Computer Science 2021-10-07 Jie Zhou , Ganqu Cui , Shengding Hu , Zhengyan Zhang , Cheng Yang , Zhiyuan Liu , Lifeng Wang , Changcheng Li , Maosong Sun

Graph neural networks (GNNs) are widely used for learning node embeddings in graphs, typically adopting a message-passing scheme. This approach, however, leads to the neighbor explosion problem, with exponentially growing computational and…

Machine Learning · Computer Science 2025-07-08 Zichao Yue , Chenhui Deng , Zhiru Zhang

Current graph neural networks (GNNs) lack generalizability with respect to scales (graph sizes, graph diameters, edge weights, etc..) when solving many graph analysis problems. Taking the perspective of synthesizing graph theory programs,…

Machine Learning · Computer Science 2020-10-27 Hao Tang , Zhiao Huang , Jiayuan Gu , Bao-Liang Lu , Hao Su

Graph Neural Networks (GNNs) have enjoyed wide spread applications in graph-structured data. However, existing graph based applications commonly lack annotated data. GNNs are required to learn latent patterns from a limited amount of…

Machine Learning · Computer Science 2023-03-22 Wenqi Wei , Mu Qiao , Divyesh Jadav

We propose a new approach to the problem of neural network expressivity, which seeks to characterize how structural properties of a neural network family affect the functions it is able to compute. Our approach is based on an interrelated…

Machine Learning · Statistics 2017-06-20 Maithra Raghu , Ben Poole , Jon Kleinberg , Surya Ganguli , Jascha Sohl-Dickstein

Graph neural networks (GNNs) are quickly becoming the standard approach for learning on graph structured data across several domains, but they lack transparency in their decision-making. Several perturbation-based approaches have been…

Machine Learning · Computer Science 2021-11-29 Anna Himmelhuber , Mitchell Joblin , Martin Ringsquandl , Thomas Runkler

Graph Neural Networks (GNNs) show strong expressive power on graph data mining, by aggregating information from neighbors and using the integrated representation in the downstream tasks. The same aggregation methods and parameters for each…

Machine Learning · Computer Science 2022-03-22 Xiaojun Ma , Qin Chen , Yuanyi Ren , Guojie Song , Liang Wang

In recent years, deep neural networks (DNNs) have known an important rise in popularity. However, although they are state-of-the-art in many machine learning challenges, they still suffer from several limitations. For example, DNNs require…

Machine Learning · Computer Science 2021-10-11 Carlos Lassance , Myriam Bontonou , Mounia Hamidouche , Bastien Pasdeloup , Lucas Drumetz , Vincent Gripon

Networks are a powerful tool to model complex systems, and the definition of many Graph Neural Networks (GNN), Deep Learning algorithms that can handle networks, has opened a new way to approach many real-world problems that would be hardly…

Machine Learning · Computer Science 2021-09-28 Marco Grassia , Manlio De Domenico , Giuseppe Mangioni

Theoretical studies on the representation power of GNNs have been centered around understanding the equivalence of GNNs, using WL-Tests for detecting graph isomorphism. In this paper, we argue that such equivalence ignores the accompanying…

Machine Learning · Computer Science 2024-08-26 P. Krishna Kumar a , Harish G. Ramaswamy

Graph Neural Networks (GNNs) have emerged as the predominant method for analyzing graph-structured data. However, canonical GNNs have limited expressive power and generalization capability, thus triggering the development of more expressive…

Machine Learning · Computer Science 2024-08-07 Danial Saber , Amirali Salehi-Abari

We present our ongoing work on understanding the limitations of graph convolutional networks (GCNs) as well as our work on generalizations of graph convolutions for representing more complex node attribute dependencies. Based on an analysis…

Machine Learning · Computer Science 2018-05-07 Mathias Niepert , Alberto Garcia-Duran

Graph Convolutional Neural Networks (GCNNs) are generalizations of CNNs to graph-structured data, in which convolution is guided by the graph topology. In many cases where graphs are unavailable, existing methods manually construct graphs…

Machine Learning · Computer Science 2019-09-17 Xiang Gao , Wei Hu , Zongming Guo

Graph structure learning is a well-established problem that aims at optimizing graph structures adaptive to specific graph datasets to help message passing neural networks (i.e., GNNs) to yield effective and robust node embeddings. However,…

Machine Learning · Computer Science 2023-06-21 Wentao Zhao , Qitian Wu , Chenxiao Yang , Junchi Yan

Graph Neural Networks (GNNs) have emerged as a dominant paradigm for learning on graph-structured data, thanks to their ability to jointly exploit node features and relational information encoded in the graph topology. This joint modeling,…

Machine Learning · Computer Science 2025-12-30 Yongyu Wang