English
Related papers

Related papers: Greener GRASS: Enhancing GNNs with Encoding, Rewir…

200 papers

Graph neural networks (GNNs) have shown significant success in learning graph representations. However, recent studies reveal that GNNs often fail to outperform simple MLPs on heterophilous graph tasks, where connected nodes may differ in…

Machine Learning · Computer Science 2025-04-10 Songwei Zhao , Yuan Jiang , Zijing Zhang , Yang Yu , Hechang Chen

Recently Graph Neural Network (GNN) has been applied successfully to various NLP tasks that require reasoning, such as multi-hop machine reading comprehension. In this paper, we consider a novel case where reasoning is needed over graphs…

Computation and Language · Computer Science 2020-04-13 Ming Tu , Jing Huang , Xiaodong He , Bowen Zhou

Graph Neural Networks (GNNs) are prominent in handling sparse and unstructured data efficiently and effectively. Specifically, GNNs were shown to be highly effective for node classification tasks, where labelled information is available for…

Machine Learning · Computer Science 2022-12-01 Moshe Eliasof , Eldad Haber , Eran Treister

Various graph neural networks (GNNs) have been proposed to solve node classification tasks in machine learning for graph data. GNNs use the structural information of graph data by aggregating the features of neighboring nodes. However, they…

Machine Learning · Computer Science 2022-12-29 Yuga Oishi , Ken kaneiwa

Graph Neural Networks (GNNs) have emerged as the leading paradigm for learning over graph-structured data. However, their performance is limited by issues inherent to graph topology, most notably oversquashing and oversmoothing. Recent…

Machine Learning · Computer Science 2025-08-29 Hugo Attali , Thomas Papastergiou , Nathalie Pernelle , Fragkiskos D. Malliaros

Graph-structured data is ubiquitous in practice and often processed using graph neural networks (GNNs). With the adoption of recent laws ensuring the ``right to be forgotten'', the problem of graph data removal has become of significant…

Machine Learning · Computer Science 2022-11-01 Eli Chien , Chao Pan , Olgica Milenkovic

Graph neural networks (GNNs) have been widely used to learn vector representation of graph-structured data and achieved better task performance than conventional methods. The foundation of GNNs is the message passing procedure, which…

Machine Learning · Computer Science 2022-01-31 Takeshi D. Itoh , Takatomi Kubo , Kazushi Ikeda

This paper introduces Graph Convolutional Recurrent Network (GCRN), a deep learning model able to predict structured sequences of data. Precisely, GCRN is a generalization of classical recurrent neural networks (RNN) to data structured by…

Machine Learning · Statistics 2016-12-23 Youngjoo Seo , Michaël Defferrard , Pierre Vandergheynst , Xavier Bresson

Graph neural networks (GNNs) have shown advantages in graph-based analysis tasks. However, most existing methods have the homogeneity assumption and show poor performance on heterophilic graphs, where the linked nodes have dissimilar…

Machine Learning · Computer Science 2024-04-16 Tianhao Peng , Wenjun Wu , Haitao Yuan , Zhifeng Bao , Zhao Pengrui , Xin Yu , Xuetao Lin , Yu Liang , Yanjun Pu

Intelligent Transportation System (ITS) is crucial for improving traffic congestion, reducing accidents, optimizing urban planning, and more. However, the complexity of traffic networks has rendered traditional machine learning and…

Machine Learning · Computer Science 2024-09-20 Hourun Li , Yusheng Zhao , Zhengyang Mao , Yifang Qin , Zhiping Xiao , Jiaqi Feng , Yiyang Gu , Wei Ju , Xiao Luo , Ming Zhang

Graph Neural Networks (GNNs) are effective tools for graph representation learning. Most GNNs rely on a recursive neighborhood aggregation scheme, named message passing, thereby their theoretical expressive power is limited to the…

Machine Learning · Computer Science 2023-09-19 Dingmin Wang , Shengchao Liu , Hanchen Wang , Bernardo Cuenca Grau , Linfeng Song , Jian Tang , Song Le , Qi Liu

We present a simple and effective approach to incorporating syntactic structure into neural attention-based encoder-decoder models for machine translation. We rely on graph-convolutional networks (GCNs), a recent class of neural networks…

Computation and Language · Computer Science 2020-06-22 Jasmijn Bastings , Ivan Titov , Wilker Aziz , Diego Marcheggiani , Khalil Sima'an

Graph neural networks (GNNs) have become powerful tools for processing graph-based information in various domains. A desirable property of GNNs is transferability, where a trained network can swap in information from a different graph…

Machine Learning · Computer Science 2024-06-24 A. Martina Neuman , Jason J. Bramburger

The mining and exploitation of graph structural information have been the focal points in the study of complex networks. Traditional structural measures in Network Science focus on the analysis and modelling of complex networks from the…

Social and Information Networks · Computer Science 2023-06-21 Mingshan Jia , Bogdan Gabrys , Katarzyna Musial

Graph neural networks (GNNs) have been widely investigated in the field of semi-supervised graph machine learning. Most methods fail to exploit adequate graph information when labeled data is limited, leading to the problem of…

Machine Learning · Computer Science 2023-03-15 Linxuan Song , Wenxuan Tu , Sihang Zhou , Xinwang Liu , En Zhu

Graph Neural Networks (GNNs) have emerged as powerful tools for predicting outcomes in graph-structured data. However, a notable limitation of GNNs is their inability to provide robust uncertainty estimates, which undermines their…

Machine Learning · Computer Science 2024-10-10 S. Akansha

We propose a new network architecture, Gated Attention Networks (GaAN), for learning on graphs. Unlike the traditional multi-head attention mechanism, which equally consumes all attention heads, GaAN uses a convolutional sub-network to…

Machine Learning · Computer Science 2018-03-21 Jiani Zhang , Xingjian Shi , Junyuan Xie , Hao Ma , Irwin King , Dit-Yan Yeung

We aim to better understand attention over nodes in graph neural networks (GNNs) and identify factors influencing its effectiveness. We particularly focus on the ability of attention GNNs to generalize to larger, more complex or noisy…

Machine Learning · Computer Science 2019-10-29 Boris Knyazev , Graham W. Taylor , Mohamed R. Amer

Attention-based graph neural networks (GNNs), such as graph attention networks (GATs), have become popular neural architectures for processing graph-structured data and learning node embeddings. Despite their empirical success, these models…

Machine Learning · Statistics 2023-06-07 Dexiong Chen , Paolo Pellizzoni , Karsten Borgwardt

Graph neural networks (GNNs) provide a powerful and scalable solution for modeling continuous spatial data. However, they often rely on Euclidean distances to construct the input graphs. This assumption can be improbable in many real-world…

Machine Learning · Computer Science 2023-02-20 Konstantin Klemmer , Nathan Safir , Daniel B. Neill