English
Related papers

Related papers: Learning Long Range Dependencies on Graphs via Ran…

200 papers

Transformers have achieved remarkable success across domains, motivating the rise of Graph Transformers (GTs) as attention-based architectures for graph-structured data. A key design choice in GTs is the use of Graph Neural Network…

Machine Learning · Computer Science 2026-05-29 Javier Porras-Valenzuela , Zhiyang Wang , Xiaotao Shang , Yusu Wang , Alejandro Ribeiro

Graph Neural Networks (GNNs) have become important machine learning tools for graph analysis, and its explainability is crucial for safety, fairness, and robustness. Layer-wise relevance propagation for GNNs (GNN-LRP) evaluates the…

Machine Learning · Computer Science 2026-05-25 Ping Xiong , Thomas Schnake , Michael Gastegger , Grégoire Montavon , Klaus-Robert Müller , Shinichi Nakajima

To capture spatial relationships and temporal dynamics in traffic data, spatio-temporal models for traffic forecasting have drawn significant attention in recent years. Most of the recent works employed graph neural networks(GNN) with…

Machine Learning · Computer Science 2021-04-02 Amit Roy , Kashob Kumar Roy , Amin Ahsan Ali , M Ashraful Amin , A K M Mahbubur Rahman

Existing Graph Neural Networks (GNNs) compute the message exchange between nodes by either aggregating uniformly (convolving) the features of all the neighboring nodes, or by applying a non-uniform score (attending) to the features. Recent…

Machine Learning · Computer Science 2023-03-02 Adrián Javaloy , Pablo Sanchez-Martin , Amit Levi , Isabel Valera

Graph neural networks (GNNs) are shown to be successful in modeling applications with graph structures. However, training an accurate GNN model requires a large collection of labeled data and expressive features, which might be inaccessible…

Machine Learning · Computer Science 2019-06-03 Ziniu Hu , Changjun Fan , Ting Chen , Kai-Wei Chang , Yizhou Sun

Graph representation learning (GRL) methods, such as graph neural networks and graph transformer models, have been successfully used to analyze graph-structured data, mainly focusing on node classification and link prediction tasks.…

Machine Learning · Computer Science 2023-08-21 Van Thuy Hoang , O-Joun Lee

How to enable efficient analytics over such data has been an increasingly important research problem. Given the sheer size of such social networks, many existing studies resort to sampling techniques that draw random nodes from an online…

Social and Information Networks · Computer Science 2015-05-12 Zhuojie Zhou , Nan Zhang , Gautam Das

Representation learning in dynamic graphs is a challenging problem because the topology of graph and node features vary at different time. This requires the model to be able to effectively capture both graph topology information and…

Machine Learning · Computer Science 2021-11-16 Xintao Xiang , Tiancheng Huang , Donglin Wang

Graph Neural Networks (GNNs) rely on the graph structure to define an aggregation strategy where each node updates its representation by combining information from its neighbours. A known limitation of GNNs is that, as the number of layers…

Machine Learning · Computer Science 2022-01-19 Davide Buffelli , Fabio Vandin

Graph Neural Networks (GNNs) have shown great potential in the field of graph representation learning. Standard GNNs define a local message-passing mechanism which propagates information over the whole graph domain by stacking multiple…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Xiaoxin He , Bryan Hooi , Thomas Laurent , Adam Perold , Yann LeCun , Xavier Bresson

Graph Transformers (GTs) have demonstrated a strong capability in modeling graph structures by addressing the intrinsic limitations of graph neural networks (GNNs), such as over-smoothing and over-squashing. Recent studies have proposed…

Machine Learning · Computer Science 2025-02-28 Chaohao Yuan , Kangfei Zhao , Ercan Engin Kuruoglu , Liang Wang , Tingyang Xu , Wenbing Huang , Deli Zhao , Hong Cheng , Yu Rong

The recent advancements in graph neural networks (GNNs) have led to state-of-the-art performances in various applications, including chemo-informatics, question-answering systems, and recommender systems. However, scaling up these methods…

Machine Learning · Computer Science 2022-03-30 Ryoma Sato , Makoto Yamada , Hisashi Kashima

Higher-order features bring significant accuracy gains in semantic dependency parsing. However, modeling higher-order features with exact inference is NP-hard. Graph neural networks (GNNs) have been demonstrated to be an effective tool for…

Computation and Language · Computer Science 2022-01-28 Bin Li , Yunlong Fan , Yikemaiti Sataer , Zhiqiang Gao

Graph Neural Networks (GNNs) have received increasing attention for representation learning in various machine learning tasks. However, most existing GNNs applying neighborhood aggregation usually perform poorly on the graph with…

Machine Learning · Computer Science 2024-10-29 Wei Zhuo , Guang Tan

Graph Neural Networks (GNNs) are the subject of intense focus by the machine learning community for problems involving relational reasoning. GNNs can be broadly divided into spatial and spectral approaches. Spatial approaches use a form of…

Machine Learning · Statistics 2021-01-05 Kimberly Stachenfeld , Jonathan Godwin , Peter Battaglia

Graph vertex embeddings based on random walks have become increasingly influential in recent years, showing good performance in several tasks as they efficiently transform a graph into a more computationally digestible format while…

Machine Learning · Statistics 2021-07-22 Dominik Kloepfer , Angelica I. Aviles-Rivero , Daniel Heydecker

Devising and analyzing learning models for spatiotemporal network data is of importance for tasks including forecasting, anomaly detection, and multi-agent coordination, among others. Graph Convolutional Neural Networks (GCNNs) are an…

Machine Learning · Computer Science 2022-07-01 Mohammad Sabbaqi , Elvin Isufi

As an emerging artificial intelligence technology, graph neural networks (GNNs) have exhibited promising performance across a wide range of graph-related applications. However, information exchanges among neighbor nodes in GNN pose new…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-10 Jun Li , Weiwei Zhang , Kang Wei , Guangji Chen , Long Shi , Wen Chen

A fundamental challenge in understanding graph neural networks (GNNs) lies in characterizing their optimization dynamics and loss landscape geometry, critical for improving interpretability and robustness. While mode connectivity, a lens…

Machine Learning · Computer Science 2025-02-19 Bingheng Li , Zhikai Chen , Haoyu Han , Shenglai Zeng , Jingzhe Liu , Jiliang Tang

Wireless networks are inherently graph-structured, which can be utilized in graph representation learning to solve complex wireless network optimization problems. In graph representation learning, feature vectors for each entity in the…

Information Theory · Computer Science 2024-10-28 Maryam Mohsenivatani , Samad Ali , Vismika Ranasinghe , Nandana Rajatheva , Matti Latva-Aho