English
Related papers

Related papers: Recurrent Distance Filtering for Graph Representat…

200 papers

Recurrent Neural Networks (RNNs) are among the most successful machine learning models for sequence modelling, but tend to suffer from an exponential increase in the number of parameters when dealing with large multidimensional data. To…

Machine Learning · Computer Science 2021-05-12 Yao Lei Xu , Danilo P. Mandic

Graph representation learning aims to effectively encode high-dimensional sparse graph-structured data into low-dimensional dense vectors, which is a fundamental task that has been widely studied in a range of fields, including machine…

Graph Neural Networks (GNNs) have emerged as powerful tools for learning on graph-structured data, but often struggle to balance local and global information. While graph Transformers aim to address this by enabling long-range interactions,…

Machine Learning · Computer Science 2025-11-18 Jeongwhan Choi , Seungjun Park , Sumin Park , Sung-Bae Cho , Noseong Park

Graph Neural Networks (GNNs) and Graph Transformers (GTs) are now a fundamental paradigm for graph learning, combining the representation-learning capabilities of deep models with the sample efficiency induced by their inductive biases.…

Machine Learning · Computer Science 2026-05-19 Stefano Carotti , Marco Pacini , Alessio Gravina , Davide Bacciu , Bruno Lepri , Sebastiano Bontorin

Temporal graphs exhibit dynamic interactions between nodes over continuous time, whose topologies evolve with time elapsing. The whole temporal neighborhood of nodes reveals the varying preferences of nodes. However, previous works usually…

Machine Learning · Computer Science 2023-04-18 Tongya Zheng , Xinchao Wang , Zunlei Feng , Jie Song , Yunzhi Hao , Mingli Song , Xingen Wang , Xinyu Wang , Chun Chen

Temporal graph is an abstraction for modeling dynamic systems that consist of evolving interaction elements. In this paper, we aim to solve an important yet neglected problem -- how to learn information from high-order neighbors in temporal…

Machine Learning · Computer Science 2023-04-17 Zehong Wang , Qi Li , Donghua Yu

Learning graph-structured data with graph neural networks (GNNs) has been recently emerging as an important field because of its wide applicability in bioinformatics, chemoinformatics, social network analysis and data mining. Recent GNN…

Machine Learning · Computer Science 2021-12-16 Cheolhyeong Kim , Haeseong Moon , Hyung Ju Hwang

Graph neural networks (GNN) typically rely on localized message passing, requiring increasing depth to capture long range dependencies. In this work, we introduce Graph Linear Transformations, a linear transformation that realizes direct…

Machine Learning · Computer Science 2026-01-19 Marshall Rosenhoover , Huaming Zhang

Graph Neural Networks (GNNs) that are based on the message passing (MP) paradigm generally exchange information between 1-hop neighbors to build node representations at each layer. In principle, such networks are not able to capture…

Machine Learning · Computer Science 2023-11-29 Vijay Prakash Dwivedi , Ladislav Rampášek , Mikhail Galkin , Ali Parviz , Guy Wolf , Anh Tuan Luu , Dominique Beaini

Graph Convolutional Networks (GCNs) gained traction for graph representation learning, with recent attention on improving performance on heterophilic graphs for various real-world applications. The localized feature aggregation in a typical…

Machine Learning · Computer Science 2025-07-30 Garv Kaushik

Hypergraphs offer a generalized framework for capturing high-order relationships between entities and have been widely applied in various domains, including healthcare, social networks, and bioinformatics. Hypergraph neural networks, which…

Machine Learning · Computer Science 2025-12-03 Akash Choudhuri , Yongjian Zhong , Bijaya Adhikari

Graph neural networks (GNNs) rely mainly on the message-passing paradigm to propagate node features and build interactions, and different graph learning problems require different ranges of node interactions. In this work, we explore the…

Machine Learning · Computer Science 2026-01-08 Fang Wu , Siyuan Li , Stan Z. Li

Numerous works have proven that existing neighbor-averaging Graph Neural Networks cannot efficiently catch structure features, and many works show that injecting structure, distance, position or spatial features can significantly improve…

Machine Learning · Computer Science 2021-12-07 Zhiguo Huang , Xiaowei Chen , Bojuan Wang

Machine learning on graphs is an important and ubiquitous task with applications ranging from drug design to friendship recommendation in social networks. The primary challenge in this domain is finding a way to represent, or encode, graph…

Social and Information Networks · Computer Science 2018-04-11 William L. Hamilton , Rex Ying , Jure Leskovec

Graph Neural Networks (GNNs) have emerged as promising solutions for collaborative filtering (CF) through the modeling of user-item interaction graphs. The nucleus of existing GNN-based recommender systems involves recursive message passing…

Machine Learning · Computer Science 2024-05-21 Peiyan Zhang , Yuchen Yan , Xi Zhang , Chaozhuo Li , Senzhang Wang , Feiran Huang , Sunghun Kim

Graph neural networks (GNNs) have been widely used in representation learning on graphs and achieved state-of-the-art performance in tasks such as node classification and link prediction. However, most existing GNNs are designed to learn…

Machine Learning · Computer Science 2020-02-06 Seongjun Yun , Minbyul Jeong , Raehyun Kim , Jaewoo Kang , Hyunwoo J. Kim

How to properly model graphs is a long-existing and important problem in NLP area, where several popular types of graphs are knowledge graphs, semantic graphs and dependency graphs. Comparing with other data structures, such as sequences…

Computation and Language · Computer Science 2019-07-16 Linfeng Song

Graph Neural Networks (GNNs) have been widely used for the representation learning of various structured graph data. While promising, most existing GNNs oversimplified the complexity and diversity of the edges in the graph, and thus…

Machine Learning · Computer Science 2021-10-07 Hao Peng , Ruitong Zhang , Yingtong Dou , Renyu Yang , Jingyi Zhang , Philip S. Yu

Graph Neural Networks (GNNs) are based on repeated aggregations of information across nodes' neighbors in a graph. However, because common neighbors are shared between different nodes, this leads to repeated and inefficient computations. We…

Machine Learning · Computer Science 2019-06-11 Zhihao Jia , Sina Lin , Rex Ying , Jiaxuan You , Jure Leskovec , Alex Aiken

Graph neural networks (GNNs) largely rely on the message-passing paradigm, where nodes iteratively aggregate information from their neighbors. Yet, standard message passing neural networks (MPNNs) face well-documented theoretical and…

Machine Learning · Computer Science 2026-05-15 Juan Amboage , Ernst Röell , Patrick Schnider , Bastian Rieck