English
Related papers

Related papers: DeltaGNN: Graph Neural Network with Information Fl…

200 papers

We explore the feasibility of combining Graph Neural Network-based policy architectures with Deep Reinforcement Learning as an approach to problems in systems. This fits particularly well with operations on networks, which naturally take…

Machine Learning · Computer Science 2021-12-02 Oliver Hope , Eiko Yoneki

Graph neural networks (GNNs) are a class of deep models that operate on data with arbitrary topology represented as graphs. We introduce an efficient memory layer for GNNs that can jointly learn node representations and coarsen the graph.…

Machine Learning · Computer Science 2020-06-11 Amir Hosein Khasahmadi , Kaveh Hassani , Parsa Moradi , Leo Lee , Quaid Morris

Graph Neural Networks (GNNs) are a powerful representational tool for solving problems on graph-structured inputs. In almost all cases so far, however, they have been applied to directly recovering a final solution from raw inputs, without…

Machine Learning · Statistics 2020-01-16 Petar Veličković , Rex Ying , Matilde Padovano , Raia Hadsell , Charles Blundell

Uncovering rationales behind predictions of graph neural networks (GNNs) has received increasing attention over the years. Existing literature mainly focus on selecting a subgraph, through combinatorial optimization, to provide faithful…

Machine Learning · Computer Science 2023-03-07 Wenqian Li , Yinchuan Li , Zhigang Li , Jianye Hao , Yan Pang

Click-through rate (CTR) prediction is an essential task in web applications such as online advertising and recommender systems, whose features are usually in multi-field form. The key of this task is to model feature interactions among…

Information Retrieval · Computer Science 2020-07-27 Zekun Li , Zeyu Cui , Shu Wu , Xiaoyu Zhang , Liang Wang

Graph neural networks (GNNs) are widely used for learning node embeddings in graphs, typically adopting a message-passing scheme. This approach, however, leads to the neighbor explosion problem, with exponentially growing computational and…

Machine Learning · Computer Science 2025-07-08 Zichao Yue , Chenhui Deng , Zhiru Zhang

Graph convolutional networks (GCNs) have shown promising results in processing graph data by extracting structure-aware features. This gave rise to extensive work in geometric deep learning, focusing on designing network architectures that…

Machine Learning · Computer Science 2022-01-20 Yimeng Min , Frederik Wenkel , Guy Wolf

Graph representation learning methods are highly effective in handling complex non-Euclidean data by capturing intricate relationships and features within graph structures. However, traditional methods face challenges when dealing with…

Machine Learning · Computer Science 2025-02-25 Hang Gao , Chenhao Zhang , Fengge Wu , Junsuo Zhao , Changwen Zheng , Huaping Liu

Message-passing graph neural networks (GNNs) excel at capturing local relationships but struggle with long-range dependencies in graphs. In contrast, graph transformers (GTs) enable global information exchange but often oversimplify the…

Machine Learning · Computer Science 2024-10-08 Dexiong Chen , Till Hendrik Schulz , Karsten Borgwardt

Graph Neural Network (GNN) models on streaming graphs entail algorithmic challenges to continuously capture its dynamic state, as well as systems challenges to optimize latency, memory, and throughput during both inference and training. We…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-17 Rustam Guliyev , Aparajita Haldar , Hakan Ferhatosmanoglu

Graph Neural Networks (GNN) have shown a strong potential to be integrated into commercial products for network control and management. Early works using GNN have demonstrated an unprecedented capability to learn from different network…

Networking and Internet Architecture · Computer Science 2021-10-05 Miquel Ferriol-Galmés , José Suárez-Varela , Krzysztof Rusek , Pere Barlet-Ros , Albert Cabellos-Aparicio

Graph Neural Networks (GNNs) that are based on the message passing (MP) paradigm generally exchange information between 1-hop neighbors to build node representations at each layer. In principle, such networks are not able to capture…

Machine Learning · Computer Science 2023-11-29 Vijay Prakash Dwivedi , Ladislav Rampášek , Mikhail Galkin , Ali Parviz , Guy Wolf , Anh Tuan Luu , Dominique Beaini

Graph-structured data consisting of objects (i.e., nodes) and relationships among objects (i.e., edges) are ubiquitous. Graph-level learning is a matter of studying a collection of graphs instead of a single graph. Traditional graph-level…

Machine Learning · Computer Science 2022-06-01 Ge Zhang , Jia Wu , Jian Yang , Shan Xue , Wenbin Hu , Chuan Zhou , Hao Peng , Quan Z. Sheng , Charu Aggarwal

Recent years have witnessed remarkable success achieved by graph neural networks (GNNs) in many real-world applications such as recommendation and drug discovery. Despite the success, oversmoothing has been identified as one of the key…

Machine Learning · Computer Science 2022-06-17 Wei Jin , Xiaorui Liu , Yao Ma , Charu Aggarwal , Jiliang Tang

Graph Neural Networks (GNNs) have seen significant advances in recent years, yet their application to multigraphs, where parallel edges exist between the same pair of nodes, remains under-explored. Standard GNNs, designed for simple graphs,…

Machine Learning · Computer Science 2024-12-11 H. Çağrı Bilgi , Lydia Y. Chen , Kubilay Atasu

Deep learning methods for graphs achieve remarkable performance on many node-level and graph-level prediction tasks. However, despite the proliferation of the methods and their success, prevailing Graph Neural Networks (GNNs) neglect…

Machine Learning · Computer Science 2020-11-10 Emily Alsentzer , Samuel G. Finlayson , Michelle M. Li , Marinka Zitnik

Subgraph GNNs enhance message-passing GNNs expressivity by representing graphs as sets of subgraphs, demonstrating impressive performance across various tasks. However, their scalability is hindered by the need to process large numbers of…

Machine Learning · Computer Science 2025-06-02 Guy Bar-Shalom , Yam Eitan , Fabrizio Frasca , Haggai Maron

Node features of graph neural networks (GNNs) tend to become more similar with the increase of the network depth. This effect is known as over-smoothing, which we axiomatically define as the exponential convergence of suitable similarity…

Machine Learning · Computer Science 2023-03-21 T. Konstantin Rusch , Michael M. Bronstein , Siddhartha Mishra

Graph Neural Networks (GNNs) face two fundamental challenges when scaled to deep architectures: oversmoothing, where node representations converge to indistinguishable vectors, and oversquashing, where information from distant nodes fails…

Machine Learning · Computer Science 2026-03-30 Mostafa Haghir Chehreghani

Inspired by the immense success of deep learning, graph neural networks (GNNs) are widely used to learn powerful node representations and have demonstrated promising performance on different graph learning tasks. However, most real-world…

Machine Learning · Computer Science 2020-01-24 Kaize Ding , Yichuan Li , Jundong Li , Chenghao Liu , Huan Liu