English
Related papers

Related papers: GNN-MoE: Context-Aware Patch Routing using GNNs fo…

200 papers

Pavement infrastructure monitoring is challenged by complex spatial dependencies, changing environmental conditions, and non-linear deterioration across road networks. Traditional Pavement Management Systems (PMS) remain largely reactive,…

Machine Learning · Computer Science 2025-11-06 Mohsin Mahmud Topu , Mahfuz Ahmed Anik , Azmine Toushik Wasi , Md Manjurul Ahsan

Despite much research, Graph Neural Networks (GNNs) still do not display the favorable scaling properties of other deep neural networks such as Convolutional Neural Networks and Transformers. Previous work has identified issues such as…

Machine Learning · Computer Science 2023-12-19 Ameen Ali , Hakan Cevikalp , Lior Wolf

Capturing long-range dependencies in feature representations is crucial for many visual recognition tasks. Despite recent successes of deep convolutional networks, it remains challenging to model non-local context relations between visual…

Computer Vision and Pattern Recognition · Computer Science 2019-05-29 Songyang Zhang , Shipeng Yan , Xuming He

Graph neural networks (GNN) has been successfully applied to operate on the graph-structured data. Given a specific scenario, rich human expertise and tremendous laborious trials are usually required to identify a suitable GNN architecture.…

Machine Learning · Computer Science 2019-09-11 Kaixiong Zhou , Qingquan Song , Xiao Huang , Xia Hu

Next Point-of-Interest (POI) recommendation is a critical task in location-based services, aiming to predict users' next visits based on their check-in histories. While many existing methods leverage Graph Neural Networks (GNNs) to…

Information Retrieval · Computer Science 2025-06-13 Yu Lei , Limin Shen , Zhu Sun , Tiantian He , Yew-Soon Ong

Graph Neural Networks (GNNs) have shown great potential in the field of graph representation learning. Standard GNNs define a local message-passing mechanism which propagates information over the whole graph domain by stacking multiple…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Xiaoxin He , Bryan Hooi , Thomas Laurent , Adam Perold , Yann LeCun , Xavier Bresson

Normalization is known to help the optimization of deep neural networks. Curiously, different architectures require specialized normalization methods. In this paper, we study what normalization is effective for Graph Neural Networks (GNNs).…

Machine Learning · Computer Science 2021-06-14 Tianle Cai , Shengjie Luo , Keyulu Xu , Di He , Tie-Yan Liu , Liwei Wang

Graph Neural Networks (GNNs) have already been widely used in various graph mining tasks. However, recent works reveal that the learned weights (channels) in well-trained GNNs are highly redundant, which inevitably limits the performance of…

Machine Learning · Computer Science 2023-10-05 Liang Zeng , Jin Xu , Zijun Yao , Yanqiao Zhu , Jian Li

The increasing size of input graphs for graph neural networks (GNNs) highlights the demand for using multi-GPU platforms. However, existing multi-GPU GNN systems optimize the computation and communication individually based on the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-28 Yuke Wang , Boyuan Feng , Zheng Wang , Tong Geng , Kevin Barker , Ang Li , Yufei Ding

Graph neural networks (GNNs) are gaining increasing popularity as a promising approach to machine learning on graphs. Unlike traditional graph workloads where each vertex/edge is associated with a scalar, GNNs attach a feature tensor to…

Machine Learning · Computer Science 2020-09-30 Yuwei Hu , Zihao Ye , Minjie Wang , Jiali Yu , Da Zheng , Mu Li , Zheng Zhang , Zhiru Zhang , Yida Wang

This paper reviews graph convolutional neural networks (GCNNs) through the lens of edge-variant graph filters. The edge-variant graph filter is a finite order, linear, and local recursion that allows each node, in each iteration, to weigh…

Machine Learning · Computer Science 2019-03-05 Elvin Isufi , Fernando Gama , Alejandro Ribeiro

Graph foundation models (GFMs) have recently attracted interest due to the promise of graph neural network (GNN) architectures that generalize zero-shot across graphs of arbitrary scales, feature dimensions, and domains. While existing work…

Machine Learning · Computer Science 2026-03-25 Benjamin Gutteridge , Michael Bronstein , Xiaowen Dong

Real-time particle transverse momentum ($p_T$) estimation in high-energy physics demands algorithms that are both efficient and accurate under strict hardware constraints. Static machine learning models degrade under high pileup and lack…

Machine Learning · Computer Science 2026-04-21 Md Abrar Jahin , Shahriar Soudeep , M. F. Mridha , Muhammad Mostafa Monowar , Md. Abdul Hamid

Graph Neural Networks (GNNs) have shown to be powerful tools for graph analytics. The key idea is to recursively propagate and aggregate information along edges of the given graph. Despite their success, however, the existing GNNs are…

Machine Learning · Computer Science 2020-11-16 Dongsheng Luo , Wei Cheng , Wenchao Yu , Bo Zong , Jingchao Ni , Haifeng Chen , Xiang Zhang

Link prediction is a classical problem in graph analysis with many practical applications. For directed graphs, recently developed deep learning approaches typically analyze node similarities through contrastive learning and aggregate…

Machine Learning · Computer Science 2025-06-26 Yuyang Zhang , Xu Shen , Yu Xie , Ka-Chun Wong , Weidun Xie , Chengbin Peng

Graph Neural Networks (GNNs) set the state-of-the-art in representation learning for graph-structured data. They are used in many domains, from online social networks to complex molecules. Most GNNs leverage the message-passing paradigm and…

Machine Learning · Computer Science 2025-03-06 Tuğrul Hasan Karabulut , İnci M. Baytaş

Graph Neural Networks (GNNs) have achieved remarkable success in various applications, but their performance can be sensitive to specific data properties of the graph datasets they operate on. Current literature on understanding the…

Machine Learning · Computer Science 2023-10-31 Ting Wei Li , Qiaozhu Mei , Jiaqi Ma

The advancement of generative artificial intelligence (GAI) has driven revolutionary applications like ChatGPT. The widespread of these applications relies on the mixture of experts (MoE), which contains multiple experts and selectively…

Networking and Internet Architecture · Computer Science 2024-02-13 Jiacheng Wang , Hongyang Du , Dusit Niyato , Jiawen Kang , Zehui Xiong , Dong In Kim , Khaled B. Letaief

Graph Neural Networks (GNNs) are popular models for machine learning on graphs that typically follow the message-passing paradigm, whereby the feature of a node is updated recursively upon aggregating information over its neighbors. While…

Machine Learning · Computer Science 2024-05-07 Federico Barbero , Ameya Velingker , Amin Saberi , Michael Bronstein , Francesco Di Giovanni

Over the last decade, graph neural networks (GNNs) have made significant progress in numerous graph machine learning tasks. In real-world applications, where domain shifts occur and labels are often unavailable for a new target domain,…

Machine Learning · Computer Science 2024-11-21 Zepeng Zhang , Olga Fink