English
Related papers

Related papers: Less is More: Strategic Expert Selection Outperfor…

200 papers

The sparse Mixture-of-Experts (Sparse-MoE) framework efficiently scales up model capacity in various domains, such as natural language processing and vision. Sparse-MoEs select a subset of the "experts" (thus, only a portion of the overall…

Machine Learning · Computer Science 2023-06-06 Shibal Ibrahim , Wenyu Chen , Hussein Hazimeh , Natalia Ponomareva , Zhe Zhao , Rahul Mazumder

Recently, forecasting the crowd flows has become an important research topic, and plentiful technologies have achieved good performances. As we all know, the flow at a citywide level is in a mixed state with several basic patterns (e.g.,…

Machine Learning · Computer Science 2022-05-18 Hongjun Wang , Jiyuan Chen , Zipei Fan , Zhiwen Zhang , Zekun Cai , Xuan Song

Spatio-temporal forecasting is an open research field whose interest is growing exponentially. In this work we focus on creating a complex deep neural framework for spatio-temporal traffic forecasting with comparatively very good…

Machine Learning · Computer Science 2020-10-22 Rodrigo de Medrano , José L. Aznarte

Traffic prediction in data-scarce, cross-city settings is challenging due to complex nonlinear dynamics and domain shifts. Existing methods often fail to capture traffic's inherent chaotic nature for effective few-shot learning. We propose…

Artificial Intelligence · Computer Science 2026-02-06 Abdul Joseph Fofanah , Lian Wen , David Chen , Alpha Alimamy Kamara , Zhongyi Zhang

Spatial-temporal network traffic forecasting is a challenging task due to the complex spatial relationships and dynamic temporal patterns present in each node. Traditional regression methods are not directly applicable to such graph data.…

Information Retrieval · Computer Science 2026-05-12 Jinming Xing , Guoheng Sun , Hui Sun , Linchao Pan , Shakir Mahmood , Xuanhao Luo , Muhammad Shahzad

Comprehensively and flexibly capturing the complex spatio-temporal dependencies of human motion is critical for multi-person motion prediction. Existing methods grapple with two primary limitations: i) Inflexible spatiotemporal…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Zheng Yin , Chengjian Li , Xiangbo Shu , Meiqi Cao , Rui Yan , Jinhui Tang

Predicting risk map of traffic accidents is vital for accident prevention and early planning of emergency response. Here, the challenge lies in the multimodal nature of urban big data. We propose a compact neural ensemble model to alleviate…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Wenshan Wang , Su Yang , Weishan Zhang

In the era of information explosion, spatio-temporal data mining serves as a critical part of urban management. Considering the various fields demanding attention, e.g., traffic state, human activity, and social event, predicting multiple…

Artificial Intelligence · Computer Science 2023-09-19 Zijian Zhang , Xiangyu Zhao , Qidong Liu , Chunxu Zhang , Qian Ma , Wanyu Wang , Hongwei Zhao , Yiqi Wang , Zitao Liu

Predicting a driver's cognitive state, or more specifically, modeling a driver's reaction time (RT) in response to the appearance of a potential hazard warrants urgent research. In the last two decades, the electric field that is generated…

Human-Computer Interaction · Computer Science 2019-05-28 Chun-Hsiang Chuang , Zehong Cao , Po-Tsang Chen , Chih-Sheng Huang , Nikhil R. Pal , Chin-Teng Lin

Finding the optimal configuration of Sparse Mixture-ofExperts (SMoE) that maximizes semantic differentiation among experts is essential for exploiting the full potential of MoE architectures. However, existing SMoE frameworks either heavily…

Machine Learning · Computer Science 2025-12-24 Sumin Park , Noseong Park

Distributed machine learning is becoming increasingly popular for geo-distributed data analytics, facilitating the collaborative analysis of data scattered across data centers in different regions. This paradigm eliminates the need for…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-28 Zonghang Li , Wenjiao Feng , Weibo Cai , Hongfang Yu , Long Luo , Gang Sun , Hongyang Du , Dusit Niyato

Traffic forecasting is a challenging spatio-temporal modeling task and a critical component of urban transportation management. Current studies mainly focus on deterministic predictions, with limited considerations on the uncertainty and…

Machine Learning · Computer Science 2026-04-20 Weijiang Xiong , Robert Fonod , Nikolas Geroliminis

Mixture-of-Experts (MoE) models have emerged as a promising direction for scaling vision architectures efficiently. Among them, Soft MoE improves training stability by assigning each token to all experts via continuous dispatch weights.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Chengxi Min , Wei Wang , Yahui Liu , Weixin Ye , Enver Sangineto , Qi Wang , Yao Zhao

Climate change is increasing the occurrence of extreme precipitation events, threatening infrastructure, agriculture, and public safety. Ensemble prediction systems provide probabilistic forecasts but exhibit biases and difficulties in…

Machine Learning · Computer Science 2025-04-09 Christopher Bülte , Sohir Maskey , Philipp Scholl , Jonas von Berg , Gitta Kutyniok

Spatio-temporal traffic forecasting is a core component of intelligent transportation systems, supporting various downstream tasks such as signal control and network-level traffic management. In real-world deployments, forecasting models…

Machine Learning · Computer Science 2026-02-17 Yue Wang , Areg Karapetyan , Djellel Difallah , Samer Madanat

Traffic flow forecasting has emerged as an indispensable mission for daily life, which is required to utilize the spatiotemporal relationship between each location within a time period under a graph structure to predict future flow.…

Machine Learning · Computer Science 2026-02-27 Runfei Chen

Accurate traffic forecasting is crucial for intelligent transportation systems, supporting effective traffic management, congestion reduction, and informed urban planning. However, traditional models often fail to adequately capture the…

Artificial Intelligence · Computer Science 2026-04-21 Dongyi He , Yuanquan Gao , Bin Jiang , He Yan

Accurate spatiotemporal traffic forecasting is vital for intelligent resource management in 5G and beyond. However, conventional AI approaches often fail to capture the intricate spatial and temporal patterns that exist, due to e.g., the…

Machine Learning · Computer Science 2025-07-29 Khalid Ali , Zineddine Bettouche , Andreas Kassler , Andreas Fischer

Traffic flow estimation (TFE) is crucial for urban intelligent traffic systems. While traditional on-road detectors are hindered by limited coverage and high costs, cloud computing and data mining of vehicular network data, such as driving…

Artificial Intelligence · Computer Science 2024-07-12 Doncheng Yuan , Jianzhe Xue , Jinshan Su , Wenchao Xu , Haibo Zhou

Graph Neural Networks (GNNs) have emerged as powerful tools for learning over graph-structured data, yet recent studies have shown that their performance gains are beginning to plateau. In many cases, well-established models such as GCN and…

Machine Learning · Computer Science 2026-02-13 Mohit Meena , Yash Punjabi , Abhishek A , Vishal Sharma , Mahesh Chandran