English
Related papers

Related papers: Knowledge-Guided Adaptive Mixture of Experts for P…

200 papers

Data-driven weather models have recently achieved state-of-the-art performance, yet progress has plateaued in recent years. This paper introduces a Mixture of Experts (MoWE) approach as a novel paradigm to overcome these limitations, not by…

This paper presents Variables Adaptive Mixture of Experts (VAMoE), a novel framework for incremental weather forecasting that dynamically adapts to evolving spatiotemporal patterns in real time data. Traditional weather prediction models…

Machine Learning · Computer Science 2025-07-21 Hao Chen , Han Tao , Guo Song , Jie Zhang , Yunlong Yu , Yonghan Dong , Lei Bai

We propose a novel adaptive Mixture-of-Experts (MoE) framework for time series forecasting that enhances expert specialization by incorporating expert-specific loss information directly into the training process. Notably, the overall…

Machine Learning · Statistics 2026-05-12 Btissame El Mahtout , Florian Ziel

Real-world time series exhibit complex and evolving dynamics, making accurate forecasting extremely challenging. Recent multi-modal forecasting methods leverage textual information such as news reports to improve prediction, but most rely…

Machine Learning · Computer Science 2026-01-30 Lige Zhang , Ali Maatouk , Jialin Chen , Leandros Tassiulas , Rex Ying

Weather forecasting is a crucial task for meteorologic research, with direct social and economic impacts. Recently, data-driven weather forecasting models based on deep learning have shown great potential, achieving superior performance…

Atmospheric and Oceanic Physics · Physics 2024-08-26 Lihao Gan , Xin Man , Chenghong Zhang , Jie Shao

Precipitation forecasting remains a persistent challenge in tropical regions like Vietnam, where complex topography and convective instability often limit the accuracy of Numerical Weather Prediction (NWP) models. While data-driven…

Artificial Intelligence · Computer Science 2026-03-27 Huyen Ngoc Tran , Dung Trung Tran , Hong Nguyen , Xuan Vu Phan , Nam-Phong Nguyen

Precipitation nowcasting is vital for flood warning, agricultural management, and emergency response, yet two bottlenecks persist: the prohibitive cost of modeling million-scale spatiotemporal tokens from multi-variate atmospheric fields,…

Artificial Intelligence · Computer Science 2026-03-17 Xinyu Xiao , Sen Lei , Eryun Liu , Shiming Xiang , Hao Li , Cheng Yuan , Yuan Qi , Qizhao Jin

Robust 3D object detection under adverse weather conditions is crucial for autonomous driving. However, most existing methods simply combine all weather samples for training while overlooking data distribution discrepancies across different…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Hongwei Lin , Xun Huang , Chenglu Wen , Cheng Wang

Forecasting time series with extreme events is critical yet challenging due to their high variance, irregular dynamics, and sparse but high-impact nature. While existing methods excel in modeling dominant regular patterns, their performance…

Machine Learning · Computer Science 2026-01-14 Yaohui Huang , Runmin Zou , Yun Wang , Laeeq Aslam , Ruipeng Dong

Non-recurrent conditions caused by incidents are different from recurrent conditions that follow periodic patterns. Existing traffic speed prediction studies are incident-agnostic and use one single model to learn all possible patterns from…

Machine Learning · Computer Science 2024-09-06 Zemian Ke , Haocheng Duan , Sean Qian

Mixture-of-Experts (MoE) models are designed to enhance the efficiency of large language models (LLMs) without proportionally increasing the computational demands. However, their deployment on edge devices still faces significant challenges…

Machine Learning · Computer Science 2024-08-21 Shuzhang Zhong , Ling Liang , Yuan Wang , Runsheng Wang , Ru Huang , Meng Li

Adverse weather removal tasks like deraining, desnowing, and dehazing are usually treated as separate tasks. However, in practical autonomous driving scenarios, the type, intensity,and mixing degree of weather are unknown, so handling each…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Yulin Luo , Rui Zhao , Xiaobao Wei , Jinwei Chen , Yijie Lu , Shenghao Xie , Tianyu Wang , Ruiqin Xiong , Ming Lu , Shanghang Zhang

This study develops and empirically validates a Mixture of Experts (MoE) framework for stock price prediction across heterogeneous volatility regimes using real market data. The proposed model combines a Recurrent Neural Network (RNN)…

Statistical Finance · Quantitative Finance 2025-08-06 Diego Vallarino

The Mixture-of-Experts (MoE) approach has demonstrated outstanding scalability in multi-task learning including low-level upstream tasks such as concurrent removal of multiple adverse weather effects. However, the conventional MoE…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Rongyu Zhang , Yulin Luo , Jiaming Liu , Huanrui Yang , Zhen Dong , Denis Gudovskiy , Tomoyuki Okuno , Yohei Nakata , Kurt Keutzer , Yuan Du , Shanghang Zhang

Mixture-of-Experts (MoE) presents a naturally compatible and scalable framework for multimodal learning, demonstrating strong adaptability across diverse modalities and tasks. Despite its growing success, a comprehensive and systematic…

Machine Learning · Computer Science 2026-05-28 Liangwei Nathan Zheng , Wei Emma Zhang , Olaf Maennel , Lin Yue , Weitong Chen

Mixture of Experts (MoE) is a popular framework for modeling heterogeneity in data for regression, classification, and clustering. For regression and cluster analyses of continuous data, MoE usually use normal experts following the Gaussian…

Methodology · Statistics 2017-01-26 Faicel Chamroukhi

The Mixture-of-Experts (MoE) paradigm has emerged as a promising solution to scale up model capacity while maintaining inference efficiency. However, deploying MoE models across heterogeneous end-cloud environments poses new challenges in…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-11 Zheming Yang , Yunqing Hu , Sheng Sun , Wen Ji

The emergence of large-scale Mixture of Experts (MoE) models represents a significant advancement in artificial intelligence, offering enhanced model capacity and computational efficiency through conditional computation. However, deploying…

Machine Learning · Computer Science 2025-01-23 Jiacheng Liu , Peng Tang , Wenfeng Wang , Yuhang Ren , Xiaofeng Hou , Pheng-Ann Heng , Minyi Guo , Chao Li

Modern applications increasingly involve many heterogeneous input streams, such as clinical sensors, wearable device data, imaging, and text, each with distinct measurement models, sampling rates, and noise characteristics. We define this…

Machine Learning · Computer Science 2026-03-03 Xing Han , Hsing-Huan Chung , Joydeep Ghosh , Paul Pu Liang , Suchi Saria

Mixture of Experts (MoE) models enable parameter-efficient scaling through sparse expert activations, yet optimizing their inference and memory costs remains challenging due to limited understanding of their specialization behavior. We…

Machine Learning · Computer Science 2026-03-09 Marmik Chaudhari , Idhant Gulati , Nishkal Hundia , Pranav Karra , Shivam Raval
‹ Prev 1 2 3 10 Next ›