English
Related papers

Related papers: RAST-MoE-RL: A Regime-Aware Spatio-Temporal MoE Fr…

200 papers

Efficient timing in ride-matching is crucial for improving the performance of ride-hailing and ride-pooling services, as it determines the number of drivers and passengers considered in each matching process. Traditional batched matching…

Machine Learning · Computer Science 2025-03-18 Yiman Bao , Jie Gao , Jinke He , Frans A. Oliehoek , Oded Cats

An online resource scheduling framework is proposed for minimizing the sum of weighted task latency for all the Internet of things (IoT) users, by optimizing offloading decision, transmission power and resource allocation in the large-scale…

Machine Learning · Computer Science 2020-04-16 Feibo Jiang , Kezhi Wang , Li Dong , Cunhua Pan , Kun Yang

Recent advances in reinforcement learning (RL) have substantially improved the training of large-scale language models, leading to significant gains in generation quality and reasoning ability. However, most existing research focuses on…

Machine Learning · Computer Science 2026-01-13 Di Zhang , Xun Wu , Shaohan Huang , Lingjie Jiang , Yaru Hao , Li Dong , Zewen Chi , Zhifang Sui , Furu Wei

Non-stationary time series forecasting is challenged by evolving distribution shifts that static models struggle to capture. While Mixture-of-Experts (MoE) architectures offer a promising paradigm for decoupling complex drift patterns,…

Machine Learning · Computer Science 2026-05-21 Jiawen Zhu , Shuhan Liu , Di Weng , Yingcai Wu

In this paper, we introduce a novel dynamic expert selection framework for Mixture of Experts (MoE) models, aiming to enhance computational efficiency and model performance by adjusting the number of activated experts based on input…

Machine Learning · Computer Science 2024-03-13 Quzhe Huang , Zhenwei An , Nan Zhuang , Mingxu Tao , Chen Zhang , Yang Jin , Kun Xu , Kun Xu , Liwei Chen , Songfang Huang , Yansong Feng

Mixture-of-Experts (MoE) based Large Language Models (LLMs) have achieved superior performance, yet the massive memory overhead caused by storing multiple expert networks severely hinders their practical deployment. Singular Value…

Machine Learning · Computer Science 2026-02-13 Zhendong Mi , Yixiao Chen , Pu Zhao , Xiaodong Yu , Hao Wang , Yanzhi Wang , Shaoyi Huang

Imitation learning enables robots to acquire manipulation skills from demonstrations, yet deploying a policy across tasks with heterogeneous dynamics remains challenging, as models tend to average over distinct behavioral modes present in…

Autonomous driving (AD) scenarios are inherently complex and diverse, posing significant challenges for a single deep learning model to effectively cover all possible conditions, such as varying weather, traffic densities, and road types.…

Robotics · Computer Science 2025-12-09 Wei-Bin Kou , Guangxu Zhu , Jingreng Lei , Chen Zhang , Yik-Chung Wu , Jianping Wang

Mixture-of-Experts (MoE) has emerged as an effective approach to reduce the computational overhead of Transformer architectures by sparsely activating a subset of parameters for each token while preserving high model capacity. This paradigm…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Dohwan Ko , Jinyoung Park , Seoung Choi , Sanghyeok Lee , Seohyun Lee , Hyunwoo J. Kim

We propose Tensor-Trained Low-Rank Adaptation Mixture of Experts (TT-LoRA MoE), a novel computational framework integrating Parameter-Efficient Fine-Tuning (PEFT) with sparse MoE routing to address scalability challenges in large model…

Machine Learning · Computer Science 2026-01-27 Pradip Kunwar , Minh N. Vu , Maanak Gupta , Mahmoud Abdelsalam , Manish Bhattarai

Existing Real-Time Object Detection (RTOD) methods commonly adopt YOLO-like architectures for their favorable trade-off between accuracy and speed. However, these models rely on static dense computation that applies uniform processing to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Xu Lin , Jinlong Peng , Zhenye Gan , Jiawen Zhu , Jun Liu

Mixture-of-Experts (MoE) models have emerged as a dominant paradigm for efficient LLM scaling, yet adapting them to non-English downstream tasks remains challenging. Existing fine-tuning approaches treat MoE models as monolithic learners,…

Computation and Language · Computer Science 2026-05-28 Guanzhi Deng , Kuan Wu , Haibo Wang , Shing Yin Wong , Sichun Luo , Linqi Song

Ride-sourcing services are now reshaping the way people travel by effectively connecting drivers and passengers through mobile internets. Online matching between idle drivers and waiting passengers is one of the most key components in a…

Multiagent Systems · Computer Science 2019-02-19 Jintao Ke , Feng Xiao , Hai Yang , Jieping Ye

Modern applications increasingly involve many heterogeneous input streams, such as clinical sensors, wearable device data, imaging, and text, each with distinct measurement models, sampling rates, and noise characteristics. We define this…

Machine Learning · Computer Science 2026-03-03 Xing Han , Hsing-Huan Chung , Joydeep Ghosh , Paul Pu Liang , Suchi Saria

Recently, mixture of experts (MoE) has become a popular paradigm for achieving the trade-off between modal capacity and efficiency of multi-modal large language models (MLLMs). Different from previous efforts, we are dedicated to exploring…

Multimedia · Computer Science 2025-02-13 Qiong Wu , Zhaoxi Ke , Yiyi Zhou , Xiaoshuai Sun , Rongrong Ji

Effective network congestion control strategies are key to keeping the Internet (or any large computer network) operational. Network congestion control has been dominated by hand-crafted heuristics for decades. Recently,…

We present a new practical framework based on deep reinforcement learning and decision-time planning for real-world vehicle repositioning on ride-hailing (a type of mobility-on-demand, MoD) platforms. Our approach learns the spatiotemporal…

Machine Learning · Computer Science 2021-07-13 Yan Jiao , Xiaocheng Tang , Zhiwei Qin , Shuaiji Li , Fan Zhang , Hongtu Zhu , Jieping Ye

Mixture-of-Experts (MoE) language models introduce unique challenges for safety alignment due to their sparse routing mechanisms, which can enable degenerate optimization behaviors under standard full-parameter fine-tuning. In our…

Machine Learning · Computer Science 2026-04-07 Jiacheng Liang , Yuhui Wang , Tanqiu Jiang , Ting Wang

Reinforcement learning (RL) has equipped LLM agents with a strong ability to solve complex tasks. However, existing RL methods normally use a \emph{single} policy network, causing \emph{simplicity bias} where simple tasks occupy most…

Artificial Intelligence · Computer Science 2026-05-20 Shengtian Yang , Yu Li , Shuo He , Yewen Li , Qingpeng Cai , Peng Jiang , Lei Feng

Mixture-of-Experts (MoE) models achieve efficient scaling through sparse expert activation, but often suffer from suboptimal routing decisions due to distribution shifts in deployment. While existing test-time adaptation methods could…

Computation and Language · Computer Science 2025-10-17 Guinan Su , Yanwu Yang , Li Shen , Lu Yin , Shiwei Liu , Jonas Geiping
‹ Prev 1 2 3 10 Next ›