English
Related papers

Related papers: DORA: A Scalable Asynchronous Reinforcement Learni…

200 papers

Developing policies that can adjust to non-stationary environments is essential for real-world reinforcement learning applications. However, learning such adaptable policies in offline settings, with only a limited set of pre-collected…

Machine Learning · Computer Science 2025-03-28 Xinyu Zhang , Wenjie Qiu , Yi-Chen Li , Lei Yuan , Chengxing Jia , Zongzhang Zhang , Yang Yu

Reinforcement Learning (RL) has become the most effective post-training approach for improving the capabilities of Large Language Models (LLMs). In practice, because of the high demands on latency and memory, it is particularly challenging…

Reinforcement learning (RL) post-training has proven effective at unlocking reasoning, self-reflection, and tool-use capabilities in large language models. As models extend to omni-modal inputs and agentic multi-turn workflows, RL training…

Computation and Language · Computer Science 2026-04-15 Liujie Zhang , Benzhe Ning , Rui Yang , Xiaoyan Yu , Jiaxing Li , Lumeng Wu , Jia Liu , Minghao Li , Weihang Chen , Weiqi Hu , Lei Zhang

Reinforcement Learning with Verifiable Reward (RLVR) is a powerful method for enhancing the reasoning abilities of Large Language Models, but its full potential is limited by a lack of exploration in two key areas: Depth (the difficulty of…

Machine Learning · Computer Science 2026-04-14 Zhicheng Yang , Zhijiang Guo , Yinya Huang , Yongxin Wang , Dongchun Xie , Hanhui Li , Yiwei Wang , Xiaodan Liang , Jing Tang

Domain Incremental Learning (DIL) is a continual learning sub-branch that aims to address never-ending arrivals of new domains without catastrophic forgetting problems. Despite the advent of parameter-efficient fine-tuning (PEFT)…

Machine Learning · Computer Science 2025-10-21 Naeem Paeedeh , Mahardhika Pratama , Weiping Ding , Jimmy Cao , Wolfgang Mayer , Ryszard Kowalczyk

Reinforcement learning exhibits potential in enhancing the reasoning abilities of large language models, yet it is hard to scale for the low sample efficiency during the rollout phase. Existing methods attempt to improve efficiency by…

Machine Learning · Computer Science 2026-02-02 Deyang Kong , Qi Guo , Xiangyu Xi , Wei Wang , Jingang Wang , Xunliang Cai , Shikun Zhang , Wei Ye

Synchronous Reinforcement Learning (RL) post-training has emerged as a crucial step for enhancing Large Language Models (LLMs) with diverse capabilities. However, many systems designed to accelerate RL post-training still suffer from low…

General-purpose large language models (LLMs) are increasingly deployed in verticals such as telecommunications, where adaptation is hindered by scarce, low-information-density corpora and tight mobile/edge constraints. We propose Data…

Machine Learning · Computer Science 2025-11-11 Zhicheng Zhou , Jing Li , Suming Qiu , Junjie Huang , Linyuan Qiu , Zhijie Sun

As Low-Rank Adaptation (LoRA) becomes the standard approach for efficiently fine-tuning large language models (LLMs), shared clusters increasingly execute many concurrent LoRA training jobs over the same frozen backbone. While recent…

Machine Learning · Computer Science 2026-02-16 Kevin Li , Dibyadeep Saha , Avni Kanodia , Fan Lai

Fine-tuning is the primary methodology for tailoring pre-trained large language models to specific tasks. As the model's scale and the diversity of tasks expand, parameter-efficient fine-tuning methods are of paramount importance. One of…

Machine Learning · Computer Science 2024-01-10 Wenhan Xia , Chengwei Qin , Elad Hazan

Recent progress in Large Language Model (LLM) reasoning is increasingly driven by the refinement of post-training loss functions and alignment strategies. However, standard Reinforcement Learning (RL) paradigms like Group Relative Policy…

Machine Learning · Computer Science 2026-01-28 Kishan Panaganti , Zhenwen Liang , Wenhao Yu , Haitao Mi , Dong Yu

Large reasoning models (LRMs) already possess a latent capacity for long chain-of-thought reasoning. Prior work has shown that outcome-based reinforcement learning (RL) can incidentally elicit advanced reasoning behaviors such as…

Computation and Language · Computer Science 2025-05-28 Zhiyuan Hu , Yibo Wang , Hanze Dong , Yuhui Xu , Amrita Saha , Caiming Xiong , Bryan Hooi , Junnan Li

Dynamic obstacle avoidance (DOA) is a fundamental challenge for any autonomous vehicle, independent of whether it operates in sea, air, or land. This paper proposes a two-step architecture for handling DOA tasks by combining supervised and…

Robotics · Computer Science 2024-08-20 Fabian Hart , Martin Waltz , Ostap Okhrin

Large Language Models (LLMs) increasingly rely on reinforcement learning with verifiable rewards (RLVR) to elicit reliable chain-of-thought reasoning. However, the training process remains bottlenecked by the computationally expensive…

Machine Learning · Computer Science 2026-01-13 Bingshuai Liu , Ante Wang , Zijun Min , Liang Yao , Haibo Zhang , Yang Liu , Xu Han , Peng Li , Anxiang Zeng , Jinsong Su

Reinforcement learning (RL) has become a pivotal technology in the post-training phase of large language models (LLMs). Traditional task-colocated RL frameworks suffer from significant scalability bottlenecks, while task-separated RL…

Channel state information (CSI) plays a critical role in achieving the potential benefits of massive multiple input multiple output (MIMO) systems. In frequency division duplex (FDD) massive MIMO systems, the base station (BS) relies on…

Information Theory · Computer Science 2022-10-03 Zhengyang Hu , Guanzhang Liu , Qi Xie , Jiang Xue , Deyu Meng , Deniz Gunduz

Reinforcement Learning (RL) is a method for learning decision-making tasks that could enable robots to learn and adapt to their situation on-line. For an RL algorithm to be practical for robotic control tasks, it must learn in very few…

Artificial Intelligence · Computer Science 2015-03-19 Todd Hester , Michael Quinlan , Peter Stone

Reinforcement Learning (RL) or Deep Reinforcement Learning (DRL) is a powerful approach to solving Markov Decision Processes (MDPs) when the model of the environment is not known a priori. However, RL models are still faced with challenges…

Systems and Control · Electrical Eng. & Systems 2024-06-04 Kabirat Olayemi , Mien Van , Luke Maguire , Sean McLoone

Scaling multi-task low-rank adaptation (LoRA) to a large number of tasks induces catastrophic performance degradation, such as an accuracy drop from 88.2% to 2.0% on DOTA when scaling from 5 to 15 tasks. This failure is due to parameter and…

Machine Learning · Computer Science 2026-03-03 Zichen Tian , Antoine Ledent , Qianru Sun

Vision-Language-Action (VLA) models have emerged as a powerful paradigm for robotic manipulation. However, existing post-training methods face a dilemma between stability and exploration: Supervised Fine-Tuning (SFT) is constrained by…

Robotics · Computer Science 2026-03-17 Jiashun Li , Xiaoyu Shi , Hong Xie , Mingsheng Shang , Yun Lu