English
Related papers

Related papers: DORA: A Scalable Asynchronous Reinforcement Learni…

200 papers

As augmented and virtual reality evolve, achieving seamless synchronization between physical and digital realms remains a critical challenge, especially for real-time applications where delays affect the user experience. This paper presents…

Networking and Internet Architecture · Computer Science 2025-10-30 Elif Ebru Ohri , Qi Liao , Anastasios Giovanidis , Francesca Fossati , Nour-El-Houda Yellas

Continual Learning (CL) with foundation models has recently emerged as a promising paradigm to exploit abundant knowledge acquired during pre-training for tackling sequential tasks. However, existing prompt-based and Low-Rank…

Machine Learning · Computer Science 2025-03-10 Yichen Wu , Hongming Piao , Long-Kai Huang , Renzhen Wang , Wanhua Li , Hanspeter Pfister , Deyu Meng , Kede Ma , Ying Wei

Self-correction is a highly desirable capability of large language models (LLMs), yet it has consistently been found to be largely ineffective in modern LLMs. Current methods for training self-correction typically depend on either multiple…

Reinforcement learning (RL) has become a central post-training tool for improving the reasoning abilities of large language models (LLMs). In these systems, the rollout, the trajectory sampled from a prompt to termination, including…

Reinforcement learning has been applied in operation research and has shown promise in solving large combinatorial optimization problems. However, existing works focus on developing neural network architectures for certain problems. These…

Optimization and Control · Mathematics 2023-03-24 Ching Pui Wan , Tung Li , Jason Min Wang

Recent advances in Large Language Models(LLMs) have enabled strong performance in long-form writing, but current training paradigms remain limited: Supervised Fine-Tuning (SFT) remains constrained by data saturation and performance…

Computation and Language · Computer Science 2026-04-21 Xuanyu Lei , Chenliang Li , Yuning Wu , Kaiming Liu , Weizhou Shen , Peng Li , Ming Yan , Fei Huang , Ya-Qin Zhang , Yang Liu

RAG-based question-answering (QA) in specialist domains faces a cold-start problem: lack of evaluative benchmarks and absence of labeled data for post-training. We present DoRA (Domain-oriented RAG Assessment), a novel benchmark…

Computation and Language · Computer Science 2026-05-28 Bao Gia Doan , Aditya Joshi , Pantelis Elinas , Aarya Bodhankar , Oscar Leslie , Tom Marchant , Flora Salim

Recent breakthroughs both in reinforcement learning and trajectory optimization have made significant advances towards real world robotic system deployment. Reinforcement learning (RL) can be applied to many problems without needing any…

Robotics · Computer Science 2019-10-23 Guillaume Bellegarda , Katie Byl

Learning a set of tasks over time, also known as continual learning (CL), is one of the most challenging problems in artificial intelligence due to catastrophic forgetting. Large language models (LLMs) are often impractical to frequent…

Machine Learning · Computer Science 2025-10-28 Jaya Krishna Mandivarapu

Autonomous robotic systems, like autonomous vehicles and robotic search and rescue, require efficient on-device training for continuous adaptation of Deep Reinforcement Learning (DRL) models in dynamic environments. This research is…

Robotics · Computer Science 2023-09-18 Zexin Li , Aritra Samanta , Yufei Li , Andrea Soltoggio , Hyoseung Kim , Cong Liu

Despite recent advances in natural language understanding and generation, and decades of research on the development of conversational bots, building automated agents that can carry on rich open-ended conversations with humans "in the wild"…

The advent of large language models (LLMs) has revolutionized natural language processing, enabling unprecedented capabilities in understanding and generating human-like text. However, the computational cost and convergence times associated…

Computation and Language · Computer Science 2024-11-26 Kerim Büyükakyüz

The growing complexity of Edge Video Analytics (EVA) facilitates new kind of intelligent applications, but creates challenges in real-time inference serving systems. State-of-the-art (SOTA) scheduling systems optimize global workload…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-25 Lucas Liebe , Thanh-Tung Nguyen , Dongman Lee

Though significant advancements have been achieved in developing long-context large language models (LLMs), the compromised quality of LLM-synthesized data for supervised fine-tuning (SFT) often affects the long-context performance of SFT…

Computation and Language · Computer Science 2024-10-29 Jiajie Zhang , Zhongni Hou , Xin Lv , Shulin Cao , Zhenyu Hou , Yilin Niu , Lei Hou , Yuxiao Dong , Ling Feng , Juanzi Li

Reinforcement learning has become a cornerstone for aligning and unlocking the reasoning capabilities of large-scale models. At its core, the training loop of GRPO and its variants alternates between rollout sampling and policy update.…

Machine Learning · Computer Science 2026-05-21 Xikai Zhang , Yongzhi Li , Likang Xiao , Yingze Zhang , Yanhua Cheng , Quan Chen , Peng Jiang , Wenjun Wu , Liu Liu

Powered by deep representation learning, reinforcement learning (RL) provides an end-to-end learning framework capable of solving self-driving (SD) tasks without manual designs. However, time-varying nonstationary environments cause…

Robotics · Computer Science 2023-03-09 Tao Li , Haozhe Lei , Quanyan Zhu

The rapid proliferation of satellite constellations in Space-Air-Ground Integrated Networks (SAGIN) presents significant challenges for network management. Conventional flat network architectures struggle with synchronization and data…

Networking and Internet Architecture · Computer Science 2025-07-29 Qiyuan Peng , Qi Zhang , Yue Gao , Kun Qiu

Deep reinforcement learning (DRL) methods have recently shown promise in path planning tasks. However, when dealing with global planning tasks, these methods face serious challenges such as poor convergence and generalization. To this end,…

Machine Learning · Computer Science 2024-01-10 Guoming Huang , Mingxin Hou , Xiaofang Yuan , Shuqiao Huang , Yaonan Wang

Reinforcement learning (RL) is a critical stage in post-training large language models (LLMs), involving repeated interaction between rollout generation, reward evaluation, and centralized learning. Distributing rollout execution offers…

Large language models (LLMs) are increasingly used as interactive agents, but optimizing them for long-horizon decision making remains difficult because current methods are largely purely reactive, which weakens both exploration and credit…

Computation and Language · Computer Science 2026-05-08 Xiangyuan Xue , Yifan Zhou , Zidong Wang , Shengji Tang , Philip Torr , Wanli Ouyang , Lei Bai , Zhenfei Yin