English
Related papers

Related papers: RollArt: Scaling Agentic RL Training via Disaggreg…

200 papers

Recently, the emergence of agentic RL has showcased that RL could also effectively improve the agentic reasoning ability of LLMs, yet the key design principles and optimal practices remain unclear. In this work, we conduct a comprehensive…

Computation and Language · Computer Science 2025-10-14 Zhaochen Yu , Ling Yang , Jiaru Zou , Shuicheng Yan , Mengdi Wang

Advancing reinforcement learning (RL) requires tools that are flexible enough to easily prototype new methods while avoiding impractically slow experimental turnaround times. To match the first requirement, the most popular RL libraries…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Albert Bou , Sebastian Dittert , Gianni De Fabritiis

Learning a world model for model-free Reinforcement Learning (RL) agents can significantly improve the sample efficiency by learning policies in imagination. However, building a world model for Multi-Agent RL (MARL) can be particularly…

Machine Learning · Computer Science 2025-09-03 Yang Zhang , Chenjia Bai , Bin Zhao , Junchi Yan , Xiu Li , Xuelong Li

As large language model (LLM) agents evolve from isolated tool users into coordinated teams, reinforcement learning (RL) must optimize not only individual actions but also how work is spawned, delegated, communicated, aggregated, and…

Computation and Language · Computer Science 2026-05-05 Chenchen Zhang

As a data-driven approach, multi-agent reinforcement learning (MARL) has made remarkable advances in solving cooperative residential load scheduling problems. However, centralized training, the most common paradigm for MARL, limits…

Multiagent Systems · Computer Science 2025-03-05 Zhaoming Qin , Nanqing Dong , Di Liu , Zhefan Wang , Junwei Cao

While reinforcement learning (RL) can empower autonomous agents by enabling self-improvement through interaction, its practical adoption remains challenging due to costly rollouts, limited task diversity, unreliable reward signals, and…

We study whether self-learning can scale LLM-based agents without relying on human-curated datasets or predefined rule-based rewards. Through controlled experiments in a search-agent setting, we identify two key determinants of scalable…

Artificial Intelligence · Computer Science 2025-10-22 Wangtao Sun , Xiang Cheng , Jialin Fan , Yao Xu , Xing Yu , Shizhu He , Jun Zhao , Kang Liu

Reinforcement Learning (RL) is a pivotal post-training technique for enhancing the reasoning capabilities of Large Language Models (LLMs). However, synchronous RL post-training often suffers from significant GPU underutilization, referred…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-26 Wei Gao , Yuheng Zhao , Dakai An , Tianyuan Wu , Lunxi Cao , Shaopan Xiong , Ju Huang , Weixun Wang , Siran Yang , Wenbo Su , Jiamang Wang , Lin Qu , Bo Zheng , Wei Wang

Recent studies reveal that a well-trained deep reinforcement learning (RL) policy can be particularly vulnerable to adversarial perturbations on input observations. Therefore, it is crucial to train RL agents that are robust against any…

Machine Learning · Computer Science 2022-10-13 Yongyuan Liang , Yanchao Sun , Ruijie Zheng , Furong Huang

Deep research systems, agentic AI that solve complex, multi-step tasks by coordinating reasoning, search across the open web and user files, and tool use, are moving toward hierarchical deployments with a Planner, Coordinator, and…

Artificial Intelligence · Computer Science 2025-11-06 Wenjun Li , Zhi Chen , Jingru Lin , Hannan Cao , Wei Han , Sheng Liang , Zhi Zhang , Kuicai Dong , Dexun Li , Chen Zhang , Yong Liu

Multi-agent systems (MAS) have shown great potential in executing complex tasks, but coordination and safety remain significant challenges. Multi-Agent Reinforcement Learning (MARL) offers a promising framework for agent collaboration, but…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Ziqi Jia , Junjie Li , Xiaoyang Qu , Jianzong Wang

Reinforcement learning (RL) emerges as a promising data-driven approach for adaptive traffic signal control (ATSC) in complex urban traffic networks, with deep neural networks substantially augmenting its learning capabilities. However,…

Artificial Intelligence · Computer Science 2025-02-25 Yuli Zhang , Shangbo Wang , Dongyao Jia , Pengfei Fan , Ruiyuan Jiang , Hankang Gu , Andy H. F. Chow

Reinforcement Learning (RL) has emerged as a powerful training paradigm for LLM-based agents. However, scaling agentic RL for deep research remains constrained by two coupled challenges: hand-crafted synthetic data fails to elicit genuine…

Artificial Intelligence · Computer Science 2026-04-23 Wanli Li , Bince Qu , Bo Pan , Jianyu Zhang , Zheng Liu , Pan Zhang , Wei Chen , Bo Zhang

In large language model (LLM) serving systems, executing each request consists of two phases: the compute-intensive prefill phase and the memory-intensive decoding phase. To prevent performance interference between the two phases, current…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-27 Yunkai Liang , Zhangyu Chen , Pengfei Zuo , Zhi Zhou , Xu Chen , Zhou Yu

Training large language models (LLMs) to reason via reinforcement learning (RL) significantly improves their problem-solving capabilities. In agentic settings, existing methods like ReAct prompt LLMs to explicitly plan before every action;…

Developing autonomous LLM agents capable of making a series of intelligent decisions to solve complex, real-world tasks is a fast-evolving frontier. Like human cognitive development, agents are expected to acquire knowledge and skills…

On-device control agents, especially on mobile devices, are responsible for operating mobile devices to fulfill users' requests, enabling seamless and intuitive interactions. Integrating Multimodal Large Language Models (MLLMs) into these…

Machine Learning · Computer Science 2025-02-24 Taiyi Wang , Zhihao Wu , Jianheng Liu , Jianye Hao , Jun Wang , Kun Shao

With the advent of ride-sharing services, there is a huge increase in the number of people who rely on them for various needs. Most of the earlier approaches tackling this issue required handcrafted functions for estimating travel times and…

Machine Learning · Computer Science 2020-06-22 Oscar de Lima , Hansal Shah , Ting-Sheng Chu , Brian Fogelson

With deep reinforcement learning (RL) methods achieving results that exceed human capabilities in games, robotics, and simulated environments, continued scaling of RL training is crucial to its deployment in solving complex real-world…

Machine Learning · Computer Science 2020-12-09 Ahmet Inci , Evgeny Bolotin , Yaosheng Fu , Gal Dalal , Shie Mannor , David Nellans , Diana Marculescu