English
Related papers

Related papers: RollArt: Scaling Agentic RL Training via Disaggreg…

200 papers

Effective cross-functional coordination is essential for enhancing firm-wide profitability, particularly in the face of growing organizational complexity and scale. Recent advances in artificial intelligence, especially in reinforcement…

Artificial Intelligence · Computer Science 2025-10-07 Jinyang Jiang , Jinhui Han , Yijie Peng , Ying Zhang

Agentic reinforcement learning (RL) is reshaping LLM post-training, but end-to-end training time is dominated by compute-intensive, multi-turn rollouts whose resource demand varies significantly across training steps. Resource-fixed systems…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-21 Wei Gao , Yuheng Zhao , Dilxat Muhtar , Dakai An , Xuchun Shang , Tianyuan Wu , Lunxi Cao , Shaopan Xiong , Weixun Wang , Ju Huang , Teng Ma , Siran Yang , Jiamang Wang , Lin Qu , Bo Zheng , Wei Wang

Maximizing training throughput and cost-efficiency of RL for LLMs is essential to democratize this advanced technique. One promising but challenging approach is to deploy such a computational workflow over heterogeneous GPUs. Unlike…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-04 Ran Yan , Youhe Jiang , Tianyuan Wu , Jiaxuan Gao , Zhiyu Mei , Wei Fu , Haohui Mai , Wei Wang , Yi Wu , Binhang Yuan

Reinforcement Learning (RL) has become the most effective post-training approach for improving the capabilities of Large Language Models (LLMs). In practice, because of the high demands on latency and memory, it is particularly challenging…

Disaggregating the generation and training stages in RL is widely adopted to scale LLM post-training. There are two critical challenges here. First, the generation stage often becomes a bottleneck due to dynamic workload shifts and severe…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-13 Xin Tan , Yicheng Feng , Yu Zhou , Yimin Jiang , Yibo Zhu , Hong Xu

Reinforcement learning (RL) has become essential for unlocking advanced reasoning capabilities in large language models (LLMs). RL workflows involve interleaving rollout and training stages with fundamentally different resource…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-09 Yongji Wu , Xueshen Liu , Haizhong Zheng , Juncheng Gu , Beidi Chen , Z. Morley Mao , Arvind Krishnamurthy , Ion Stoica

Resource-disaggregated data centres (RDDC) propose a resource-centric, and high-utilisation architecture for data centres (DC), avoiding resource fragmentation and enabling arbitrarily sized resource pools to be allocated to tasks, rather…

Machine Learning · Computer Science 2021-11-12 Zacharaya Shabka , Georgios Zervas

We present Agent Lightning, a flexible and extensible framework that enables Reinforcement Learning (RL)-based training of Large Language Models (LLMs) for any AI agent. Unlike existing methods that tightly couple RL training with agent or…

Artificial Intelligence · Computer Science 2025-08-06 Xufang Luo , Yuge Zhang , Zhiyuan He , Zilong Wang , Siyun Zhao , Dongsheng Li , Luna K. Qiu , Yuqing Yang

Ultra-reliable low latency communications (URLLC) service is envisioned to enable use cases with strict reliability and latency requirements in 5G. One approach for enabling URLLC services is to leverage Reinforcement Learning (RL) to…

Systems and Control · Electrical Eng. & Systems 2023-07-26 Wei Shi , Milad Ganjalizadeh , Hossein Shokri Ghadikolaei , Marina Petrova

Resource allocation in integrated sensing and communication (ISAC) systems needs to be optimized to balance the requirements of the communication and sensing modules considering complicated cross-layer data traffic and queue status in…

Signal Processing · Electrical Eng. & Systems 2026-04-28 Xiyu Wang , Gilberto Berardinelli , Hei Victor Cheng , Petar Popovski , Ramoni Adeogun

In this paper, we introduce Quantum-Train-Based Distributed Multi-Agent Reinforcement Learning (Dist-QTRL), a novel approach to addressing the scalability challenges of traditional Reinforcement Learning (RL) by integrating quantum…

Quantum Physics · Physics 2024-12-13 Kuan-Cheng Chen , Samuel Yen-Chi Chen , Chen-Yu Liu , Kin K. Leung

Adaptive Mixed-Criticality (AMC) is a fixed-priority preemptive scheduling algorithm for mixed-criticality hard real-time systems. It dominates many other scheduling algorithms for mixed-criticality systems, but does so at the cost of…

Operating Systems · Computer Science 2024-11-04 Bruno Mendes , Pedro F. Souto , Pedro C. Diniz

Reinforcement learning (RL) is central to post-training, particularly for agentic models that require specialized reasoning behaviors. In this setting, model merging offers a practical mechanism for integrating multiple RL-trained agents…

Machine Learning · Computer Science 2026-01-21 Xiangchi Yuan , Dachuan Shi , Chunhui Zhang , Zheyuan Liu , Shenglong Yao , Soroush Vosoughi , Wenke Lee

Reinforcement learning (RL) is currently used in various real-life applications. RL-based solutions have the potential to generically address problems, including the ones that are difficult to solve with heuristics and meta-heuristics and,…

Machine Learning · Computer Science 2022-11-24 Rafael F. Reale , Joberto S. B. Martins

Large Language Models (LLMs) increasingly rely on agentic capabilities-iterative retrieval, tool use, and decision-making-to overcome the limits of static, parametric knowledge. Yet existing agentic frameworks treat external information as…

Computation and Language · Computer Science 2026-04-24 Yuanfu Sun , Kang Li , Dongzhe Fan , Jiajin Liu , Qiaoyu Tan

As emerging networks such as Open Radio Access Networks (O-RAN) and 5G continue to grow, the demand for various services with different requirements is increasing. Network slicing has emerged as a potential solution to address the different…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-19 Fatemeh Lotfi , Fatemeh Afghah , Jonathan Ashdown

Scalability is the key roadstone towards the application of cooperative intelligent algorithms in large-scale networks. Reinforcement learning (RL) is known as model-free and high efficient intelligent algorithm for communication problems…

Signal Processing · Electrical Eng. & Systems 2021-11-08 Fenghe Hu , Yansha Deng , A. Hamid Aghvami

Language model (LM) agents have gained significant attention for their ability to autonomously complete tasks through interactions with environments, tools, and APIs. LM agents are primarily built with prompt engineering or supervised…

Artificial Intelligence · Computer Science 2025-07-22 Renxi Wang , Rifo Ahmad Genadi , Bilal El Bouardi , Yongxin Wang , Fajri Koto , Zhengzhong Liu , Timothy Baldwin , Haonan Li

We introduce OpenTinker, an infrastructure for reinforcement learning (RL) of large language model (LLM) agents built around a separation of concerns across algorithm design, execution, and agent-environment interaction. Rather than relying…

Artificial Intelligence · Computer Science 2026-01-13 Siqi Zhu , Jiaxuan You

Efficient load balancing is crucial in cloud computing environments to ensure optimal resource utilization, minimize response times, and prevent server overload. Traditional load balancing algorithms, such as round-robin or least…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-10 Kavish Chawla