English
Related papers

Related papers: MindSpeed RL: Distributed Dataflow for Scalable an…

200 papers

Reinforcement learning (RL) has become a powerful approach for improving the reasoning capabilities of large language models (LLMs), as evidenced by recent successes such as OpenAI's o1 and Deepseek-R1. However, applying RL at scale remains…

Machine Learning · Computer Science 2025-06-23 Siru Ouyang , Xinyu Zhu , Zilin Xiao , Minhao Jiang , Yu Meng , Jiawei Han

Thanks to their remarkable flexibility, diffusion models and flow models have emerged as promising candidates for policy representation. However, efficient reinforcement learning (RL) upon these policies remains a challenge due to the lack…

Machine Learning · Computer Science 2026-03-31 Chenxiao Gao , Edward Chen , Tianyi Chen , Bo Dai

Efficient load balancing is crucial in cloud computing environments to ensure optimal resource utilization, minimize response times, and prevent server overload. Traditional load balancing algorithms, such as round-robin or least…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-10 Kavish Chawla

Reinforcement learning (RL) has been widely applied to dynamic routing, modulation and spectrum assignment (RMSA) in optical networks, yet no prior work has trained a transformer model for this task. We attribute this to the high data and…

Networking and Internet Architecture · Computer Science 2026-05-19 Michael Doherty , Alejandra Beghelli , Laura Toni

Reinforcement learning (RL) in few-shot scenarios with limited sensor data is challenging due to insufficient training samples, particularly in applications like Dynamic Voltage and Frequency Scaling (DVFS) where sensor readings are…

Machine Learning · Computer Science 2026-01-13 Mohammad Pivezhandi , Abusayeed Saifullah

Training deep learning models takes an extremely long execution time and consumes large amounts of computing resources. At the same time, recent research proposed systems and compilers that are expected to decrease deep learning models…

Machine Learning · Computer Science 2022-05-11 Sean Parker , Sami Alabed , Eiko Yoneki

Large Language Models (LLMs) have achieved remarkable success through imitation learning on vast text corpora, but this paradigm creates a training-generation gap and limits robust reasoning. Reinforcement learning (RL) offers a more…

Computation and Language · Computer Science 2026-04-13 Zhepeng Cen , Haolin Chen , Shiyu Wang , Zuxin Liu , Zhiwei Liu , Jielin Qiu , Ding Zhao , Silvio Savarese , Caiming Xiong , Huan Wang , Weiran Yao

In cellular networks, resource allocation is performed in a centralized way, which brings huge computation complexity to the base station (BS) and high transmission overhead. This paper investigates the distributed resource allocation…

Signal Processing · Electrical Eng. & Systems 2024-11-12 Zelin Ji , Zhijin Qin

Deep reinforcement learning (DRL) has been successfully used to design forwarding strategies for multi-hop mobile wireless networks. While such strategies can be used directly for networks with varied connectivity and dynamic conditions,…

Networking and Internet Architecture · Computer Science 2025-09-30 Cheonjin Park , Victoria Manfredi , Xiaolan Zhang , Chengyi Liu , Alicia P Wolfe , Dongjin Song , Sarah Tasneem , Bing Wang

Enhancing the reasoning capabilities of large language models (LLMs) typically relies on massive computational resources and extensive datasets, limiting accessibility for resource-constrained settings. Our study investigates the potential…

Machine Learning · Computer Science 2026-01-21 Quy-Anh Dang , Chris Ngo

Modern RL-based post-training for large language models (LLMs) co-locate trajectory sampling and policy optimisation on the same GPU cluster, forcing the system to switch between inference and training workloads. This serial context…

Machine Learning · Computer Science 2025-08-13 Jie Xiao , Changyuan Fan , Qingnan Ren , Alfred Long , Yuchen Zhang , Rymon Yu , Eric Yang , Lynn Ai , Shaoduo Gan

Deep Reinforcement Learning (DRL) presents a promising avenue for optimizing Energy Storage Systems (ESSs) dispatch in distribution networks. This paper introduces RL-ADN, an innovative open-source library specifically designed for solving…

Machine Learning · Computer Science 2024-08-09 Shengren Hou , Shuyi Gao , Weijie Xia , Edgar Mauricio Salazar Duque , Peter Palensky , Pedro P. Vergara

In distributed optimization, the practical problem-solving performance is essentially sensitive to algorithm selection, parameter setting, problem type and data pattern. Thus, it is often laborious to acquire a highly efficient method for a…

Optimization and Control · Mathematics 2024-01-04 Daokuan Zhu , Tianqi Xu , Jie Lu

Reinforcement Learning (RL) has achieved significant success in application domains such as robotics, games and health care. However, training RL agents is very time consuming. Current implementations exhibit poor performance due to…

Machine Learning · Computer Science 2021-12-24 Chi Zhang , Sanmukh Rao Kuppannagari , Viktor K Prasanna

We approach the task of network congestion control in datacenters using Reinforcement Learning (RL). Successful congestion control algorithms can dramatically improve latency and overall network throughput. Until today, no such…

In this paper, we focus on general-purpose Distributed Stream Data Processing Systems (DSDPSs), which deal with processing of unbounded streams of continuous data at scale distributedly in real or near-real time. A fundamental problem in a…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-06 Teng Li , Zhiyuan Xu , Jian Tang , Yanzhi Wang

As computing power is becoming the core productivity of the digital economy era, the concept of Computing and Network Convergence (CNC), under which network and computing resources can be dynamically scheduled and allocated according to…

Networking and Internet Architecture · Computer Science 2022-09-23 Aidong Yang , Mohan Wu , Boquan Cheng , Xiaozhou Ye , Ye Ouyang

Agentic Reinforcement Learning (RL) enables Large Language Models (LLMs) to perform autonomous decision-making and long-term planning. Unlike standard LLM post-training, agentic RL workloads are highly heterogeneous, combining…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-30 Wei Gao , Yuheng Zhao , Tianyuan Wu , Shaopan Xiong , Weixun Wang , Dakai An , Lunxi Cao , Dilxat Muhtar , Zichen Liu , Haizhou Zhao , Ju Huang , Siran Yang , Yongbin Li , Wenbo Su , Jiamang Wang , Lin Qu , Bo Zheng , Wei Wang

While reinforcement learning (RL) algorithms are achieving state-of-the-art performance in various challenging tasks, they can easily encounter catastrophic forgetting or interference when faced with lifelong streaming information. In the…

Machine Learning · Computer Science 2022-05-24 Zhi Wang , Chunlin Chen , Daoyi Dong

Reinforcement learning (RL) post-training has become pivotal for enhancing the capabilities of modern large models. A recent trend is to develop RL systems with a fully disaggregated architecture, which decouples the three RL phases…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-21 Haoyang Li , Sheng Lin , Fangcheng Fu , Yuming Zhou , Xiaodong Ji , Yanfeng Zhao , Lefeng Wang , Jie Jiang , Bin Cui