English
Related papers

Related papers: Spreeze: High-Throughput Parallel Reinforcement Le…

200 papers

The increasingly deeper neural networks hinder the democratization of privacy-enhancing distributed learning, such as federated learning (FL), to resource-constrained devices. To overcome this challenge, in this paper, we advocate the…

Machine Learning · Computer Science 2024-01-25 Zheng Lin , Guangyu Zhu , Yiqin Deng , Xianhao Chen , Yue Gao , Kaibin Huang , Yuguang Fang

Large language models (LLMs) have shown strong reasoning capabilities when fine-tuned with reinforcement learning (RL). However, such methods require extensive data and compute, making them impractical under many realistic training budgets.…

Machine Learning · Computer Science 2026-04-17 Dai Do , Manh Nguyen , Svetha Venkatesh , Hung Le

The rapid growth of data across fields of science and industry has increased the need to improve the performance of end-to-end data transfers while using the resources more efficiently. In this paper, we present a dynamic, multiparameter…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-27 Hasibul Jamil , Jacob Goldverg , Elvis Rodrigues , MD S Q Zulkar Nine , Tevfik Kosar

We introduce ComputerRL, a framework for autonomous desktop intelligence that enables agents to operate complex digital workspaces skillfully. ComputerRL features the API-GUI paradigm, which unifies programmatic API calls and direct GUI…

Artificial Intelligence · Computer Science 2025-10-22 Hanyu Lai , Xiao Liu , Yanxiao Zhao , Han Xu , Hanchen Zhang , Bohao Jing , Yanyu Ren , Shuntian Yao , Yuxiao Dong , Jie Tang

Reinforcement learning (RL) has become the dominant paradigm for improving the performance of language models on complex reasoning tasks. Despite the substantial empirical gains demonstrated by RL-based training methods like GRPO, a…

Artificial Intelligence · Computer Science 2025-10-27 Jiayu Wang , Yifei Ming , Zixuan Ke , Caiming Xiong , Shafiq Joty , Aws Albarghouthi , Frederic Sala

IEEE 802.11be -Extremely High Throughput-, commercially known as Wireless-Fidelity (Wi-Fi) 7 is the newest IEEE 802.11 amendment that comes to address the increasingly throughput hungry services such as Ultra High Definition (4K/8K) Video…

Networking and Internet Architecture · Computer Science 2023-03-17 Pedro Enrique Iturria Rivera , Marcel Chenier , Bernard Herscovici , Burak Kantarci , Melike Erol-Kantarci

A central component of training in Reinforcement Learning (RL) is Experience: the data used for training. The mechanisms used to generate and consume this data have an important effect on the performance of RL algorithms. In this paper, we…

Machine Learning · Computer Science 2021-02-10 Albin Cassirer , Gabriel Barth-Maron , Eugene Brevdo , Sabela Ramos , Toby Boyd , Thibault Sottiaux , Manuel Kroiss

We propose a novel framework for efficient parallelization of deep reinforcement learning algorithms, enabling these algorithms to learn from multiple actors on a single machine. The framework is algorithm agnostic and can be applied to…

Machine Learning · Computer Science 2017-05-17 Alfredo V. Clemente , Humberto N. Castejón , Arjun Chandra

Reinforcement learning (RL) has emerged as a critical paradigm for post-training Vision-Language-Action (VLA) models, enabling embodied agents to adapt and improve through environmental interaction. However, existing RL frameworks for VLAs…

Optimization problems characterized by both discrete and continuous variables are common across various disciplines, presenting unique challenges due to their complex solution landscapes and the difficulty of navigating mixed-variable…

Optimization and Control · Mathematics 2024-06-03 Haoyan Zhai , Qianli Hu , Jiangning Chen

Reinforcement learning (RL) has become a pivotal component of large language model (LLM) post-training, and agentic RL extends this paradigm to operate as agents through multi-turn interaction and tool use. Scaling such systems exposes two…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-08 Zheyue Tan , Mustapha Abdullahi , Tuo Shi , Huining Yuan , Zelai Xu , Chao Yu , Boxun Li , Bo Zhao

Deep Reinforcement Learning (DRL) has shown promise in various networking environments. However, these environments present several fundamental challenges for standard DRL techniques. They are difficult to explore and exhibit high levels of…

Machine Learning · Computer Science 2023-11-14 Sagar Patel , Junyang Zhang , Sangeetha Abdu Jyothi , Nina Narodytska

Reinforcement learning (RL) has become essential for unlocking advanced reasoning capabilities in large language models (LLMs). RL workflows involve interleaving rollout and training stages with fundamentally different resource…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-09 Yongji Wu , Xueshen Liu , Haizhong Zheng , Juncheng Gu , Beidi Chen , Z. Morley Mao , Arvind Krishnamurthy , Ion Stoica

Reinforcement Learning (RL) post-training has emerged as the dominant paradigm for eliciting mathematical reasoning in Large Language Models (LLMs), yet prevailing techniques such as GRPO and DAPO distribute rollout and gradient budgets…

Machine Learning · Computer Science 2026-05-20 Peng Cui , Boyao Yang , Jun Zhu

The framework of deep reinforcement learning (DRL) provides a powerful and widely applicable mathematical formalization for sequential decision-making. This paper present a novel DRL framework, termed \emph{$f$-Divergence Reinforcement…

Machine Learning · Computer Science 2021-12-15 Chen Gong , Qiang He , Yunpeng Bai , Zhou Yang , Xiaoyu Chen , Xinwen Hou , Xianjie Zhang , Yu Liu , Guoliang Fan

Large-scale LP problems from industry usually contain much redundancy that severely hurts the efficiency and reliability of solving LPs, making presolve (i.e., the problem simplification module) one of the most critical components in modern…

Machine Learning · Computer Science 2023-10-19 Yufei Kuang , Xijun Li , Jie Wang , Fangzhou Zhu , Meng Lu , Zhihai Wang , Jia Zeng , Houqiang Li , Yongdong Zhang , Feng Wu

Temporal information is essential to learning effective policies with Reinforcement Learning (RL). However, current state-of-the-art RL algorithms either assume that such information is given as part of the state space or, when learning…

Machine Learning · Computer Science 2021-01-07 Wenling Shang , Xiaofei Wang , Aravind Srinivas , Aravind Rajeswaran , Yang Gao , Pieter Abbeel , Michael Laskin

The integration of deep learning to reinforcement learning (RL) has enabled RL to perform efficiently in high-dimensional environments. Deep RL methods have been applied to solve many complex real-world problems in recent years. However,…

Machine Learning · Computer Science 2021-02-24 Ngoc Duy Nguyen , Thanh Thi Nguyen , Hai Nguyen , Doug Creighton , Saeid Nahavandi

This article explores the concepts of online protocol synthesis using Reinforcement Learning (RL). The study is performed in the context of sensor and IoT networks with ultra low complexity wireless transceivers. The paper introduces the…

Networking and Internet Architecture · Computer Science 2023-02-13 Hrishikesh Dutta , Amit Kumar Bhuyan , Subir Biswas

Hybrid parallelism underpins large-scale LLM training across tens of thousands of GPUs. At such scale, hardware failures on individual devices lead to performance skew across devices, diminishing overall training efficiency. Existing…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-12 Tenghui Ma , Jihu Guo , Wei Gao , Sitian Lu , Zhisheng Ye , Hanjing Wang , Dahua Lin