English
Related papers

Related papers: SURREAL-System: Fully-Integrated Stack for Distrib…

200 papers

In recent years deep reinforcement learning (RL) systems have attained superhuman performance in a number of challenging task domains. However, a major limitation of such applications is their demand for massive amounts of training data. A…

We present a unifying framework for designing and analysing distributional reinforcement learning (DRL) algorithms in terms of recursively estimating statistics of the return distribution. Our key insight is that DRL algorithms can be…

Machine Learning · Statistics 2019-02-22 Mark Rowland , Robert Dadashi , Saurabh Kumar , Rémi Munos , Marc G. Bellemare , Will Dabney

We study the problem of Distributionally Robust Constrained RL (DRC-RL), where the goal is to maximize the expected reward subject to environmental distribution shifts and constraints. This setting captures situations where training and…

Machine Learning · Computer Science 2024-06-25 Zhengfei Zhang , Kishan Panaganti , Laixi Shi , Yanan Sui , Adam Wierman , Yisong Yue

Reinforcement learning (RL) has become a promising paradigm for optimizing Retrieval-Augmented Generation (RAG) in complex reasoning tasks. However, traditional outcome-based RL approaches often suffer from reward sparsity and inefficient…

Artificial Intelligence · Computer Science 2026-01-30 Zhao Wang , Ziliang Zhao , Zhicheng Dou

In real-world applications with large state and action spaces, reinforcement learning (RL) typically employs function approximations to represent core components like the policies, value functions, and dynamics models. Although powerful…

Machine Learning · Computer Science 2026-01-29 Chenxiao Gao , Haotian Sun , Na Li , Dale Schuurmans , Bo Dai

Distributed reinforcement learning policies face network delays, jitter, and packet loss when deployed across edge devices and cloud servers. Standard RL training assumes zero-latency interaction, causing severe performance degradation…

Machine Learning · Computer Science 2026-03-16 Carlos Purves , Pietro Lio'

We introduce Distribution Contractive Reinforcement Learning (DICE-RL), a framework that uses reinforcement learning (RL) as a "distribution contraction" operator to refine pretrained generative robot policies. DICE-RL turns a pretrained…

Robotics · Computer Science 2026-03-12 Zhanyi Sun , Shuran Song

Deep Reinforcement Learning (DRL) has become a powerful methodology to solve complex decision-making problems. However, DRL has several limitations when used in real-world problems (e.g., robotics applications). For instance, long training…

Robotics · Computer Science 2019-08-15 Rodrigo Pérez-Dattari , Carlos Celemin , Javier Ruiz-del-Solar , Jens Kober

The learning inefficiency of reinforcement learning (RL) from scratch hinders its practical application towards continuous robotic tracking control, especially for high-dimensional robots. This work proposes a data-informed residual…

Systems and Control · Electrical Eng. & Systems 2024-06-10 Cong Li , Fangzhou Liu , Yongchao Wang , Martin Buss

In recent years, \emph{Reinforcement Learning} (RL) has made remarkable progress, achieving superhuman performance in a wide range of simulated environments. As research moves toward deploying RL in real-world applications, the field faces…

In real-world tasks, reinforcement learning (RL) agents frequently encounter situations that are not present during training time. To ensure reliable performance, the RL agents need to exhibit robustness against worst-case situations. The…

Machine Learning · Computer Science 2021-03-19 Sebastian Curi , Ilija Bogunovic , Andreas Krause

We focus on the problem of reliably training Reinforcement Learning (RL) models (agents) for stable low-level control in embedded systems and test our methods on a high-performance, custom-built quadrotor platform. A common but often…

Robotics · Computer Science 2021-10-14 Siddharth Mysore , Bassel Mabsout , Kate Saenko , Renato Mancuso

Efficient task scheduling in large-scale distributed systems presents significant challenges due to dynamic workloads, heterogeneous resources, and competing quality-of-service requirements. Traditional centralized approaches face…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-27 Daniel Benniah John

Remote state estimation of large-scale distributed dynamic processes plays an important role in Industry 4.0 applications. In this paper, we focus on the transmission scheduling problem of a remote estimation system. First, we derive some…

Information Theory · Computer Science 2024-10-28 Jiazheng Chen , Wanchun Liu , Daniel E. Quevedo , Saeed R. Khosravirad , Yonghui Li , Branka Vucetic

This paper presents a novel federated reinforcement learning (Fed-RL) methodology to enhance the cyber resiliency of networked microgrids. We formulate a resilient reinforcement learning (RL) training setup which (a) generates episodic…

Exploiting unmanned aerial vehicles (UAVs) to execute tasks is gaining growing popularity recently. To solve the underlying task scheduling problem, the deep reinforcement learning (DRL) based methods demonstrate notable advantage over the…

Machine Learning · Computer Science 2023-06-07 Xiao Mao , Zhiguang Cao , Mingfeng Fan , Guohua Wu , Witold Pedrycz

Offline reinforcement learning algorithms hold the promise of enabling data-driven RL methods that do not require costly or dangerous real-world exploration and benefit from large pre-collected datasets. This in turn can facilitate…

We describe a system for deep reinforcement learning of robotic manipulation skills applied to a large-scale real-world task: sorting recyclables and trash in office buildings. Real-world deployment of deep RL policies requires not only…

This work proposes a deep learning (DL)-based framework, namely Sim2Real, for spectral signal reconstruction in reconstructive spectroscopy, focusing on efficient data sampling and fast inference time. The work focuses on the challenge of…

Machine Learning · Computer Science 2024-08-20 Jiyi Chen , Pengyu Li , Yutong Wang , Pei-Cheng Ku , Qing Qu

Real-world reinforcement learning (RL) offers a promising approach to training precise and dexterous robotic manipulation policies in an online manner, enabling robots to learn from their own experience while gradually reducing human labor.…