中文
相关论文

相关论文: Off-Policy Deep Reinforcement Learning with Analog…

200 篇论文

Robust reinforcement learning (Robust RL) seeks to handle epistemic uncertainty in environment dynamics, but existing approaches often rely on nested min--max optimization, which is computationally expensive and yields overly conservative…

机器学习 · 计算机科学 2025-10-15 Chenliang Li , Junyu Leng , Jiaxiang Li , Youbang Sun , Shixiang Chen , Shahin Shahrampour , Alfredo Garcia

Off-Policy Actor-Critic (Off-PAC) methods have proven successful in a variety of continuous control tasks. Normally, the critic's action-value function is updated using temporal-difference, and the critic in turn provides a loss for the…

机器学习 · 计算机科学 2020-11-03 Wei Zhou , Yiying Li , Yongxin Yang , Huaimin Wang , Timothy M. Hospedales

We reformulate the option framework as two parallel augmented MDPs. Under this novel formulation, all policy optimization algorithms can be used off the shelf to learn intra-option policies, option termination conditions, and a master…

机器学习 · 计算机科学 2019-09-12 Shangtong Zhang , Shimon Whiteson

Due to their complex nonlinear dynamics and batch-to-batch variability, batch processes pose a challenge for process control. Due to the absence of accurate models and resulting plant-model mismatch, these problems become harder to address…

机器学习 · 计算机科学 2022-05-03 Tanuja Joshi , Hariprasad Kodamana , Harikumar Kandath , Niket Kaisare

We consider off-dynamics reinforcement learning (RL) where one needs to transfer policies across different domains with dynamics mismatch. Despite the focus on developing dynamics-aware algorithms, this field is hindered due to the lack of…

机器学习 · 计算机科学 2024-10-29 Jiafei Lyu , Kang Xu , Jiacheng Xu , Mengbei Yan , Jingwen Yang , Zongzhang Zhang , Chenjia Bai , Zongqing Lu , Xiu Li

A promising paradigm for offline reinforcement learning (RL) is to constrain the learned policy to stay close to the dataset behaviors, known as policy constraint offline RL. However, existing works heavily rely on the purity of the data,…

机器学习 · 计算机科学 2022-10-20 Chengqian Gao , Ke Xu , Liu Liu , Deheng Ye , Peilin Zhao , Zhiqiang Xu

Discrete reinforcement learning (RL) algorithms have demonstrated exceptional performance in solving sequential decision tasks with discrete action spaces, such as Atari games. However, their effectiveness is hindered when applied to…

机器学习 · 计算机科学 2023-08-22 Yechen Zhang , Jian Sun , Gang Wang , Zhuo Li , Wei Chen

We study the problem of off-policy evaluation (OPE) in Reinforcement Learning (RL), where the aim is to estimate the performance of a new policy given historical data that may have been generated by a different policy, or policies. In…

机器学习 · 计算机科学 2019-12-16 Aurélien F. Bibaut , Ivana Malenica , Nikos Vlassis , Mark J. van der Laan

Offline reinforcement learning (RL) that learns policies from offline datasets without environment interaction has received considerable attention in recent years. Compared with the rich literature in the single-agent case, offline…

机器学习 · 计算机科学 2023-06-16 Xiangsen Wang , Xianyuan Zhan

High-precision control tasks present substantial challenges for reinforcement learning (RL) algorithms, frequently resulting in suboptimal performance attributed to network approximation inaccuracies and inadequate sample quality.These…

机器学习 · 计算机科学 2025-02-05 Donghe Chen , Yubin Peng , Tengjie Zheng , Han Wang , Chaoran Qu , Lin Cheng

Offline reinforcement learning (offline RL), which aims to find an optimal policy from a previously collected static dataset, bears algorithmic difficulties due to function approximation errors from out-of-distribution (OOD) data points. To…

机器学习 · 计算机科学 2021-10-06 Gaon An , Seungyong Moon , Jang-Hyun Kim , Hyun Oh Song

Offline policy learning is aimed at learning decision-making policies using existing datasets of trajectories without collecting additional data. The primary motivation for using reinforcement learning (RL) instead of supervised learning…

We propose a fully distributed actor-critic architecture, named Diff-DAC, with application to multitask reinforcement learning (MRL). During the learning process, agents communicate their value and policy parameters to their neighbours,…

机器学习 · 计算机科学 2021-10-26 Sergio Valcarcel Macua , Ian Davies , Aleksi Tukiainen , Enrique Munoz de Cote

Recent advances in behavior cloning (BC) have enabled impressive visuomotor control policies. However, these approaches are limited by the quality of human demonstrations, the manual effort required for data collection, and the diminishing…

机器人学 · 计算机科学 2025-09-29 Lars Ankile , Zhenyu Jiang , Rocky Duan , Guanya Shi , Pieter Abbeel , Anusha Nagabandi

Diffusion policy sampling enables reinforcement learning (RL) to represent multimodal action distributions beyond suboptimal unimodal Gaussian policies. However, existing diffusion-based RL methods primarily focus on offline settings for…

机器学习 · 计算机科学 2026-05-07 Xiaoyuan Cheng , Wenxuan Yuan , Boyang Li , Yuanchao Xu , Yiming Yang , Hao Liang , Bei Peng , Robert Loftin , Zhuo Sun , Yukun Hu

This paper considers the problem of solving constrained reinforcement learning (RL) problems with anytime guarantees, meaning that the algorithmic solution must yield a constraint-satisfying policy at every iteration of its evolution. Our…

系统与控制 · 电气工程与系统科学 2025-10-03 Pol Mestres , Arnau Marzabal , Jorge Cortés

A key aspect of intelligence is the ability to demonstrate a broad spectrum of behaviors for adapting to unexpected situations. Over the past decade, advancements in deep reinforcement learning have led to groundbreaking achievements to…

机器学习 · 计算机科学 2024-06-04 Luca Grillotti , Maxence Faldor , Borja G. León , Antoine Cully

Reinforcement Learning (RL) has achieved remarkable success in sequential decision tasks. However, recent studies have revealed the vulnerability of RL policies to different perturbations, raising concerns about their effectiveness and…

机器学习 · 计算机科学 2025-07-08 Buqing Nie , Yangqing Fu , Jingtian Ji , Yue Gao

Reinforcement learning (RL) with sparse and deceptive rewards is challenging because non-zero rewards are rarely obtained. Hence, the gradient calculated by the agent can be stochastic and without valid information. Recent studies that…

机器学习 · 计算机科学 2024-02-08 Guojian Wang , Faguo Wu , Xiao Zhang , Jianxiang Liu

Deep learning in combination with improved training techniques and high computational power has led to recent advances in the field of reinforcement learning (RL) and to successful robotic RL applications such as in-hand manipulation.…

机器人学 · 计算机科学 2021-03-18 Melvin Laux , Oleg Arenz , Jan Peters , Joni Pajarinen