中文
相关论文

相关论文: Off-Policy Actor-Critic with Sigmoid-Bounded Entro…

200 篇论文

Off-policy reinforcement learning holds the promise of sample-efficient learning of decision-making policies by leveraging past experience. However, in the offline RL setting -- where a fixed collection of interactions are provided and no…

机器学习 · 计算机科学 2021-01-15 Seyed Kamyar Seyed Ghasemipour , Dale Schuurmans , Shixiang Shane Gu

Recent advances in deep Reinforcement Learning (RL) have created unprecedented opportunities for intelligent automation, where a machine can autonomously learn an optimal policy for performing a given task. However, current deep RL…

机器学习 · 计算机科学 2021-05-27 Zohreh Raziei , Mohsen Moghaddam

Reinforcement Learning (RL) is a semi-supervised learning paradigm which an agent learns by interacting with an environment. Deep learning in combination with RL provides an efficient method to learn how to interact with the environment is…

声音 · 计算机科学 2022-03-30 Thejan Rajapakshe , Rajib Rana , Sara Khalifa , Björn W. Schuller , Jiajun Liu

Actor-critic methods, a type of model-free reinforcement learning (RL), have achieved state-of-the-art performances in many real-world domains in continuous control. Despite their success, the wide-scale deployment of these models is still…

机器学习 · 计算机科学 2020-12-14 Srinjoy Roy , Saptam Bakshi , Tamal Maharaj

Recent advance in deep offline reinforcement learning (RL) has made it possible to train strong robotic agents from offline datasets. However, depending on the quality of the trained agents and the application being considered, it is often…

机器人学 · 计算机科学 2021-11-02 Seunghyun Lee , Younggyo Seo , Kimin Lee , Pieter Abbeel , Jinwoo Shin

In reinforcement learning (RL) research, it is common to assume access to direct online interactions with the environment. However in many real-world applications, access to the environment is limited to a fixed offline dataset of logged…

机器学习 · 计算机科学 2019-11-27 Yifan Wu , George Tucker , Ofir Nachum

Many practical applications of reinforcement learning (RL) constrain the agent to learn from a fixed offline dataset of logged interactions, which has already been gathered, without offering further possibility for data collection. However,…

机器学习 · 计算机科学 2021-07-06 Zizhou Su

A key problem in off-policy Reinforcement Learning (RL) is the mismatch, or distribution shift, between the dataset and the distribution over states and actions visited by the learned policy. This problem is exacerbated in the fully offline…

机器学习 · 计算机科学 2023-11-28 Melrose Roderick , Gaurav Manek , Felix Berkenkamp , J. Zico Kolter

Offline reinforcement learning (offline RL), which aims to find an optimal policy from a previously collected static dataset, bears algorithmic difficulties due to function approximation errors from out-of-distribution (OOD) data points. To…

机器学习 · 计算机科学 2021-10-06 Gaon An , Seungyong Moon , Jang-Hyun Kim , Hyun Oh Song

We propose WSAC (Weighted Safe Actor-Critic), a novel algorithm for Safe Offline Reinforcement Learning (RL) under functional approximation, which can robustly optimize policies to improve upon an arbitrary reference policy with limited…

机器学习 · 计算机科学 2024-11-01 Honghao Wei , Xiyue Peng , Arnob Ghosh , Xin Liu

Offline reinforcement learning (RL) enables learning control policies by utilizing only prior experience, without any online interaction. This can allow robots to acquire generalizable skills from large and diverse datasets, without any…

机器学习 · 计算机科学 2021-09-24 Aviral Kumar , Anikait Singh , Stephen Tian , Chelsea Finn , Sergey Levine

Deploying controllers trained with Reinforcement Learning (RL) on real robots can be challenging: RL relies on agents' policies being modeled as Markov Decision Processes (MDPs), which assume an inherently discrete passage of time. The use…

机器人学 · 计算机科学 2024-04-03 Dong Wang , Giovanni Beltrame

Current end-to-end deep Reinforcement Learning (RL) approaches require jointly learning perception, decision-making and low-level control from very sparse reward signals and high-dimensional inputs, with little capability of incorporating…

机器学习 · 计算机科学 2019-10-10 Vibhavari Dasagi , Robert Lee , Serena Mou , Jake Bruce , Niko Sünderhauf , Jürgen Leitner

Reinforcement Learning (RL) can effectively learn complex policies. However, learning these policies often demands extensive trial-and-error interactions with the environment. In many real-world scenarios, this approach is not practical due…

机器学习 · 计算机科学 2024-02-19 Linh Le Pham Van , Hung The Tran , Sunil Gupta

Safe reinforcement learning (RL) trains a constraint satisfaction policy by interacting with the environment. We aim to tackle a more challenging problem: learning a safe policy from an offline dataset. We study the offline safe RL problem…

机器学习 · 计算机科学 2023-06-22 Zuxin Liu , Zijian Guo , Yihang Yao , Zhepeng Cen , Wenhao Yu , Tingnan Zhang , Ding Zhao

The actor-critic (AC) framework has achieved strong empirical success in off-policy reinforcement learning but suffers from the "moving target" problem, where the evaluated policy changes continually. Functional critics, or…

机器学习 · 计算机科学 2026-02-10 Qinxun Bai , Yuxuan Han , Wei Xu , Zhengyuan Zhou

Autonomous parking is a key technology in modern autonomous driving systems, requiring high precision, strong adaptability, and efficiency in complex environments. This paper proposes a Deep Reinforcement Learning (DRL) framework based on…

机器人学 · 计算机科学 2025-05-01 Zheyu Zhang , Yutong Luo , Yongzhou Chen , Haopeng Zhao , Zhichao Ma , Hao Liu

Generalization has been a long-standing challenge for reinforcement learning (RL). Visual RL, in particular, can be easily distracted by irrelevant factors in high-dimensional observation space. In this work, we consider robust policy…

机器学习 · 计算机科学 2021-06-18 Linxi Fan , Guanzhi Wang , De-An Huang , Zhiding Yu , Li Fei-Fei , Yuke Zhu , Anima Anandkumar

Biological agents learn and act intelligently in spite of a highly limited capacity to process and store information. Many real-world problems involve continuous control, which represents a difficult task for artificial intelligence agents.…

机器学习 · 计算机科学 2025-05-16 Tailia Malloy , Chris R. Sims , Tim Klinger , Miao Liu , Matthew Riemer , Gerald Tesauro

Robust real-world learning should benefit from both demonstrations and interactions with the environment. Current approaches to learning from demonstration and reward perform supervised learning on expert demonstration data and use…

人工智能 · 计算机科学 2019-05-31 Yang Gao , Huazhe Xu , Ji Lin , Fisher Yu , Sergey Levine , Trevor Darrell