中文
相关论文

相关论文: CUDC: A Curiosity-Driven Unsupervised Data Collect…

200 篇论文

Offline reinforcement learning (offline RL), which aims to find an optimal policy from a previously collected static dataset, bears algorithmic difficulties due to function approximation errors from out-of-distribution (OOD) data points. To…

机器学习 · 计算机科学 2021-10-06 Gaon An , Seungyong Moon , Jang-Hyun Kim , Hyun Oh Song

Developing an agent in reinforcement learning (RL) that is capable of performing complex control tasks directly from high-dimensional observation such as raw pixels is yet a challenge as efforts are made towards improving sample efficiency…

机器学习 · 计算机科学 2023-01-13 Thanh Nguyen , Tung M. Luu , Thang Vu , Chang D. Yoo

To obtain a near-optimal policy with fewer interactions in Reinforcement Learning (RL), a promising approach involves the combination of offline RL, which enhances sample efficiency by leveraging offline datasets, and online RL, which…

机器学习 · 计算机科学 2024-11-18 Xiaoyu Wen , Xudong Yu , Rui Yang , Haoyuan Chen , Chenjia Bai , Zhen Wang

Reinforcement learning (RL) is a class of artificial intelligence algorithms being used to design adaptive optimal controllers through online learning. This paper presents a model-free, real-time, data-efficient Q-learning-based algorithm…

系统与控制 · 电气工程与系统科学 2023-10-11 Ali Aalipour , Alireza Khani

As a data-driven paradigm, offline reinforcement learning (Offline RL) has been formulated as sequence modeling, where the Decision Transformer (DT) has demonstrated exceptional capabilities. Unlike previous reinforcement learning methods…

机器学习 · 计算机科学 2024-09-13 Teng Yan , Zhendong Ruan , Yaobang Cai , Yu Han , Wenxian Li , Yang Zhang

Offline reinforcement learning (RL), also known as batch RL, offers the prospect of policy optimization from large pre-recorded datasets without online environment interaction. It addresses challenges with regard to the cost of data…

Training autonomous agents with sparse rewards is a long-standing problem in online reinforcement learning (RL), due to low data efficiency. Prior work overcomes this challenge by extracting useful knowledge from offline data, often…

机器学习 · 计算机科学 2024-06-07 Qianlan Yang , Yu-Xiong Wang

Many reinforcement learning (RL) problems in practice are offline, learning purely from observational data. A key challenge is how to ensure the learned policy is safe, which requires quantifying the risk associated with different actions.…

机器学习 · 计算机科学 2021-10-28 Yecheng Jason Ma , Dinesh Jayaraman , Osbert Bastani

Offline reinforcement learning (RL) enables learning effective policies from fixed datasets without any environment interaction. Existing methods typically employ policy constraints to mitigate the distribution shift encountered during…

机器学习 · 计算机科学 2026-04-30 Tan Jing , Xiaorui Li , Chao Yao , Xiaojuan Ban , Yuetong Fang , Renjing Xu , Zhaolin Yuan

Unsupervised Reinforcement Learning (RL) aims to discover diverse behaviors that can accelerate the learning of downstream tasks. Previous methods typically focus on entropy-based exploration or empowerment-driven skill learning. However,…

机器学习 · 计算机科学 2025-06-18 Ting Xiao , Jiakun Zheng , Rushuai Yang , Kang Xu , Qiaosheng Zhang , Peng Liu , Chenjia Bai

Offline policy learning is aimed at learning decision-making policies using existing datasets of trajectories without collecting additional data. The primary motivation for using reinforcement learning (RL) instead of supervised learning…

The recent advances in information technology and artificial intelligence have fueled a rapid expansion of the data center (DC) industry worldwide, accompanied by an immense appetite for electricity to power the DCs. In a typical DC, around…

Offline-to-online reinforcement learning (RL), a framework that trains a policy with offline RL and then further fine-tunes it with online RL, has been considered a promising recipe for data-driven decision-making. While sensible, this…

机器学习 · 计算机科学 2024-08-28 Junsu Kim , Seohong Park , Sergey Levine

A promising paradigm for offline reinforcement learning (RL) is to constrain the learned policy to stay close to the dataset behaviors, known as policy constraint offline RL. However, existing works heavily rely on the purity of the data,…

机器学习 · 计算机科学 2022-10-20 Chengqian Gao , Ke Xu , Liu Liu , Deheng Ye , Peilin Zhao , Zhiqiang Xu

Current reinforcement learning (RL) often suffers when solving a challenging exploration problem where the desired outcomes or high rewards are rarely observed. Even though curriculum RL, a framework that solves complex tasks by proposing a…

机器学习 · 计算机科学 2023-02-21 Daesol Cho , Seungjae Lee , H. Jin Kim

Offline reinforcement learning (RL) provides a promising direction to exploit massive amount of offline data for complex decision-making tasks. Due to the distribution shift issue, current offline RL algorithms are generally designed to be…

机器学习 · 计算机科学 2022-10-25 Rui Yang , Chenjia Bai , Xiaoteng Ma , Zhaoran Wang , Chongjie Zhang , Lei Han

Nowadays, Deep Learning (DL) methods often overcome the limitations of traditional signal processing approaches. Nevertheless, DL methods are barely applied in real-life applications. This is mainly due to limited robustness and…

机器学习 · 计算机科学 2022-10-27 Julius Ott , Lorenzo Servadei , Gianfranco Mauro , Thomas Stadelmayer , Avik Santra , Robert Wille

In offline reinforcement learning (RL), an RL agent learns to solve a task using only a fixed dataset of previously collected data. While offline RL has been successful in learning real-world robot control policies, it typically requires…

机器学习 · 计算机科学 2024-08-09 Nicholas E. Corrado , Yuxiao Qu , John U. Balis , Adam Labiosa , Josiah P. Hanna

Deep reinforcement learning algorithms require large amounts of experience to learn an individual task. While in principle meta-reinforcement learning (meta-RL) algorithms enable agents to learn new skills from small amounts of experience,…

机器学习 · 计算机科学 2019-03-21 Kate Rakelly , Aurick Zhou , Deirdre Quillen , Chelsea Finn , Sergey Levine

Cross-domain offline reinforcement learning (RL) aims to train a well-performing agent in the target environment, leveraging both a limited target domain dataset and a source domain dataset with (possibly) sufficient data coverage. Due to…

机器学习 · 计算机科学 2026-03-23 Zhongjian Qiao , Rui Yang , Jiafei Lyu , Chenjia Bai , Xiu Li , Siyang Gao , Shuang Qiu