中文
相关论文

相关论文: Discovering Multiple Solutions from a Single Task …

200 篇论文

We seek to understand what facilitates sample-efficient learning from historical datasets for sequential decision-making, a problem that is popularly known as offline reinforcement learning (RL). Further, we are interested in algorithms…

机器学习 · 计算机科学 2024-02-07 Thanh Nguyen-Tang , Raman Arora

We study the problem of Offline Safe Reinforcement Learning (OSRL), where the goal is to learn a reward-maximizing policy from fixed data under a cumulative cost constraint. We propose a novel OSRL approach that frames the problem as a…

机器学习 · 计算机科学 2025-10-28 Yassine Chemingui , Aryan Deshwal , Alan Fern , Thanh Nguyen-Tang , Janardhan Rao Doppa

Offline reinforcement learning (RL) refers to the problem of learning policies entirely from a large batch of previously collected data. This problem setting offers the promise of utilizing such datasets to acquire policies without any…

机器学习 · 计算机科学 2020-11-24 Tianhe Yu , Garrett Thomas , Lantao Yu , Stefano Ermon , James Zou , Sergey Levine , Chelsea Finn , Tengyu Ma

Reinforcement Learning (RL) is a method for learning decision-making tasks that could enable robots to learn and adapt to their situation on-line. For an RL algorithm to be practical for robotic control tasks, it must learn in very few…

人工智能 · 计算机科学 2015-03-19 Todd Hester , Michael Quinlan , Peter Stone

Offline reinforcement learning (RL), also known as batch RL, offers the prospect of policy optimization from large pre-recorded datasets without online environment interaction. It addresses challenges with regard to the cost of data…

Learning a reward function from human preferences is challenging as it typically requires having a high-fidelity simulator or using expensive and potentially unsafe actual physical rollouts in the environment. However, in many tasks the…

机器学习 · 计算机科学 2022-02-18 Daniel Shin , Daniel S. Brown , Anca D. Dragan

Reinforcement Learning (RL) has achieved state-of-the-art results in domains such as robotics and games. We build on this previous work by applying RL algorithms to a selection of canonical online stochastic optimization problems with a…

Safe reinforcement learning (RL) trains a constraint satisfaction policy by interacting with the environment. We aim to tackle a more challenging problem: learning a safe policy from an offline dataset. We study the offline safe RL problem…

机器学习 · 计算机科学 2023-06-22 Zuxin Liu , Zijian Guo , Yihang Yao , Zhepeng Cen , Wenhao Yu , Tingnan Zhang , Ding Zhao

We consider the problem of sequential recommendation, where the current recommendation is made based on past interactions. This recommendation task requires efficient processing of the sequential data and aims to provide recommendations…

信息检索 · 计算机科学 2023-07-28 Xumei Xi , Yuke Zhao , Quan Liu , Liwen Ouyang , Yang Wu

This paper studies tabular reinforcement learning (RL) in the hybrid setting, which assumes access to both an offline dataset and online interactions with the unknown environment. A central question boils down to how to efficiently utilize…

机器学习 · 计算机科学 2023-05-18 Gen Li , Wenhao Zhan , Jason D. Lee , Yuejie Chi , Yuxin Chen

In offline model-based reinforcement learning (offline MBRL), we learn a dynamic model from historically collected data, and subsequently utilize the learned model and fixed datasets for policy learning, without further interacting with the…

机器学习 · 计算机科学 2022-10-13 Shentao Yang , Shujian Zhang , Yihao Feng , Mingyuan Zhou

Offline reinforcement learning (RL) aims to find optimal policies in dynamic environments in order to maximize the expected total rewards by leveraging pre-collected data. Learning from heterogeneous data is one of the fundamental…

机器学习 · 统计学 2026-03-10 Rui Miao , Babak Shahbaba , Annie Qu

The recent success of supervised learning methods on ever larger offline datasets has spurred interest in the reinforcement learning (RL) field to investigate whether the same paradigms can be translated to RL algorithms. This research…

机器学习 · 计算机科学 2021-02-12 Mengjiao Yang , Ofir Nachum

Reinforcement learning (RL) has achieved impressive performance in a variety of online settings in which an agent's ability to query the environment for transitions and rewards is effectively unlimited. However, in many practical…

机器学习 · 计算机科学 2021-05-06 Anurag Ajay , Aviral Kumar , Pulkit Agrawal , Sergey Levine , Ofir Nachum

Distributionally robust offline reinforcement learning (RL) aims to find a policy that performs the best under the worst environment within an uncertainty set using an offline dataset collected from a nominal model. While recent advances in…

机器学习 · 计算机科学 2025-01-07 Ruiquan Huang , Yingbin Liang , Jing Yang

This paper investigates a hybrid learning framework for reinforcement learning (RL) in which the agent can leverage both an offline dataset and online interactions to learn the optimal policy. We present a unified algorithm and analysis and…

机器学习 · 计算机科学 2025-07-01 Ruiquan Huang , Donghao Li , Chengshuai Shi , Cong Shen , Jing Yang

Offline zero-shot reinforcement learning (RL) aims to learn agents that optimize unseen reward functions without additional environment interaction. The standard approach to this problem trains task-conditioned policies by sampling task…

人工智能 · 计算机科学 2026-04-29 Nazim Bendib , Nicolas Perrin-Gilbert , Olivier Sigaud

Currently, reinforcement learning (RL), especially deep RL, has received more and more attention in the research area. However, the security of RL has been an obvious problem due to the attack manners becoming mature. In order to defend…

机器学习 · 计算机科学 2023-10-04 Jiarui Yao , Simon Shaolei Du

Enhancing diverse human decision-making processes in an urban environment is a critical issue across various applications, including ride-sharing vehicle dispatching, public transportation management, and autonomous driving. Offline…

机器学习 · 计算机科学 2024-06-21 Xinbo Zhao , Yingxue Zhang , Xin Zhang , Yu Yang , Yiqun Xie , Yanhua Li , Jun Luo

To obtain a near-optimal policy with fewer interactions in Reinforcement Learning (RL), a promising approach involves the combination of offline RL, which enhances sample efficiency by leveraging offline datasets, and online RL, which…

机器学习 · 计算机科学 2024-11-18 Xiaoyu Wen , Xudong Yu , Rui Yang , Haoyuan Chen , Chenjia Bai , Zhen Wang