中文
相关论文

相关论文: Accelerating Offline Reinforcement Learning Applic…

200 篇论文

Reinforcement learning (RL) has achieved impressive performance in a variety of online settings in which an agent's ability to query the environment for transitions and rewards is effectively unlimited. However, in many practical…

机器学习 · 计算机科学 2021-05-06 Anurag Ajay , Aviral Kumar , Pulkit Agrawal , Sergey Levine , Ofir Nachum

Reinforcement learning serves as a potent tool for modeling dynamic user interests within recommender systems, garnering increasing research attention of late. However, a significant drawback persists: its poor data efficiency, stemming…

信息检索 · 计算机科学 2023-08-23 Xiaocong Chen , Siyu Wang , Julian McAuley , Dietmar Jannach , Lina Yao

Reinforcement learning (RL) has shown great promise with algorithms learning in environments with large state and action spaces purely from scalar reward signals. A crucial challenge for current deep RL algorithms is that they require a…

机器学习 · 计算机科学 2023-11-23 Shivakanth Sujit , Pedro H. M. Braga , Jorg Bornschein , Samira Ebrahimi Kahou

Learning a reward function from human preferences is challenging as it typically requires having a high-fidelity simulator or using expensive and potentially unsafe actual physical rollouts in the environment. However, in many tasks the…

机器学习 · 计算机科学 2023-01-05 Daniel Shin , Anca D. Dragan , Daniel S. Brown

We hypothesize that empirically studying the sample complexity of offline reinforcement learning (RL) is crucial for the practical applications of RL in the real world. Several recent works have demonstrated the ability to learn policies…

机器学习 · 计算机科学 2022-01-03 Samin Yeasar Arnob , Riashat Islam , Doina Precup

Offline reinforcement learning (RL) enables learning control policies by utilizing only prior experience, without any online interaction. This can allow robots to acquire generalizable skills from large and diverse datasets, without any…

机器学习 · 计算机科学 2021-09-24 Aviral Kumar , Anikait Singh , Stephen Tian , Chelsea Finn , Sergey Levine

Offline reinforcement learning (RL) provides a promising approach to avoid costly online interaction with the real environment. However, the performance of offline RL highly depends on the quality of the datasets, which may cause…

机器人学 · 计算机科学 2024-05-08 Yiwen Hou , Haoyuan Sun , Jinming Ma , Feng Wu

The online advertising market, with its thousands of auctions run per second, presents a daunting challenge for advertisers who wish to optimize their spend under a budget constraint. Thus, advertising platforms typically provide automated…

机器学习 · 计算机科学 2023-10-17 Dmytro Korenkevych , Frank Cheng , Artsiom Balakir , Alex Nikulkov , Lingnan Gao , Zhihao Cen , Zuobing Xu , Zheqing Zhu

In this tutorial article, we aim to provide the reader with the conceptual tools needed to get started on research on offline reinforcement learning algorithms: reinforcement learning algorithms that utilize previously collected data,…

机器学习 · 计算机科学 2020-11-03 Sergey Levine , Aviral Kumar , George Tucker , Justin Fu

In this paper, we argue that the paradigm commonly adopted for offline evaluation of sequential recommender systems is unsuitable for evaluating reinforcement learning-based recommenders. We find that most of the existing offline evaluation…

信息检索 · 计算机科学 2023-01-04 Romain Deffayet , Thibaut Thonet , Jean-Michel Renders , Maarten de Rijke

The recent development of reinforcement learning (RL) has boosted the adoption of online RL for wireless radio resource management (RRM). However, online RL algorithms require direct interactions with the environment, which may be…

信息论 · 计算机科学 2023-11-21 Kun Yang , Cong Shen , Jing Yang , Shu-ping Yeh , Jerry Sydir

Offline reinforcement learning (RL) has emerged as a prevalent and effective methodology for real-world recommender systems, enabling learning policies from historical data and capturing user preferences. In offline RL, reward shaping…

信息检索 · 计算机科学 2025-07-01 Wenzheng Shu , Yanxiang Zeng , Yongxiang Tang , Teng Sha , Ning Luo , Yanhua Cheng , Xialong Liu , Fan Zhou , Peng Jiang

In offline reinforcement learning (RL), we seek to utilize offline data to evaluate (or learn) policies in scenarios where the data are collected from a distribution that substantially differs from that of the target policy to be evaluated.…

机器学习 · 计算机科学 2021-03-09 Ruosong Wang , Yifan Wu , Ruslan Salakhutdinov , Sham M. Kakade

Offline reinforcement learning (RL) refers to the problem of learning policies from a static dataset of environment interactions. Offline RL enables extensive use and re-use of historical datasets, while also alleviating safety concerns…

机器学习 · 计算机科学 2020-12-22 Rafael Rafailov , Tianhe Yu , Aravind Rajeswaran , Chelsea Finn

Offline reinforcement learning (RL) represents a significant shift in RL research, allowing agents to learn from pre-collected datasets without further interaction with the environment. A key, yet underexplored, challenge in offline RL is…

Offline reinforcement learning (RL) aims to learn policies without online explorations. To enlarge the training data, model-based offline RL learns a dynamics model which is utilized as a virtual environment to generate simulation data and…

机器学习 · 计算机科学 2025-07-11 Ziqi Zhao , Zhaochun Ren , Liu Yang , Yunsen Liang , Fajie Yuan , Pengjie Ren , Zhumin Chen , jun Ma , Xin Xin

This paper introduces SCOPE-RL, a comprehensive open-source Python software designed for offline reinforcement learning (offline RL), off-policy evaluation (OPE), and selection (OPS). Unlike most existing libraries that focus solely on…

机器学习 · 计算机科学 2024-03-12 Haruka Kiyohara , Ren Kishimoto , Kosuke Kawakami , Ken Kobayashi , Kazuhide Nakata , Yuta Saito

Offline reinforcement learning algorithms often require careful hyperparameter tuning. Before deployment, we need to select amongst a set of candidate policies. However, there is limited understanding about the fundamental limits of this…

机器学习 · 计算机科学 2026-02-17 Vincent Liu , Prabhat Nagarajan , Andrew Patterson , Martha White

Both in academic and industry-based research, online evaluation methods are seen as the golden standard for interactive applications like recommendation systems. Naturally, the reason for this is that we can directly measure utility metrics…

Reinforcement learning (RL) is a powerful data-driven control method that has been largely explored in autonomous driving tasks. However, conventional RL approaches learn control policies through trial-and-error interactions with the…

机器人学 · 计算机科学 2021-11-03 Tianyu Shi , Dong Chen , Kaian Chen , Zhaojian Li