中文
相关论文

相关论文: Offline Reinforcement Learning with Domain-Unlabel…

200 篇论文

Safe reinforcement learning (RL) trains a constraint satisfaction policy by interacting with the environment. We aim to tackle a more challenging problem: learning a safe policy from an offline dataset. We study the offline safe RL problem…

机器学习 · 计算机科学 2023-06-22 Zuxin Liu , Zijian Guo , Yihang Yao , Zhepeng Cen , Wenhao Yu , Tingnan Zhang , Ding Zhao

We consider reinforcement learning (RL) methods in offline domains without additional online data collection, such as mobile health applications. Most of existing policy optimization algorithms in the computer science literature are…

机器学习 · 统计学 2022-07-28 Chengchun Shi , Shikai Luo , Yuan Le , Hongtu Zhu , Rui Song

Similar to other machine learning frameworks, Offline Reinforcement Learning (RL) is shown to be vulnerable to poisoning attacks, due to its reliance on externally sourced datasets, a vulnerability that is exacerbated by its sequential…

机器学习 · 计算机科学 2025-05-28 Shijie Liu , Andrew C. Cullen , Paul Montague , Sarah Erfani , Benjamin I. P. Rubinstein

The potential of offline reinforcement learning (RL) is that high-capacity models trained on large, heterogeneous datasets can lead to agents that generalize broadly, analogously to similar advances in vision and NLP. However, recent works…

机器学习 · 计算机科学 2023-04-19 Aviral Kumar , Rishabh Agarwal , Xinyang Geng , George Tucker , Sergey Levine

Traditional offline reinforcement learning (RL) methods predominantly operate in a batch-constrained setting. This confines the algorithms to a specific state-action distribution present in the dataset, reducing the effects of…

机器学习 · 统计学 2025-07-16 Charles A. Hepburn , Yue Jin , Giovanni Montana

Deep reinforcement learning algorithms have succeeded in several challenging domains. Classic Online RL job schedulers can learn efficient scheduling strategies but often takes thousands of timesteps to explore the environment and adapt…

机器学习 · 计算机科学 2022-12-05 Vanamala Venkataswamy , Jake Grigsby , Andrew Grimshaw , Yanjun Qi

Offline Reinforcement Learning (RL) has emerged as a powerful alternative to imitation learning for behavior modeling in various domains, particularly in complex navigation tasks. An existing challenge with Offline RL is the signal-to-noise…

机器学习 · 计算机科学 2024-11-13 Alexi Canesse , Mathieu Petitbois , Ludovic Denoyer , Sylvain Lamprier , Rémy Portelas

Existing theoretical studies on offline reinforcement learning (RL) mostly consider a dataset sampled directly from the target task. In practice, however, data often come from several heterogeneous but related sources. Motivated by this…

机器学习 · 统计学 2023-06-16 Chengshuai Shi , Wei Xiong , Cong Shen , Jing Yang

Offline reinforcement learning (RL) presents distinct challenges as it relies solely on observational data. A central concern in this context is ensuring the safety of the learned policy by quantifying uncertainties associated with various…

机器学习 · 计算机科学 2025-07-03 Xiaocong Chen , Siyu Wang , Tong Yu , Lina Yao

Sample efficiency is critical when applying learning-based methods to robotic manipulation due to the high cost of collecting expert demonstrations and the challenges of on-robot policy learning through online Reinforcement Learning (RL).…

机器学习 · 计算机科学 2024-06-21 Arsh Tangri , Ondrej Biza , Dian Wang , David Klee , Owen Howell , Robert Platt

In offline model-based reinforcement learning (offline MBRL), we learn a dynamic model from historically collected data, and subsequently utilize the learned model and fixed datasets for policy learning, without further interacting with the…

机器学习 · 计算机科学 2022-10-13 Shentao Yang , Shujian Zhang , Yihao Feng , Mingyuan Zhou

Offline zero-shot reinforcement learning (RL) aims to learn agents that optimize unseen reward functions without additional environment interaction. The standard approach to this problem trains task-conditioned policies by sampling task…

人工智能 · 计算机科学 2026-04-29 Nazim Bendib , Nicolas Perrin-Gilbert , Olivier Sigaud

Offline reinforcement learning, which aims at optimizing sequential decision-making strategies with historical data, has been extensively applied in real-life applications. State-Of-The-Art algorithms usually leverage powerful function…

机器学习 · 计算机科学 2022-11-28 Ming Yin , Mengdi Wang , Yu-Xiang Wang

Modern decision-making systems, from robots to web recommendation engines, are expected to adapt: to user preferences, changing circumstances or even new tasks. Yet, it is still uncommon to deploy a dynamically learning agent (rather than a…

Large-scale Web-based services present opportunities for improving UI policies based on observed user interactions. We address challenges of learning such policies through model-free offline Reinforcement Learning (RL) with off-policy…

In recent years, significant progress has been made in multi-objective reinforcement learning (RL) research, which aims to balance multiple objectives by incorporating preferences for each objective. In most existing studies, specific…

机器学习 · 计算机科学 2024-09-17 Qian Lin , Zongkai Liu , Danying Mo , Chao Yu

When dealing with binary classification of data with only one labeled class data scientists employ two main approaches, namely One-Class (OC) classification and Positive Unlabeled (PU) learning. The former only learns from labeled positive…

机器学习 · 计算机科学 2022-03-15 Farid Bagirov , Dmitry Ivanov , Aleksei Shpilman

The objective of offline RL is to learn optimal policies when a fixed exploratory demonstrations data-set is available and sampling additional observations is impossible (typically if this operation is either costly or rises ethical…

机器学习 · 计算机科学 2021-06-10 Firas Jarboui , Vianney Perchet

We study offline multitask representation learning in reinforcement learning (RL), where a learner is provided with an offline dataset from different tasks that share a common representation and is asked to learn the shared representation.…

机器学习 · 计算机科学 2024-11-01 Haque Ishfaq , Thanh Nguyen-Tang , Songtao Feng , Raman Arora , Mengdi Wang , Ming Yin , Doina Precup

We study a robust alternative to empirical risk minimization called distributionally robust learning (DRL), in which one learns to perform against an adversary who can choose the data distribution from a specified set of distributions. We…

机器学习 · 计算机科学 2019-12-19 Charlie Frogner , Sebastian Claici , Edward Chien , Justin Solomon