中文
相关论文

相关论文: Dealing with the Unknown: Pessimistic Offline Rein…

200 篇论文

Offline reinforcement learning (RL) refers to the problem of learning policies entirely from a large batch of previously collected data. This problem setting offers the promise of utilizing such datasets to acquire policies without any…

机器学习 · 计算机科学 2020-11-24 Tianhe Yu , Garrett Thomas , Lantao Yu , Stefano Ermon , James Zou , Sergey Levine , Chelsea Finn , Tengyu Ma

Scaling reinforcement learning (RL) to recommender systems (RS) is promising since maximizing the expected cumulative rewards for RL agents meets the objective of RS, i.e., improving customers' long-term satisfaction. A key approach to this…

机器学习 · 计算机科学 2022-09-27 Chengqian Gao , Ke Xu , Kuangqi Zhou , Lanqing Li , Xueqian Wang , Bo Yuan , Peilin Zhao

Reinforcement Learning (RL) has achieved state-of-the-art results in domains such as robotics and games. We build on this previous work by applying RL algorithms to a selection of canonical online stochastic optimization problems with a…

Offline reinforcement-learning (RL) algorithms learn to make decisions using a given, fixed training dataset without online data collection. This problem setting is captivating because it holds the promise of utilizing previously collected…

机器学习 · 计算机科学 2022-12-07 Dan Elbaz , Gal Novik , Oren Salzman

Offline policy learning is aimed at learning decision-making policies using existing datasets of trajectories without collecting additional data. The primary motivation for using reinforcement learning (RL) instead of supervised learning…

Reinforcement learning (RL) has achieved phenomenal success in various domains. However, its data-driven nature also introduces new vulnerabilities that can be exploited by malicious opponents. Recent work shows that a well-trained RL agent…

机器学习 · 计算机科学 2024-03-08 Xiaolin Sun , Zizhan Zheng

Offline Reinforcement Learning (ORL) offers a robust solution to training agents in applications where interactions with the environment must be strictly limited due to cost, safety, or lack of accurate simulation environments. Despite its…

机器学习 · 计算机科学 2024-07-16 Carlo Romeo , Andrew D. Bagdanov

In this work, we study offline reinforcement learning (RL) with zero-shot generalization property (ZSG), where the agent has access to an offline dataset including experiences from different environments, and the goal of the agent is to…

机器学习 · 计算机科学 2025-03-12 Zhiyong Wang , Chen Yang , John C. S. Lui , Dongruo Zhou

In offline reinforcement learning (RL), addressing the out-of-distribution (OOD) action issue has been a focus, but we argue that there exists an OOD state issue that also impairs performance yet has been underexplored. Such an issue…

机器学习 · 计算机科学 2024-11-04 Yixiu Mao , Qi Wang , Chen Chen , Yun Qu , Xiangyang Ji

``Distribution shift'' is the main obstacle to the success of offline reinforcement learning. A learning policy may take actions beyond the behavior policy's knowledge, referred to as Out-of-Distribution (OOD) actions. The Q-values for…

机器学习 · 计算机科学 2025-01-14 Jing Zhang , Linjiajie Fang , Kexin Shi , Wenjia Wang , Bing-Yi Jing

Offline Reinforcement Learning (RL) is structured to derive policies from static trajectory data without requiring real-time environment interactions. Recent studies have shown the feasibility of framing offline RL as a sequence modeling…

机器学习 · 计算机科学 2023-09-01 Abdelghani Ghanem , Philippe Ciblat , Mounir Ghogho

Offline reinforcement learning (RL) struggles in environments with rich and noisy inputs, where the agent only has access to a fixed dataset without environment interactions. Past works have proposed common workarounds based on the…

机器学习 · 计算机科学 2023-03-01 Hongyu Zang , Xin Li , Jie Yu , Chen Liu , Riashat Islam , Remi Tachet Des Combes , Romain Laroche

Off-dynamics Reinforcement Learning (ODRL) seeks to transfer a policy from a source environment to a target environment characterized by distinct yet similar dynamics. In this context, traditional RL agents depend excessively on the…

机器学习 · 计算机科学 2024-07-16 Paul Daoudi , Christophe Prieur , Bogdan Robu , Merwan Barlier , Ludovic Dos Santos

One of the main challenges in reinforcement learning (RL) is that the agent has to make decisions that would influence the future performance without having complete knowledge of the environment. Dynamically adjusting the level of epistemic…

机器学习 · 计算机科学 2026-03-02 Yupeng Wu , Wenyun Li , Wenjie Huang , Chin Pang Ho

Offline reinforcement learning (RL) aims to learn a policy using only pre-collected and fixed data. Although avoiding the time-consuming online interactions in RL, it poses challenges for out-of-distribution (OOD) state actions and often…

机器学习 · 计算机科学 2023-06-23 Jinxin Liu , Ziqi Zhang , Zhenyu Wei , Zifeng Zhuang , Yachen Kang , Sibo Gai , Donglin Wang

In this paper, we consider the problem of predicting unknown targets from data. We propose Online Residual Learning (ORL), a method that combines online adaptation with offline-trained predictions. At a lower level, we employ multiple…

系统与控制 · 电气工程与系统科学 2024-09-10 Anastasios Vlachos , Anastasios Tsiamis , Aren Karapetyan , Efe C. Balta , John Lygeros

Offline safe reinforcement learning(OSRL) derives constraint-satisfying policies from pre-collected datasets, offers a promising avenue for deploying RL in safety-critical real-world domains such as robotics. However, the majority of…

机器学习 · 计算机科学 2025-06-02 Zhikun Tao

Reinforcement learning (RL) is a powerful data-driven control method that has been largely explored in autonomous driving tasks. However, conventional RL approaches learn control policies through trial-and-error interactions with the…

机器人学 · 计算机科学 2021-11-03 Tianyu Shi , Dong Chen , Kaian Chen , Zhaojian Li

The recent development of reinforcement learning (RL) has boosted the adoption of online RL for wireless radio resource management (RRM). However, online RL algorithms require direct interactions with the environment, which may be…

信息论 · 计算机科学 2023-11-21 Kun Yang , Cong Shen , Jing Yang , Shu-ping Yeh , Jerry Sydir

Offline reinforcement learning (RL) aims to find performant policies from logged data without further environment interaction. Model-based algorithms, which learn a model of the environment from the dataset and perform conservative policy…

机器学习 · 计算机科学 2022-10-12 Marc Rigter , Bruno Lacerda , Nick Hawes