中文
相关论文

相关论文: Pessimistic Model Selection for Offline Deep Reinf…

200 篇论文

The offline reinforcement learning (RL) setting (also known as full batch RL), where a policy is learned from a static dataset, is compelling as progress enables RL methods to take advantage of large, previously-collected datasets, much…

机器学习 · 计算机科学 2021-02-09 Justin Fu , Aviral Kumar , Ofir Nachum , George Tucker , Sergey Levine

In this paper, we study offline preference-based reinforcement learning (PbRL), where learning is based on pre-collected preference feedback over pairs of trajectories. While offline PbRL has demonstrated remarkable empirical success,…

机器学习 · 计算机科学 2025-06-04 Hyungkyu Kang , Min-hwan Oh

We introduce a deep reinforcement learning (DRL) approach for solving management problems including inventory management, dynamic pricing, and recommendation. This DRL approach has the potential to lead to a large management model based on…

人工智能 · 计算机科学 2024-03-04 Jinyang Jiang , Xiaotian Liu , Tao Ren , Qinghao Wang , Yi Zheng , Yufu Du , Yijie Peng , Cheng Zhang

The growing prospect of deep reinforcement learning (DRL) being used in cyber-physical systems has raised concerns around safety and robustness of autonomous agents. Recent work on generating adversarial attacks have shown that it is…

机器学习 · 计算机科学 2018-07-18 Aaron J. Havens , Zhanhong Jiang , Soumik Sarkar

In many real-world settings, reinforcement learning systems suffer performance degradation when the environment encountered at deployment differs from that observed during training. Distributionally robust reinforcement learning (DR-RL)…

机器学习 · 计算机科学 2026-03-05 Debamita Ghosh , George K. Atia , Yue Wang

Reliability is one of the major design criteria in Cyber-Physical Systems (CPSs). This is because of the existence of some critical applications in CPSs and their failure is catastrophic. Therefore, employing strong error detection and…

机器学习 · 计算机科学 2023-06-07 Seyyedamirhossein Saeidi , Forouzan Fallah , Saeed Samieezafarghandi , Hamed Farbeh

Local policy search is performed by most Deep Reinforcement Learning (D-RL) methods, which increases the risk of getting trapped in a local minimum. Furthermore, the availability of a simulation model is not fully exploited in D-RL even in…

机器学习 · 计算机科学 2020-10-27 Jakob J. Hollenstein , Erwan Renaudo , Matteo Saveriano , Justus Piater

Offline Safe Reinforcement Learning (RL) seeks to address safety constraints by learning from static datasets and restricting exploration. However, these approaches heavily rely on the dataset and struggle to generalize to unseen scenarios…

机器人学 · 计算机科学 2025-03-04 Chenyang Cao , Yucheng Xin , Silang Wu , Longxiang He , Zichen Yan , Junbo Tan , Xueqian Wang

Deep reinforcement learning (DRL) requires the collection of interventional data, which is sometimes expensive and even unethical in the real world, such as in the autonomous driving and the medical field. Offline reinforcement learning…

机器学习 · 计算机科学 2023-06-12 Wenxuan Zhu , Chao Yu , Qiang Zhang

Impressive results in natural language processing (NLP) based on the Transformer neural network architecture have inspired researchers to explore viewing offline reinforcement learning (RL) as a generic sequence modeling problem. Recent…

机器学习 · 计算机科学 2022-07-22 Adam Villaflor , Zhe Huang , Swapnil Pande , John Dolan , Jeff Schneider

The recent development of reinforcement learning (RL) has boosted the adoption of online RL for wireless radio resource management (RRM). However, online RL algorithms require direct interactions with the environment, which may be…

信息论 · 计算机科学 2023-11-21 Kun Yang , Cong Shen , Jing Yang , Shu-ping Yeh , Jerry Sydir

Deep Reinforcement Learning (DRL) is considered a potential framework to improve many real-world autonomous systems; it has attracted the attention of multiple and diverse fields. Nevertheless, the successful deployment in the real world is…

机器学习 · 计算机科学 2021-07-08 Juan Jose Garau-Luis , Edward Crawley , Bruce Cameron

In this work, we study offline reinforcement learning (RL) with zero-shot generalization property (ZSG), where the agent has access to an offline dataset including experiences from different environments, and the goal of the agent is to…

机器学习 · 计算机科学 2025-03-12 Zhiyong Wang , Chen Yang , John C. S. Lui , Dongruo Zhou

The integration of distributed energy resources (DER) has escalated the challenge of voltage magnitude regulation in distribution networks. Traditional model-based approaches, which rely on complex sequential mathematical formulations,…

系统与控制 · 电气工程与系统科学 2024-11-05 Shengren Hou , Peter Palensky , Pedro P. Vergara

This article reviews the recent advances on the statistical foundation of reinforcement learning (RL) in the offline and low-adaptive settings. We will start by arguing why offline RL is the appropriate model for almost any real-life ML…

机器学习 · 计算机科学 2025-01-07 Ming Yin , Mengdi Wang , Yu-Xiang Wang

We study an approach to offline reinforcement learning (RL) based on optimally solving finitely-represented MDPs derived from a static dataset of experience. This approach can be applied on top of any learned representation and has the…

机器学习 · 计算机科学 2025-02-06 Aayam Shrestha , Stefan Lee , Prasad Tadepalli , Alan Fern

The offline reinforcement learning (RL) problem is often motivated by the need to learn data-driven decision policies in financial, legal and healthcare applications. However, the learned policy could retain sensitive information of…

机器学习 · 计算机科学 2023-01-04 Dan Qiao , Yu-Xiang Wang

Offline reinforcement learning (RL) addresses the challenge of expensive and high-risk data exploration inherent in RL by pre-training policies on vast amounts of offline data, enabling direct deployment or fine-tuning in real-world…

机器学习 · 计算机科学 2024-08-13 Thanh Nguyen , Tung M. Luu , Tri Ton , Chang D. Yoo

Offline reinforcement learning (RL) is a variant of RL where the policy is learned from a previously collected dataset of trajectories and rewards. In our work, we propose a practical approach to offline RL with large language models…

We study the fundamental problem of offline assortment optimization under the Multinomial Logit (MNL) model, where sellers must determine the optimal subset of the products to offer based solely on historical customer choice data. While…

机器学习 · 统计学 2025-08-26 Yuxuan Han , Han Zhong , Miao Lu , Jose Blanchet , Zhengyuan Zhou