中文
相关论文

相关论文: Tackling Data Corruption in Offline Reinforcement …

200 篇论文

Recent advances in batch (offline) reinforcement learning have shown promising results in learning from available offline data and proved offline reinforcement learning to be an essential toolkit in learning control policies in a model-free…

机器学习 · 计算机科学 2022-12-19 Ashish Kumar , Ilya Kuzovkin

Reinforcement learning (RL) has shown promise for decision-making tasks in real-world applications. One practical framework involves training parameterized policy models from an offline dataset and subsequently deploying them in an online…

机器学习 · 计算机科学 2023-03-14 Ziniu Li , Ke Xu , Liu Liu , Lanqing Li , Deheng Ye , Peilin Zhao

Continual learning has primarily focused on the issue of catastrophic forgetting and the associated stability-plasticity tradeoffs. However, little attention has been paid to the efficacy of continually learned representations, as…

计算机视觉与模式识别 · 计算机科学 2024-11-21 Ameya Prabhu , Shiven Sinha , Ponnurangam Kumaraguru , Philip H. S. Torr , Ozan Sener , Puneet K. Dokania

We study the problem of off-policy evaluation (OPE) in reinforcement learning (RL), where the goal is to estimate the performance of a policy from the data generated by another policy(ies). In particular, we focus on the doubly robust (DR)…

人工智能 · 计算机科学 2018-05-25 Mehrdad Farajtabar , Yinlam Chow , Mohammad Ghavamzadeh

In many real-world settings, reinforcement learning systems suffer performance degradation when the environment encountered at deployment differs from that observed during training. Distributionally robust reinforcement learning (DR-RL)…

机器学习 · 计算机科学 2026-03-05 Debamita Ghosh , George K. Atia , Yue Wang

The success of deep reinforcement learning (DRL) relies on the availability and quality of training data, often requiring extensive interactions with specific environments. In many real-world scenarios, where data collection is costly and…

机器学习 · 计算机科学 2025-04-15 Amir Abolfazli , Zekun Song , Avishek Anand , Wolfgang Nejdl

We consider robustness against data corruption in offline multi-agent reinforcement learning from human feedback (MARLHF) under a strong-contamination model: given a dataset $D$ of trajectory-preference tuples (each preference being an…

机器学习 · 计算机科学 2026-04-10 Andi Nika , Debmalya Mandal , Parameswaran Kamalaruban , Adish Singla , Goran Radanović

The goal in offline data-driven decision-making is synthesize decisions that optimize a black-box utility function, using a previously-collected static dataset, with no active interaction. These problems appear in many forms: offline…

机器学习 · 计算机科学 2022-11-28 Han Qi , Yi Su , Aviral Kumar , Sergey Levine

Offline reinforcement learning (RL) is an effective tool for real-world recommender systems with its capacity to model the dynamic interest of users and its interactive nature. Most existing offline RL recommender systems focus on…

信息检索 · 计算机科学 2025-05-13 Yi Zhang , Ruihong Qiu , Jiajun Liu , Sen Wang

Ensuring safety of nonlinear systems under model uncertainty and external disturbances is crucial, especially for real-world control tasks. Predictive methods such as robust model predictive control (RMPC) require solving nonconvex…

系统与控制 · 电气工程与系统科学 2023-11-14 Zeyang Li , Chuxiong Hu , Weiye Zhao , Changliu Liu

Finding effective representations for time series data is a useful but challenging task. Several works utilize self-supervised or unsupervised learning methods to address this. However, there still remains the open question of how to…

机器学习 · 计算机科学 2024-03-19 Yuansan Liu , Sudanthi Wijewickrema , Christofer Bester , Stephen O'Leary , James Bailey

Sequential decision-making agents struggle with long horizon tasks, since solving them requires multi-step reasoning. Most reinforcement learning (RL) algorithms address this challenge by improved credit assignment, introducing memory…

机器学习 · 计算机科学 2023-04-04 Bogdan Mazoure , Jake Bruce , Doina Precup , Rob Fergus , Ankit Anand

Depth estimation from monocular images is pivotal for real-world visual perception systems. While current learning-based depth estimation models train and test on meticulously curated data, they often overlook out-of-distribution (OoD)…

计算机视觉与模式识别 · 计算机科学 2023-10-24 Lingdong Kong , Shaoyuan Xie , Hanjiang Hu , Lai Xing Ng , Benoit R. Cottereau , Wei Tsang Ooi

Reinforcement learning (RL) has proved to have a promising role in future intelligent wireless networks. Online RL has been adopted for radio resource management (RRM), taking over traditional schemes. However, due to its reliance on online…

机器学习 · 计算机科学 2025-01-24 Eslam Eldeeb , Hirley Alves

Offline reinforcement learning often requires a quality dataset that we can train a policy on. However, in many situations, it is not possible to get such a dataset, nor is it easy to train a policy to perform well in the actual environment…

机器学习 · 计算机科学 2025-11-04 Jonathan Light , Yuanzhe Liu , Ziniu Hu

This article proposes a model-based deep reinforcement learning (DRL) method to design emergency control strategies for short-term voltage stability problems in power systems. Recent advances show promising results in model-free DRL-based…

系统与控制 · 电气工程与系统科学 2022-12-07 Ramij R. Hossain , Tianzhixi Yin , Yan Du , Renke Huang , Jie Tan , Wenhao Yu , Yuan Liu , Qiuhua Huang

Multimodal models trained on complete modality data often exhibit a substantial decrease in performance when faced with imperfect data containing corruptions or missing modalities. To address this robustness challenge, prior methods have…

多媒体 · 计算机科学 2023-10-24 Mengxi Chen , Jiangchao Yao , Linyu Xing , Yu Wang , Ya Zhang , Yanfeng Wang

We study the problem of off-policy value evaluation in reinforcement learning (RL), where one aims to estimate the value of a new policy based on data collected by a different policy. This problem is often a critical step when applying RL…

机器学习 · 计算机科学 2016-05-27 Nan Jiang , Lihong Li

This dissertation investigates how reinforcement learning (RL) methods can be designed to be safe, sample-efficient, and robust. Framed through the unifying perspective of contextual-bandit RL, the work addresses two major application…

机器学习 · 计算机科学 2025-10-20 Shashank Gupta

Offline reinforcement learning is used to train policies in scenarios where real-time access to the environment is expensive or impossible. As a natural consequence of these harsh conditions, an agent may lack the resources to fully observe…