中文
相关论文

相关论文: Tackling Data Corruption in Offline Reinforcement …

200 篇论文

Imitation learning has proven effective for training robots to perform complex tasks from expert human demonstrations. However, it remains limited by its reliance on high-quality, task-specific data, restricting adaptability to the diverse…

Fault diagnosis (FD) is essential for maintaining operational safety and minimizing economic losses by detecting system abnormalities. Recently, deep learning (DL)-driven FD methods have gained prominence, offering significant improvements…

机器学习 · 计算机科学 2024-08-13 Dandan Zhao , Karthick Sharma , Hongpeng Yin , Yuxin Qi , Shuhao Zhang

Recent work have demonstrated that robustness (to "corruption") can be at odds with generalization. Adversarial training, for instance, aims to reduce the problematic susceptibility of modern neural networks to small data perturbations.…

机器学习 · 统计学 2023-05-19 Amine Bennouna , Ryan Lucas , Bart Van Parys

Offline reinforcement learning (RL) aims to find a near-optimal policy using pre-collected datasets. In real-world scenarios, data collection could be costly and risky; therefore, offline RL becomes particularly challenging when the…

机器学习 · 计算机科学 2024-12-18 Ruizhe Shi , Yuyao Liu , Yanjie Ze , Simon S. Du , Huazhe Xu

Offline reinforcement learning (RL) enables agents to learn policies from fixed datasets, avoiding costly or unsafe environment interactions. However, its effectiveness is often limited by dataset sparsity and the lack of transition overlap…

人工智能 · 计算机科学 2025-07-22 Lu Guo , Yixiang Shan , Zhengbang Zhu , Qifan Liang , Lichang Song , Ting Long , Weinan Zhang , Yi Chang

Traditional approaches in offline reinforcement learning aim to learn the optimal policy that maximizes the cumulative reward, also known as return. It is increasingly important to adjust the performance of AI agents to meet human…

机器学习 · 计算机科学 2025-06-23 Tsunehiko Tanaka , Kenshi Abe , Kaito Ariu , Tetsuro Morimura , Edgar Simo-Serra

Equipped with the trained environmental dynamics, model-based offline reinforcement learning (RL) algorithms can often successfully learn good policies from fixed-sized datasets, even some datasets with poor quality. Unfortunately, however,…

机器学习 · 计算机科学 2023-07-27 Junjie Zhang , Jiafei Lyu , Xiaoteng Ma , Jiangpeng Yan , Jun Yang , Le Wan , Xiu Li

Leveraging offline data is a promising way to improve the sample efficiency of online reinforcement learning (RL). This paper expands the pool of usable data for offline-to-online RL by leveraging abundant non-curated data that is…

Offline reinforcement learning (RL) represents a significant shift in RL research, allowing agents to learn from pre-collected datasets without further interaction with the environment. A key, yet underexplored, challenge in offline RL is…

This paper studies a challenging robust federated learning task with model heterogeneous and data corrupted clients, where the clients have different local model structures. Data corruption is unavoidable due to factors such as random…

机器学习 · 计算机科学 2025-03-13 Xiuwen Fang , Mang Ye , Bo Du

In this work we revisit the Mobility Robustness Optimisation (MRO) algorithm and study the possibility of learning the optimal Cell Individual Offset tuning using offline Reinforcement Learning. Such methods make use of collected offline…

网络与互联网体系结构 · 计算机科学 2025-07-01 Pegah Alizadeh , Anastasios Giovanidis , Pradeepa Ramachandra , Vasileios Koutsoukis , Osama Arouk

Offline reinforcement learning enables sample-efficient policy acquisition without risky online interaction, yet policies trained on static datasets remain brittle under action-space perturbations such as actuator faults. This study…

机器人学 · 计算机科学 2026-03-02 Shingo Ayabe , Hiroshi Kera , Kazuhiko Kawamoto

The deployment of unmanned aerial vehicles (UAVs) for reliable and energy-efficient data collection from spatially distributed devices holds great promise in supporting diverse Internet of Things (IoT) applications. Nevertheless, the…

系统与控制 · 电气工程与系统科学 2025-09-23 Zhixion Chen , Jiangzhou Wang , Hyundong Shin , Arumugam Nallanathan

We investigate robust model-free reinforcement learning algorithms designed for environments that may be dynamic or even adversarial. Traditional state-based policies often struggle to accommodate the challenges imposed by the presence of…

机器学习 · 计算机科学 2023-11-02 Udaya Ghai , Arushi Gupta , Wenhan Xia , Karan Singh , Elad Hazan

Reinforcement learning is able to solve complex sequential decision-making tasks but is currently limited by sample efficiency and required computation. To improve sample efficiency, recent work focuses on model-based RL which interleaves…

机器学习 · 计算机科学 2023-06-19 Yi Zhao , Wenshuai Zhao , Rinu Boney , Juho Kannala , Joni Pajarinen

Fine-tuning reinforcement learning (RL) models has been challenging because of a lack of large scale off-the-shelf datasets as well as high variance in transferability among different environments. Recent work has looked at tackling offline…

机器学习 · 计算机科学 2022-07-26 Machel Reid , Yutaro Yamada , Shixiang Shane Gu

A longstanding goal of artificial general intelligence is highly capable generalists that can learn from diverse experiences and generalize to unseen tasks. The language and vision communities have seen remarkable progress toward this trend…

机器学习 · 计算机科学 2024-10-25 Zhi Wang , Li Zhang , Wenhao Wu , Yuanheng Zhu , Dongbin Zhao , Chunlin Chen

Continuous generation of streaming data from diverse sources, such as online transactions and digital interactions, necessitates timely fraud detection. Traditional batch processing methods often struggle to capture the rapidly evolving…

机器学习 · 计算机科学 2025-04-15 Vivek Yelleti

Deep Reinforcement Learning (DRL) has emerged as an efficient approach to resource allocation due to its strong capability in handling complex decision-making tasks. However, only limited research has explored the training of DRL models…

机器学习 · 计算机科学 2025-09-23 Aohan Li , Miyu Tsuzuki

Reinforcement learning (RL) in the real world necessitates the development of procedures that enable agents to explore without causing harm to themselves or others. The most successful solutions to the problem of safe RL leverage offline…

机器学习 · 计算机科学 2025-01-09 Alexander Quessy , Thomas Richardson , Sebastian East