English
Related papers

Related papers: Katakomba: Tools and Benchmarks for Data-Driven Ne…

200 papers

Offline reinforcement learning (RL) defines the task of learning from a fixed batch of data. Due to errors in value estimation from out-of-distribution actions, most offline RL algorithms take the approach of constraining or regularizing…

Machine Learning · Computer Science 2021-12-06 Scott Fujimoto , Shixiang Shane Gu

While reinforcement learning (RL) enables robots to acquire skills autonomously, its real-world deployment is severely limited by inefficient and unsafe exploration. Human-in-the-loop interventions offer a practical solution, yet existing…

Robotics · Computer Science 2026-05-26 Yunyang Mo , Jian Li , Qiwei Wu , Yihang Kang , Renjing Xu

Reinforcement Learning (RL) has shown great empirical success in various application domains. The theoretical aspects of the problem have been extensively studied over past decades, particularly under tabular and linear Markov Decision…

Machine Learning · Computer Science 2024-06-24 Sattar Vakili

Reliant on too many experiments to learn good actions, current Reinforcement Learning (RL) algorithms have limited applicability in real-world settings, which can be too expensive to allow exploration. We propose an algorithm for batch RL,…

Machine Learning · Computer Science 2021-12-07 Rasool Fakoor , Jonas Mueller , Kavosh Asadi , Pratik Chaudhari , Alexander J. Smola

Among the reasons hindering reinforcement learning (RL) applications to real-world problems, two factors are critical: limited data and the mismatch between the testing environment (real environment in which the policy is deployed) and the…

Machine Learning · Computer Science 2023-01-30 Xiaoteng Ma , Zhipeng Liang , Jose Blanchet , Mingwen Liu , Li Xia , Jiheng Zhang , Qianchuan Zhao , Zhengyuan Zhou

Since the inception of Deep Reinforcement Learning (DRL) algorithms, there has been a growing interest in both research and industrial communities in the promising potentials of this paradigm. The list of current and envisioned applications…

Machine Learning · Computer Science 2018-10-25 Vahid Behzadan , Arslan Munir

Learning tabula rasa, that is without any prior knowledge, is the prevalent workflow in reinforcement learning (RL) research. However, RL systems, when applied to large-scale settings, rarely operate tabula rasa. Such large-scale systems…

Machine Learning · Computer Science 2022-10-05 Rishabh Agarwal , Max Schwarzer , Pablo Samuel Castro , Aaron Courville , Marc G. Bellemare

Random exploration is one of the main mechanisms through which reinforcement learning (RL) finds well-performing policies. However, it can lead to undesirable or catastrophic outcomes when learning online in safety-critical environments. In…

Machine Learning · Computer Science 2021-07-15 Djordje Grbic , Sebastian Risi

Offline reinforcement learning (RL) provides a promising approach to avoid costly online interaction with the real environment. However, the performance of offline RL highly depends on the quality of the datasets, which may cause…

Robotics · Computer Science 2024-05-08 Yiwen Hou , Haoyuan Sun , Jinming Ma , Feng Wu

Recent offline meta-reinforcement learning (meta-RL) methods typically utilize task-dependent behavior policies (e.g., training RL agents on each individual task) to collect a multi-task dataset. However, these methods always require extra…

Machine Learning · Computer Science 2023-06-02 Jianhao Wang , Jin Zhang , Haozhe Jiang , Junyu Zhang , Liwei Wang , Chongjie Zhang

Reinforcement learning (RL) is a powerful data-driven control method that has been largely explored in autonomous driving tasks. However, conventional RL approaches learn control policies through trial-and-error interactions with the…

Robotics · Computer Science 2021-11-03 Tianyu Shi , Dong Chen , Kaian Chen , Zhaojian Li

Offline reinforcement learning (RL) aims to find a near-optimal policy using pre-collected datasets. In real-world scenarios, data collection could be costly and risky; therefore, offline RL becomes particularly challenging when the…

Machine Learning · Computer Science 2024-12-18 Ruizhe Shi , Yuyao Liu , Yanjie Ze , Simon S. Du , Huazhe Xu

Sequential decision-making agents struggle with long horizon tasks, since solving them requires multi-step reasoning. Most reinforcement learning (RL) algorithms address this challenge by improved credit assignment, introducing memory…

Machine Learning · Computer Science 2023-04-04 Bogdan Mazoure , Jake Bruce , Doina Precup , Rob Fergus , Ankit Anand

One of the main challenges in reinforcement learning (RL) is that the agent has to make decisions that would influence the future performance without having complete knowledge of the environment. Dynamically adjusting the level of epistemic…

Machine Learning · Computer Science 2026-03-02 Yupeng Wu , Wenyun Li , Wenjie Huang , Chin Pang Ho

The past few years have seen rapid progress in combining reinforcement learning (RL) with deep learning. Various breakthroughs ranging from games to robotics have spurred the interest in designing sophisticated RL algorithms and systems.…

Machine Learning · Computer Science 2022-11-09 Zhihui Xie , Zichuan Lin , Junyou Li , Shuai Li , Deheng Ye

Modern astronomical experiments are designed to achieve multiple scientific goals, from studies of galaxy evolution to cosmic acceleration. These goals require data of many different classes of night-sky objects, each of which has a…

Instrumentation and Methods for Astrophysics · Physics 2023-12-01 Franco Terranova , M. Voetberg , Brian Nord , Amanda Pagul

Meta-learning is a line of research that develops the ability to leverage past experiences to efficiently solve new learning problems. Meta-Reinforcement Learning (meta-RL) methods demonstrate a capability to learn behaviors that…

Machine Learning · Computer Science 2022-08-25 Brieuc Pinon , Jean-Charles Delvenne , Raphaël Jungers

Online reinforcement learning (RL) is increasingly used for realizing adaptive systems in the presence of design time uncertainty. Online RL facilitates learning from actual operational data and thereby leverages feedback only available at…

Software Engineering · Computer Science 2023-07-11 Andreas Metzger , Jan Laufer , Felix Feit , Klaus Pohl

A major challenge of reinforcement learning (RL) in real-world applications is the variation between environments, tasks or clients. Meta-RL (MRL) addresses this issue by learning a meta-policy that adapts to new tasks. Standard MRL methods…

Machine Learning · Computer Science 2023-10-03 Ido Greenberg , Shie Mannor , Gal Chechik , Eli Meirom

Data is a critical asset in AI, as high-quality datasets can significantly improve the performance of machine learning models. In safety-critical domains such as autonomous vehicles, offline deep reinforcement learning (offline DRL) is…

Cryptography and Security · Computer Science 2023-09-07 Linkang Du , Min Chen , Mingyang Sun , Shouling Ji , Peng Cheng , Jiming Chen , Zhikun Zhang