中文
相关论文

相关论文: Off-Policy RL Algorithms Can be Sample-Efficient f…

200 篇论文

Sample inefficiency is a long-lasting challenge in deep reinforcement learning (DRL). Despite dramatic improvements have been made, the problem is far from being solved and is especially challenging in environments with sparse or delayed…

机器学习 · 计算机科学 2025-06-17 Federico Malato , Ville Hautamaki

This paper introduces an open-source, decentralized framework named SigmaRL, designed to enhance both sample efficiency and generalization of multi-agent Reinforcement Learning (RL) for motion planning of connected and automated vehicles.…

机器人学 · 计算机科学 2025-04-11 Jianye Xu , Pan Hu , Bassam Alrifaee

Applying reinforcement learning (RL) to real-world applications requires addressing a trade-off between asymptotic performance, sample efficiency, and inference time. In this work, we demonstrate how to address this triple challenge by…

机器学习 · 计算机科学 2024-07-03 Zakariae El Asri , Olivier Sigaud , Nicolas Thome

Adversarial Imitation Learning (AIL) faces challenges with sample inefficiency because of its reliance on sufficient on-policy data to evaluate the performance of the current policy during reward function updates. In this work, we study the…

机器学习 · 计算机科学 2024-05-28 Yilei Chen , Vittorio Giammarino , James Queeney , Ioannis Ch. Paschalidis

To unbiasedly evaluate multiple target policies, the dominant approach among RL practitioners is to run and evaluate each target policy separately. However, this evaluation method is far from efficient because samples are not shared across…

机器学习 · 计算机科学 2024-12-30 Shuze Daniel Liu , Claire Chen , Shangtong Zhang

Offline reinforcement learning (RL) defines the task of learning from a fixed batch of data. Due to errors in value estimation from out-of-distribution actions, most offline RL algorithms take the approach of constraining or regularizing…

机器学习 · 计算机科学 2021-12-06 Scott Fujimoto , Shixiang Shane Gu

Offline reinforcement learning proposes to learn policies from large collected datasets without interacting with the physical environment. These algorithms have made it possible to learn useful skills from data that can then be deployed in…

机器学习 · 计算机科学 2021-07-06 Samarth Sinha , Ajay Mandlekar , Animesh Garg

As a paradigm for sequential decision making in unknown environments, reinforcement learning (RL) has received a flurry of attention in recent years. However, the explosion of model complexity in emerging applications and the presence of…

机器学习 · 统计学 2025-07-22 Yuejie Chi , Yuxin Chen , Yuting Wei

Multi-agent reinforcement learning (MARL) methods have achieved state-of-the-art results on a range of multi-agent tasks. Yet, MARL algorithms typically require significantly more environment interactions than their single-agent…

系统与控制 · 电气工程与系统科学 2026-03-17 Tom Danino , Nahum Shimkin

The paradigm of decision-making has been revolutionised by reinforcement learning and deep learning. Although this has led to significant progress in domains such as robotics, healthcare, and finance, the use of RL in practice is…

机器学习 · 计算机科学 2026-02-23 Daqian Shao

Reinforcement learning (RL) is a classical tool to solve network control or policy optimization problems in unknown environments. The original Q-learning suffers from performance and complexity challenges across very large networks. Herein,…

机器学习 · 计算机科学 2024-09-02 Talha Bozkus , Urbashi Mitra

Offline learning is a key part of making reinforcement learning (RL) useable in real systems. Offline RL looks at scenarios where there is data from a system's operation, but no direct access to the system when learning a policy. Recent…

机器学习 · 计算机科学 2021-03-18 Arthur Argenson , Gabriel Dulac-Arnold

Recent theoretical work studies sample-efficient reinforcement learning (RL) extensively in two settings: learning interactively in the environment (online RL), or learning from an offline dataset (offline RL). However, existing algorithms…

机器学习 · 计算机科学 2022-02-14 Tengyang Xie , Nan Jiang , Huan Wang , Caiming Xiong , Yu Bai

Offline reinforcement learning (RL) tries to learn the near-optimal policy with recorded offline experience without online exploration. Current offline RL research includes: 1) generative modeling, i.e., approximating a policy using fixed…

机器学习 · 计算机科学 2021-06-23 Hua Wei , Deheng Ye , Zhao Liu , Hao Wu , Bo Yuan , Qiang Fu , Wei Yang , Zhenhui Li

Reliant on too many experiments to learn good actions, current Reinforcement Learning (RL) algorithms have limited applicability in real-world settings, which can be too expensive to allow exploration. We propose an algorithm for batch RL,…

机器学习 · 计算机科学 2021-12-07 Rasool Fakoor , Jonas Mueller , Kavosh Asadi , Pratik Chaudhari , Alexander J. Smola

Offline reinforcement learning (RL) seeks to learn optimal policies from static datasets without further environment interaction. A key challenge is the distribution shift between the learned and behavior policies, leading to…

机器学习 · 计算机科学 2025-08-11 Haohui Chen , Zhiyong Chen

Off-policy learning methods seek to derive an optimal policy directly from a fixed dataset of prior interactions. This objective presents significant challenges, primarily due to the inherent distributional shift and value function…

机器学习 · 计算机科学 2026-02-03 Arip Asadulaev , Maksim Bobrin , Salem Lahlou , Dmitry Dylov , Fakhri Karray , Martin Takac

Multitask Reinforcement Learning (MTRL) approaches have gained increasing attention for its wide applications in many important Reinforcement Learning (RL) tasks. However, while recent advancements in MTRL theory have focused on the…

机器学习 · 统计学 2024-03-07 Ziping Xu , Zifan Xu , Runxuan Jiang , Peter Stone , Ambuj Tewari

Modern reinforcement learning (RL) often faces an enormous state-action space. Existing analytical results are typically for settings with a small number of state-actions, or simple models such as linearly modeled Q-functions. To derive…

机器学习 · 计算机科学 2023-02-03 Sing-Yuan Yeh , Fu-Chieh Chang , Chang-Wei Yueh , Pei-Yuan Wu , Alberto Bernacchia , Sattar Vakili

Deep reinforcement learning (DRL) provides a new way to generate robot control policy. However, the process of training control policy requires lengthy exploration, resulting in a low sample efficiency of reinforcement learning (RL) in…

机器学习 · 计算机科学 2022-12-08 Chao Li