中文
相关论文

相关论文: Offline Learning from Demonstrations and Unlabeled…

200 篇论文

Deep reinforcement learning algorithms have succeeded in several challenging domains. Classic Online RL job schedulers can learn efficient scheduling strategies but often takes thousands of timesteps to explore the environment and adapt…

机器学习 · 计算机科学 2022-12-05 Vanamala Venkataswamy , Jake Grigsby , Andrew Grimshaw , Yanjun Qi

A major challenge in real-world reinforcement learning (RL) is the sparsity of reward feedback. Often, what is available is an intuitive but sparse reward function that only indicates whether the task is completed partially or fully.…

机器学习 · 计算机科学 2022-02-15 Desik Rengarajan , Gargi Vaidya , Akshay Sarvesh , Dileep Kalathil , Srinivas Shakkottai

Offline reinforcement learning (RL) seeks to learn optimal policies from static datasets without interacting with the environment. A common challenge is handling multi-modal action distributions, where multiple behaviours are represented in…

机器学习 · 计算机科学 2025-03-20 Mianchu Wang , Yue Jin , Giovanni Montana

Offline inverse reinforcement learning (IRL) aims to recover a reward function that explains expert behavior using only fixed demonstration data, without any additional online interaction. We propose BiCQL-ML, a policy-free offline IRL…

机器学习 · 计算机科学 2025-12-01 Junsung Park

Most existing imitation learning approaches assume the demonstrations are drawn from experts who are optimal, but relaxing this assumption enables us to use a wider range of data. Standard imitation learning may learn a suboptimal policy…

机器学习 · 计算机科学 2022-01-27 Songyuan Zhang , Zhangjie Cao , Dorsa Sadigh , Yanan Sui

In many reinforcement learning (RL) applications one cannot easily let the agent act in the world; this is true for autonomous vehicles, healthcare applications, and even some recommender systems, to name a few examples. Offline RL provides…

机器学习 · 计算机科学 2024-07-02 Ori Linial , Guy Tennenholtz , Uri Shalit

Learning robot policies using imitation learning requires collecting large amounts of costly action-labeled expert demonstrations, which fundamentally limits the scale of training data. A promising approach to address this bottleneck is to…

机器人学 · 计算机科学 2025-05-12 Anthony Liang , Pavel Czempin , Matthew Hong , Yutai Zhou , Erdem Biyik , Stephen Tu

Offline inverse reinforcement learning (Offline IRL) aims to recover the structure of rewards and environment dynamics that underlie observed actions in a fixed, finite set of demonstrations from an expert agent. Accurate models of…

机器学习 · 计算机科学 2024-03-01 Siliang Zeng , Chenliang Li , Alfredo Garcia , Mingyi Hong

Offline reinforcement learning (RL) enables training from fixed data without online interaction, but policies learned offline often struggle when deployed in dynamic environments due to distributional shift and unreliable value estimates on…

机器学习 · 计算机科学 2025-11-06 Lipeng Zu , Hansong Zhou , Xiaonan Zhang

Online interactions with the environment to collect data samples for training a Reinforcement Learning (RL) agent is not always feasible due to economic and safety concerns. The goal of Offline Reinforcement Learning is to address this…

机器学习 · 计算机科学 2021-10-05 Chi Zhang , Sanmukh Rao Kuppannagari , Viktor K Prasanna

We present a map-less path planning algorithm based on Deep Reinforcement Learning (DRL) for mobile robots navigating in unknown environment that only relies on 40-dimensional raw laser data and odometry information. The planner is trained…

机器人学 · 计算机科学 2020-02-12 Nicolò Botteghi , Beril Sirmacek , Khaled A. A. Mustafa , Mannes Poel , Stefano Stramigioli

Reinforcement learning (RL) and causal modelling naturally complement each other. The goal of causal modelling is to predict the effects of interventions in an environment, while the goal of reinforcement learning is to select interventions…

机器学习 · 计算机科学 2024-07-12 Oliver Schulte , Pascal Poupart

Single-task RL agents are typically trained under a fixed reward function, which limits their robustness to reward misspecification and their ability to adapt to changing preferences. We introduce Reward-Conditioned Reinforcement Learning…

机器学习 · 计算机科学 2026-05-20 Michal Nauman , Marek Cygan , Pieter Abbeel

Offline reinforcement learning allows training reinforcement learning models on data from live deployments. However, it is limited to choosing the best combination of behaviors present in the training data. In contrast, simulation…

机器学习 · 计算机科学 2024-09-24 Eshagh Kargar , Ville Kyrki

The training of autonomous agents often requires expensive and unsafe trial-and-error interactions with the environment. Nowadays several data sets containing recorded experiences of intelligent agents performing various tasks, spanning…

机器学习 · 计算机科学 2020-10-06 Giorgio Angelotti , Nicolas Drougard , Caroline Ponzoni Carvalho Chanel

Off-policy reinforcement learning algorithms promise to be applicable in settings where only a fixed data-set (batch) of environment interactions is available and no new experience can be acquired. This property makes these algorithms…

Behavioral cloning, or more broadly, learning from demonstrations (LfD) is a priomising direction for robot policy learning in complex scenarios. Albeit being straightforward to implement and data-efficient, behavioral cloning has its own…

机器人学 · 计算机科学 2024-05-27 Carl Qi , Edward Sun , Harry Zhang

Despite the considerable potential of reinforcement learning (RL), robotic control tasks predominantly rely on imitation learning (IL) due to its better sample efficiency. However, it is costly to collect comprehensive expert demonstrations…

机器学习 · 计算机科学 2024-05-22 Hengyuan Hu , Suvir Mirchandani , Dorsa Sadigh

We tackle a common scenario in imitation learning (IL), where agents try to recover the optimal policy from expert demonstrations without further access to the expert or environment reward signals. Except the simple Behavior Cloning (BC)…

机器学习 · 计算机科学 2021-04-16 Minghuan Liu , Tairan He , Minkai Xu , Weinan Zhang

In inverse reinforcement learning (IRL), an agent seeks to replicate expert demonstrations through interactions with the environment. Traditionally, IRL is treated as an adversarial game, where an adversary searches over reward models, and…

机器学习 · 计算机科学 2025-04-23 Arnav Kumar Jain , Harley Wiltzer , Jesse Farebrother , Irina Rish , Glen Berseth , Sanjiban Choudhury