中文
相关论文

相关论文: Imitation Learning from Observation through Optima…

200 篇论文

A significant challenge for the practical application of reinforcement learning in the real world is the need to specify an oracle reward function that correctly defines a task. Inverse reinforcement learning (IRL) seeks to avoid this…

机器学习 · 计算机科学 2019-10-16 Kelvin Xu , Ellis Ratner , Anca Dragan , Sergey Levine , Chelsea Finn

We propose a distributional framework for offline Inverse Reinforcement Learning (IRL) that jointly models uncertainty over reward functions and full distributions of returns. Unlike conventional IRL approaches that recover a deterministic…

机器学习 · 计算机科学 2026-05-29 Feiyang Wu , Ye Zhao , Anqi Wu

Inverse Reinforcement Learning (IRL) learns a reward function to explain expert demonstrations. Modern IRL methods often use the adversarial (minimax) formulation that alternates between reward and policy optimization, which often lead to…

机器学习 · 计算机科学 2025-10-14 Yang Chen , Menglin Zou , Jiaqi Zhang , Yitan Zhang , Junyi Yang , Gael Gendron , Libo Zhang , Jiamou Liu , Michael J. Witbrock

How to make imitation learning more general when demonstrations are relatively limited has been a persistent problem in reinforcement learning (RL). Poor demonstrations lead to narrow and biased date distribution, non-Markovian human expert…

人工智能 · 计算机科学 2021-11-17 Haofeng Liu , Yiwen Chen , Jiayi Tan , Marcelo H Ang

Imitation learning is a promising approach for training autonomous vehicles (AV) to navigate complex traffic environments by mimicking expert driver behaviors. While existing imitation learning frameworks focus on leveraging expert…

机器人学 · 计算机科学 2025-09-25 Yasin Sonmez , Hanna Krasowski , Murat Arcak

Two current methods used to train autonomous cars are reinforcement learning and imitation learning. This research develops a new learning methodology and systematic approach in both a simulated and a smaller real world environment by…

机器人学 · 计算机科学 2021-11-24 Heidi Lu

Sample efficiency is critical for online Reinforcement Learning from Human Feedback (RLHF). While existing works investigate sample-efficient online exploration strategies, the potential of utilizing misspecified yet relevant reward models…

机器学习 · 计算机科学 2025-05-20 Jiawei Huang , Bingcong Li , Christoph Dann , Niao He

This paper presents a novel approach to imitation learning from observations, where an autoregressive mixture of experts model is deployed to fit the underlying policy. The parameters of the model are learned via a two-stage framework. By…

机器学习 · 计算机科学 2024-11-14 Renzi Wang , Flavia Sofia Acerbo , Tong Duy Son , Panagiotis Patrinos

Trajectory optimization (TO) is an efficient tool to generate a redundant manipulator's joint trajectory following a 6-dimensional Cartesian path. The optimization performance largely depends on the quality of initial trajectories. However,…

机器人学 · 计算机科学 2026-02-10 Minsung Yoon , Mincheul Kang , Daehyung Park , Sung-Eui Yoon

Imitation learning has been applied to a range of robotic tasks, but can struggle when robots encounter edge cases that are not represented in the training data (i.e., distribution shift). Interactive fleet learning (IFL) mitigates…

机器人学 · 计算机科学 2023-10-23 Gaurav Datta , Ryan Hoque , Anrui Gu , Eugen Solowjow , Ken Goldberg

A key challenge in Imitation Learning (IL) is that optimal state actions demonstrations are difficult for the teacher to provide. For example in robotics, providing kinesthetic demonstrations on a robotic manipulator requires the teacher to…

机器人学 · 计算机科学 2021-04-05 Matthew Schmittle , Sanjiban Choudhury , Siddhartha S. Srinivasa

This work handles the inverse reinforcement learning (IRL) problem where only a small number of demonstrations are available from a demonstrator for each high-dimensional task, insufficient to estimate an accurate reward function. Observing…

人工智能 · 计算机科学 2017-10-16 Kun Li , Joel W. Burdick

Learning from demonstration is widely used as an efficient way for robots to acquire new skills. However, it typically requires that demonstrations provide full access to the state and action sequences. In contrast, learning from…

机器学习 · 计算机科学 2020-08-05 Zachary W. Robertson , Matthew R. Walter

The goal of imitation learning is to mimic expert behavior without access to an explicit reward signal. Expert demonstrations provided by humans, however, often show significant variability due to latent factors that are typically not…

机器学习 · 计算机科学 2017-11-16 Yunzhu Li , Jiaming Song , Stefano Ermon

Cross-domain imitation learning studies how to leverage expert demonstrations of one agent to train an imitation agent with a different embodiment or morphology. Comparing trajectories and stationary distributions between the expert and…

机器学习 · 计算机科学 2026-01-14 Arnaud Fickinger , Samuel Cohen , Stuart Russell , Brandon Amos

We consider a setting for Inverse Reinforcement Learning (IRL) where the learner is extended with the ability to actively select multiple environments, observing an agent's behavior on each environment. We first demonstrate that if the…

人工智能 · 计算机科学 2016-01-26 Kareem Amin , Satinder Singh

Sidewalk micromobility is a promising solution for last-mile transportation, but current learning-based control methods struggle in complex urban environments. Imitation learning (IL) learns policies from human demonstrations, yet its…

机器人学 · 计算机科学 2026-03-25 Honglin He , Yukai Ma , Brad Squicciarini , Wayne Wu , Bolei Zhou

Imitation learning is an effective alternative approach to learn a policy when the reward function is sparse. In this paper, we consider a challenging setting where an agent and an expert use different actions from each other. We assume…

机器学习 · 计算机科学 2019-08-27 Konrad Zolna , Negar Rostamzadeh , Yoshua Bengio , Sungjin Ahn , Pedro O. Pinheiro

This article studies inverse reinforcement learning (IRL) for the stochastic linear-quadratic optimal control problem, where two agents are considered. A learner agent does not know the expert agent's performance cost function, but it…

最优化与控制 · 数学 2024-05-28 Zhongshi Sun , Guangyan Jia

While imitation learning for vision based autonomous mobile robot navigation has recently received a great deal of attention in the research community, existing approaches typically require state action demonstrations that were gathered…

机器人学 · 计算机科学 2022-03-30 Haresh Karnan , Garrett Warnell , Xuesu Xiao , Peter Stone