中文
相关论文

相关论文: A Dual Approach to Imitation Learning from Observa…

200 篇论文

Imitation learning is a central problem in reinforcement learning where the goal is to learn a policy that mimics the expert's behavior. In practice, it is often challenging to learn the expert policy from a limited number of demonstrations…

机器学习 · 计算机科学 2025-06-26 Heyang Zhao , Xingrui Yu , David M. Bossens , Ivor W. Tsang , Quanquan Gu

We propose a new framework for imitation learning -- treating imitation as a two-player ranking-based game between a policy and a reward. In this game, the reward agent learns to satisfy pairwise performance rankings between behaviors,…

机器学习 · 计算机科学 2023-01-18 Harshit Sikchi , Akanksha Saran , Wonjoon Goo , Scott Niekum

Construction robots are challenging the traditional paradigm of labor intensive and repetitive construction tasks. Present concerns regarding construction robots are focused on their abilities in performing complex tasks consisting of…

机器人学 · 计算机科学 2023-05-25 Kangkang Duan , Zhengbo Zou

Limited data has become a major bottleneck in scaling up offline imitation learning (IL). In this paper, we propose enhancing IL performance under limited expert data by introducing a pre-training stage that learns dynamics representations,…

机器人学 · 计算机科学 2025-08-21 Haitong Ma , Bo Dai , Zhaolin Ren , Yebin Wang , Na Li

Imitation learning (IL) is a popular paradigm for training policies in robotic systems when specifying the reward function is difficult. However, despite the success of IL algorithms, they impose the somewhat unrealistic requirement that…

In reinforcement learning (RL), sparse rewards can present a significant challenge. Fortunately, expert actions can be utilized to overcome this issue. However, acquiring explicit expert actions can be costly, and expert observations are…

机器人学 · 计算机科学 2023-07-25 Minh-Huy Hoang , Long Dinh , Hai Nguyen

We present the ADaptive Adversarial Imitation Learning (ADAIL) algorithm for learning adaptive policies that can be transferred between environments of varying dynamics, by imitating a small number of demonstrations collected from a single…

机器学习 · 计算机科学 2020-08-31 Yiren Lu , Jonathan Tompson

Imitation by observation is an approach for learning from expert demonstrations that lack action information, such as videos. Recent approaches to this problem can be placed into two broad categories: training dynamics models that aim to…

机器学习 · 计算机科学 2019-05-21 Ashley D. Edwards , Charles L. Isbell

Imitation learning (IL) consists of a set of tools that leverage expert demonstrations to quickly learn policies. However, if the expert is suboptimal, IL can yield policies with inferior performance compared to reinforcement learning (RL).…

机器学习 · 计算机科学 2018-05-29 Ching-An Cheng , Xinyan Yan , Nolan Wagener , Byron Boots

Offline reinforcement learning agents face significant deployment challenges due to the synthetic-to-real distribution mismatch. While most prior research has focused on improving the fidelity of synthetic sampling and incorporating…

机器学习 · 计算机科学 2025-10-01 Chi Zhou , Wang Luo , Haoran Li , Congying Han , Tiande Guo , Zicheng Zhang

Imitation learning allows agents to learn complex behaviors from demonstrations. However, learning a complex vision-based task may require an impractical number of demonstrations. Meta-imitation learning is a promising approach towards…

Imitation learning enables autonomous agents to learn from human examples, without the need for a reward signal. Still, if the provided dataset does not encapsulate the task correctly, or when the task is too complex to be modeled, such…

人工智能 · 计算机科学 2024-06-10 Federico Malato , Ville Hautamaki

Imitation learning is a widely used policy learning method that enables intelligent agents to acquire complex skills from expert demonstrations. The input to the imitation learning algorithm is usually composed of both the current…

计算机视觉与模式识别 · 计算机科学 2022-07-21 Chia-Chi Chuang , Donglin Yang , Chuan Wen , Yang Gao

Offline Reinforcement Learning (RL) addresses the problem of sequential decision-making by learning optimal policy through pre-collected data, without interacting with the environment. As yet, it has remained somewhat impractical, because…

机器学习 · 计算机科学 2024-10-07 Maksim Bobrin , Nazar Buzun , Dmitrii Krylov , Dmitry V. Dylov

Offline imitation learning enables learning a policy solely from a set of expert demonstrations, without any environment interaction. To alleviate the issue of distribution shift arising due to the small amount of expert data, recent works…

机器学习 · 计算机科学 2025-05-23 Udita Ghosh , Dripta S. Raychaudhuri , Jiachen Li , Konstantinos Karydis , Amit K. Roy-Chowdhury

Imitation learning from observation (LfO) is more preferable than imitation learning from demonstration (LfD) due to the nonnecessity of expert actions when reconstructing the expert policy from the expert data. However, previous studies…

机器人学 · 计算机科学 2020-10-19 Zhihao Cheng , Liu Liu , Aishan Liu , Hao Sun , Meng Fang , Dacheng Tao

We focus on the problem of imitation learning from visual observations, where the learning agent has access to videos of experts as its sole learning source. The challenges of this framework include the absence of expert actions and the…

机器学习 · 计算机科学 2024-05-27 Vittorio Giammarino , James Queeney , Ioannis Ch. Paschalidis

When cast into the Deep Reinforcement Learning framework, many robotics tasks require solving a long horizon and sparse reward problem, where learning algorithms struggle. In such context, Imitation Learning (IL) can be a powerful approach…

人工智能 · 计算机科学 2023-04-14 Alexandre Chenu , Nicolas Perrin-Gilbert , Olivier Sigaud

In many cases an intelligent agent may want to learn how to mimic a single observed demonstrated trajectory. In this work we consider how to perform such procedural learning from observation, which could help to enable agents to better use…

机器学习 · 计算机科学 2019-04-22 Tong Mu , Karan Goel , Emma Brunskill

Imitation learning techniques have been shown to be highly effective in real-world control scenarios, such as robotics. However, these approaches not only suffer from compounding error issues but also require human experts to provide…

机器人学 · 计算机科学 2025-02-21 Yigit Korkmaz , Erdem Bıyık