English
Related papers

Related papers: Learning from Interventions using Hierarchical Pol…

200 papers

Imitation learning (IL) aims to mimic the behavior of an expert in a sequential decision making task by learning from demonstrations, and has been widely applied to robotics, autonomous driving, and autoregressive text generation. The…

Machine Learning · Computer Science 2024-12-03 Dylan J. Foster , Adam Block , Dipendra Misra

How to make imitation learning more general when demonstrations are relatively limited has been a persistent problem in reinforcement learning (RL). Poor demonstrations lead to narrow and biased date distribution, non-Markovian human expert…

Artificial Intelligence · Computer Science 2021-11-17 Haofeng Liu , Yiwen Chen , Jiayi Tan , Marcelo H Ang

Effective exploration continues to be a significant challenge that prevents the deployment of reinforcement learning for many physical systems. This is particularly true for systems with continuous and high-dimensional state and action…

Machine Learning · Computer Science 2022-07-21 Trevor Ablett , Bryan Chan , Jonathan Kelly

Learning from Demonstration (LfD) constitutes one of the most robust methodologies for constructing efficient cognitive robotic systems. Despite the large body of research works already reported, current key technological challenges include…

Robotics · Computer Science 2021-03-30 Georgios Th. Papadopoulos , Margherita Antona , Constantine Stephanidis

Conventional reinforcement learning (RL) methods can successfully solve a wide range of sequential decision problems. However, learning policies that can generalize predictably across multiple tasks in a setting with non-Markovian reward…

Machine Learning · Computer Science 2024-06-04 Guillermo Infante , David Kuric , Anders Jonsson , Vicenç Gómez , Herke van Hoof

State-of-the-art imitation learning from observation methods (ILfO) have recently made significant progress, but they still have some limitations: they need action-based supervised optimisation, assume that states have a single optimal…

Machine Learning · Computer Science 2026-01-27 Nathan Gavenski , Matteo Leonetti , Odinaldo Rodrigues

In sequential decision-making environments, the primary approaches for training agents are Reinforcement Learning (RL) and Imitation Learning (IL). Unlike RL, which relies on modeling a reward function, IL leverages expert demonstrations,…

Artificial Intelligence · Computer Science 2024-12-11 Jonas Nüßlein , Maximilian Zorn , Philipp Altmann , Claudia Linnhoff-Popien

Learning from Demonstration (LfD) is a promising approach to enable Multi-Robot Systems (MRS) to acquire complex skills and behaviors. However, the intricate interactions and coordination challenges in MRS pose significant hurdles for…

Robotics · Computer Science 2024-04-04 Vishnunandan L. N. Venkatesh , Byung-Cheol Min

Learning from observation (LfO) aims to imitate experts by learning from state-only demonstrations without requiring action labels. Existing adversarial imitation learning approaches learn a generator agent policy to produce state…

Machine Learning · Computer Science 2024-10-10 Bo-Ruei Huang , Chun-Kai Yang , Chun-Mao Lai , Dai-Jie Wu , Shao-Hua Sun

This paper presents our solution for the Real Robot Challenge (RRC) III, a competition featured in the NeurIPS 2022 Competition Track, aimed at addressing dexterous robotic manipulation tasks through learning from pre-collected offline…

Reinforcement learning (RL) algorithms have demonstrated promising results on complex tasks, yet often require impractical numbers of samples since they learn from scratch. Meta-RL aims to address this challenge by leveraging experience…

Machine Learning · Computer Science 2020-10-28 Russell Mendonca , Abhishek Gupta , Rosen Kralev , Pieter Abbeel , Sergey Levine , Chelsea Finn

Humans often acquire new skills through observation and imitation. For robotic agents, learning from the plethora of unlabeled video demonstration data available on the Internet necessitates imitating the expert without access to its…

Robotics · Computer Science 2024-02-08 Yuyang Liu , Weijun Dong , Yingdong Hu , Chuan Wen , Zhao-Heng Yin , Chongjie Zhang , Yang Gao

Imitation learning is an effective and safe technique to train robot policies in the real world because it does not depend on an expensive random exploration process. However, due to the lack of exploration, learning policies that…

Robotics · Computer Science 2021-06-24 Ajay Mandlekar , Danfei Xu , Roberto Martín-Martín , Silvio Savarese , Li Fei-Fei

Learning from Demonstration (LfD) algorithms enable humans to teach new skills to robots through demonstrations. The learned skills can be robustly reproduced from the identical or near boundary conditions (e.g., initial point). However,…

Robotics · Computer Science 2024-07-01 Brendan Hertel , S. Reza Ahmadzadeh

Humans generally teach their fellow collaborators to perform tasks through a small number of demonstrations. The learnt task is corrected or extended to meet specific task goals by means of coaching. Adopting a similar framework for…

Recent Offline Reinforcement Learning methods have succeeded in learning high-performance policies from fixed datasets of experience. A particularly effective approach learns to first identify and then mimic optimal decision-making…

Machine Learning · Computer Science 2023-12-12 Jake Grigsby , Yanjun Qi

Imitation learning trains control policies by mimicking pre-recorded expert demonstrations. In partially observable settings, imitation policies must rely on observation histories, but many seemingly paradoxical results show better…

Machine Learning · Computer Science 2021-06-14 Chuan Wen , Jierui Lin , Jianing Qian , Yang Gao , Dinesh Jayaraman

Recent advances in deep reinforcement learning (RL) have demonstrated its potential to learn complex robotic manipulation tasks. However, RL still requires the robot to collect a large amount of real-world experience. To address this…

Robotics · Computer Science 2020-03-12 Bohan Wu , Feng Xu , Zhanpeng He , Abhi Gupta , Peter K. Allen

Humans demonstrate a variety of interesting behavioral characteristics when performing tasks, such as selecting between seemingly equivalent optimal actions, performing recovery actions when deviating from the optimal trajectory, or…

Robotics · Computer Science 2022-11-08 Hanbit Oh , Hikaru Sasaki , Brendan Michael , Takamitsu Matsubara

Visuomotor policies trained via behavior cloning are vulnerable to covariate shift, where small deviations from expert trajectories can compound into failure. Common strategies to mitigate this issue involve expanding the training…

Robotics · Computer Science 2025-08-11 Zhanyi Sun , Shuran Song