English
Related papers

Related papers: Imitation Learning from Observations by Minimizing…

200 papers

Learning from visual data opens the potential to accrue a large range of manipulation behaviors by leveraging human demonstrations without specifying each of them mathematically, but rather through natural task specification. In this paper,…

Robotics · Computer Science 2021-11-16 Haoyu Xiong , Quanzhou Li , Yun-Chun Chen , Homanga Bharadhwaj , Samarth Sinha , Animesh Garg

This work studies the alignment of large language models with preference data from an imitation learning perspective. We establish a close theoretical connection between reinforcement learning from human feedback RLHF and imitation learning…

Machine Learning · Computer Science 2025-03-10 Teng Xiao , Yige Yuan , Mingxiao Li , Zhengyu Chen , Vasant G Honavar

Deep reinforcement learning (DRL) provides a new way to generate robot control policy. However, the process of training control policy requires lengthy exploration, resulting in a low sample efficiency of reinforcement learning (RL) in…

Machine Learning · Computer Science 2022-12-08 Chao Li

Imitation Learning (IL), also referred to as Learning from Demonstration (LfD), holds significant promise for capturing expert motor skills through efficient imitation, facilitating adept navigation of complex scenarios. A persistent…

Robotics · Computer Science 2024-04-01 Yingbai Hu , Fares J. Abu-Dakka , Fei Chen , Xiao Luo , Zheng Li , Alois Knoll , Weiping Ding

We propose Zeroth-Order Random Matrix Search for Learning from Demonstrations (ZORMS-LfD). ZORMS-LfD enables the costs, constraints, and dynamics of constrained optimal control problems, in both continuous and discrete time, to be learned…

Machine Learning · Computer Science 2025-07-24 Olivia Dry , Timothy L. Molloy , Wanxin Jin , Iman Shames

Utilizing a robot in a new application requires the robot to be programmed at each time. To reduce such programmings efforts, we have been developing ``Learning-from-observation (LfO)'' that automatically generates robot programs by…

Robotics · Computer Science 2023-04-21 Katsushi Ikeuchi , Jun Takamatsu , Kazuhiro Sasabuchi , Naoki Wake , Atsushi Kanehiro

This article proposes a method for learning and robotic replication of dynamic collaborative tasks from offline videos. The objective is to extend the concept of learning from demonstration (LfD) to dynamic scenarios, benefiting from widely…

Robotics · Computer Science 2022-04-11 Francesco Iodice , Yuqiang Wu , Wansoo Kim , Fei Zhao , Elena De Momi , Arash Ajoudani

Current Human-Robot Interaction (HRI) systems for skill teaching are fragmented, and existing approaches in the literature do not offer a cohesive framework that is simultaneously efficient, intuitive, and universally safe. This paper…

Robotics · Computer Science 2026-04-10 Zi-Qi Yang , Mehrdad R. Kermani

Learning from demonstration (LfD) provides a fast, intuitive and efficient framework to program robot skills, which has gained growing interest both in research and industrial applications. Most complex manipulation tasks are long-term and…

Robotics · Computer Science 2022-03-02 Meng Guo , Mathias Buerger

Current visual foundation models (VFMs) face a fundamental limitation in transferring knowledge from vision language models (VLMs), while VLMs excel at modeling cross-modal interactions through unified representation spaces, existing VFMs…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Yilin Gao , Kangyi Chen , Zhongxing Peng , Hengjie Lu , Shugong Xu

Expert demonstrations have proven an easy way to indirectly specify complex tasks. Recent algorithms even support extracting unambiguous formal specifications, e.g. deterministic finite automata (DFA), from demonstrations. Unfortunately,…

Machine Learning · Computer Science 2025-06-24 Marcell Vazquez-Chanlatte , Karim Elmaaroufi , Stefan J. Witwicki , Matei Zaharia , Sanjit A. Seshia

Learning from Demonstration (LfD) algorithms enable humans to teach new skills to robots through demonstrations. The learned skills can be robustly reproduced from the identical or near boundary conditions (e.g., initial point). However,…

Robotics · Computer Science 2024-07-01 Brendan Hertel , S. Reza Ahmadzadeh

Imitation learning is a central problem in reinforcement learning where the goal is to learn a policy that mimics the expert's behavior. In practice, it is often challenging to learn the expert policy from a limited number of demonstrations…

Machine Learning · Computer Science 2025-06-26 Heyang Zhao , Xingrui Yu , David M. Bossens , Ivor W. Tsang , Quanquan Gu

The problem of generalization in learning from demonstration (LfD) has received considerable attention over the years, particularly within the context of movement primitives, where a number of approaches have emerged. Recently, two…

Machine Learning · Computer Science 2025-03-05 Markus Knauer , Alin Albu-Schäffer , Freek Stulp , João Silvério

Learning from Demonstration (LfD) stands as an efficient framework for imparting human-like skills to robots. Nevertheless, designing an LfD framework capable of seamlessly imitating, generalizing, and reacting to disturbances for…

Robotics · Computer Science 2024-06-25 Yan Zhang , Teng Xue , Amirreza Razmjoo , Sylvain Calinon

Imitation learning is a widely used policy learning method that enables intelligent agents to acquire complex skills from expert demonstrations. The input to the imitation learning algorithm is usually composed of both the current…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Chia-Chi Chuang , Donglin Yang , Chuan Wen , Yang Gao

Most existing imitation learning approaches assume the demonstrations are drawn from experts who are optimal, but relaxing this assumption enables us to use a wider range of data. Standard imitation learning may learn a suboptimal policy…

Machine Learning · Computer Science 2022-01-27 Songyuan Zhang , Zhangjie Cao , Dorsa Sadigh , Yanan Sui

This paper presents a novel approach to imitation learning from observations, where an autoregressive mixture of experts model is deployed to fit the underlying policy. The parameters of the model are learned via a two-stage framework. By…

Machine Learning · Computer Science 2024-11-14 Renzi Wang , Flavia Sofia Acerbo , Tong Duy Son , Panagiotis Patrinos

Inverse reinforcement learning (IRL), which infers reward functions from demonstrations, is a valuable tool for modeling and understanding decision-making behavior. Many variants of IRL have been developed to capture complexities of human…

Machine Learning · Computer Science 2026-05-14 Leo Benac , Abhishek Sharma , Alihan Huyuk , Finale Doshi-Velez

Existing imitation learning (IL) methods such as inverse reinforcement learning (IRL) usually have a double-loop training process, alternating between learning a reward function and a policy and tend to suffer long training time and high…

Machine Learning · Computer Science 2022-06-13 Siwei Chen , Xiao Ma , Zhongwen Xu