English
Related papers

Related papers: JUICER: Data-Efficient Imitation Learning for Robo…

200 papers

Realizing generalizable dynamic object manipulation on conveyor systems is important for enhancing manufacturing efficiency, as it eliminates specialized engineering for different scenarios. To this end, imitation learning emerges as a…

Robotics · Computer Science 2026-02-10 Zhuoling Li , Jinrong Yang , Yong Zhao , Liangliang Ren , Xiaoyang Wu , Zhenhua Xu , Hengshuang Zhao

Imitation learning enables robots to learn and replicate human behavior from training data. Recent advances in machine learning enable end-to-end learning approaches that directly process high-dimensional observation data, such as images.…

Robotics · Computer Science 2024-01-22 Koki Yamane , Sho Sakaino , Toshiaki Tsuji

Advanced imitation learning with structures like the transformer is increasingly demonstrating its advantages in robotics. However, deploying these large-scale models on embedded platforms remains a major challenge. In this paper, we…

Machine Learning · Computer Science 2024-11-19 Haizhou Ge , Ruixiang Wang , Zhu-ang Xu , Hongrui Zhu , Ruichen Deng , Yuhang Dong , Zeyu Pang , Guyue Zhou , Junyu Zhang , Lu Shi

Imitation learning is a powerful paradigm for robot skill acquisition, yet conventional demonstration methods--such as kinesthetic teaching and teleoperation--are cumbersome, hardware-heavy, and disruptive to workflows. Recently, passive…

Robotics · Computer Science 2025-09-30 Rohan Walia , Yusheng Wang , Ralf Römer , Masahiro Nishio , Angela P. Schoellig , Jun Ota

Imitation learning is a promising approach for training autonomous vehicles (AV) to navigate complex traffic environments by mimicking expert driver behaviors. While existing imitation learning frameworks focus on leveraging expert…

Robotics · Computer Science 2025-09-25 Yasin Sonmez , Hanna Krasowski , Murat Arcak

Imitation learning from human demonstrations is an effective means to teach robots manipulation skills. But data acquisition is a major bottleneck in applying this paradigm more broadly, due to the amount of cost and human effort involved.…

Robotics · Computer Science 2025-03-07 Zhenyu Jiang , Yuqi Xie , Kevin Lin , Zhenjia Xu , Weikang Wan , Ajay Mandlekar , Linxi Fan , Yuke Zhu

Robot learning has proven to be a general and effective technique for programming manipulators. Imitation learning is able to teach robots solely from human demonstrations but is bottlenecked by the capabilities of the demonstrations.…

Robotics · Computer Science 2024-10-24 Zihan Zhou , Animesh Garg , Dieter Fox , Caelan Garrett , Ajay Mandlekar

Imitation learning from human demonstrations is an effective paradigm for robot manipulation, but acquiring large datasets is costly and resource-intensive, especially for long-horizon tasks. To address this issue, we propose SkillMimicGen…

Robotics · Computer Science 2024-10-25 Caelan Garrett , Ajay Mandlekar , Bowen Wen , Dieter Fox

Imitating human demonstrations is a promising approach to endow robots with various manipulation capabilities. While recent advances have been made in imitation learning and batch (offline) reinforcement learning, a lack of open-source…

While imitation learning provides us with an efficient toolkit to train robots, learning skills that are robust to environment variations remains a significant challenge. Current approaches address this challenge by relying either on large…

Robotics · Computer Science 2023-03-03 Siddhant Haldar , Jyothish Pari , Anant Rai , Lerrel Pinto

Simulation is increasingly being used for generating large labelled datasets in many machine learning problems. Recent methods have focused on adjusting simulator parameters with the goal of maximising accuracy on a validation task, usually…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Harkirat Singh Behl , Atılım Güneş Baydin , Ran Gal , Philip H. S. Torr , Vibhav Vineet

We propose a demonstration-efficient strategy to compress a computationally expensive Model Predictive Controller (MPC) into a more computationally efficient representation based on a deep neural network and Imitation Learning (IL). By…

Robotics · Computer Science 2021-09-27 Andrea Tagliabue , Dong-Ki Kim , Michael Everett , Jonathan P. How

Imitation can allow us to quickly gain an understanding of a new task. Through a demonstration, we can gain direct knowledge about which actions need to be performed and which goals they have. In this paper, we introduce a new approach to…

Robotics · Computer Science 2024-06-04 Josua Spisak , Matthias Kerzel , Stefan Wermter

Imitation learning from human demonstrations is a promising paradigm for teaching robots manipulation skills in the real world. However, learning complex long-horizon tasks often requires an unattainable amount of demonstrations. To reduce…

Robotics · Computer Science 2023-10-16 Chen Wang , Linxi Fan , Jiankai Sun , Ruohan Zhang , Li Fei-Fei , Danfei Xu , Yuke Zhu , Anima Anandkumar

One of the key challenges in visual imitation learning is collecting large amounts of expert demonstrations for a given task. While methods for collecting human demonstrations are becoming easier with teleoperation methods and the use of…

Robotics · Computer Science 2021-07-20 Sarah Young , Jyothish Pari , Pieter Abbeel , Lerrel Pinto

Recent advances in unsupervised representation learning significantly improved the sample efficiency of training Reinforcement Learning policies in simulated environments. However, similar gains have not yet been seen for real-robot…

Robotics · Computer Science 2022-10-18 Albert Zhan , Ruihan Zhao , Lerrel Pinto , Pieter Abbeel , Michael Laskin

Optimizing behaviors for dexterous manipulation has been a longstanding challenge in robotics, with a variety of methods from model-based control to model-free reinforcement learning having been previously explored in literature. Perhaps…

Robotics · Computer Science 2022-03-25 Sridhar Pandian Arunachalam , Sneha Silwal , Ben Evans , Lerrel Pinto

Encouraged by the remarkable achievements of language and vision foundation models, developing generalist robotic agents through imitation learning, using large demonstration datasets, has become a prominent area of interest in robot…

Robotics · Computer Science 2024-04-12 Tongzhou Mu , Yijie Guo , Jie Xu , Ankit Goyal , Hao Su , Dieter Fox , Animesh Garg

Imitation learning often needs a large demonstration set in order to handle the full range of situations that an agent might find itself in during deployment. However, collecting expert demonstrations can be expensive. Recent work in…

Quality control of assembly processes is essential in manufacturing to ensure not only the quality of individual components but also their proper integration into the final product. To assist in this matter, automated assembly control using…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Jonas Werheid , Shengjie He , Aymen Gannouni , Anas Abdelrazeq , Robert H. Schmitt