English
Related papers

Related papers: SKIL: Semantic Keypoint Imitation Learning for Gen…

200 papers

In-context imitation learning allows robots to acquire skills from demonstrations, yet one-shot trajectory generation remains fragile under environmental variation. We propose SAIL, a framework that reframes robot imitation as an iterative…

Robotics · Computer Science 2026-03-10 Makoto Sato , Yusuke Iwasawa , Yujin Tang , So Kuroki

Acquiring physically plausible motor skills across diverse and unconventional morphologies-including humanoid robots, quadrupeds, and animals-is essential for advancing character simulation and robotics. Traditional methods, such as…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Mert Albaba , Chenhao Li , Markos Diomataris , Omid Taheri , Andreas Krause , Michael Black

How can we imbue robots with the ability to manipulate objects precisely but also to reason about them in terms of abstract concepts? Recent works in manipulation have shown that end-to-end networks can learn dexterous skills that require…

Robotics · Computer Science 2021-09-27 Mohit Shridhar , Lucas Manuelli , Dieter Fox

Surgical robot task automation has recently attracted great attention due to its potential to benefit both surgeons and patients. Reinforcement learning (RL) based approaches have demonstrated promising ability to provide solutions to…

Robotics · Computer Science 2024-09-12 Jingshuai Liu , Alain Andres , Yonghang Jiang , Xichun Luo , Wenmiao Shu , Sotirios A. Tsaftaris

Imitation learning is a popular method for teaching robots new behaviors. However, most existing methods focus on teaching short, isolated skills rather than long, multi-step tasks. To bridge this gap, imitation learning algorithms must not…

Artificial Intelligence · Computer Science 2025-11-04 Leon Keller , Daniel Tanneberg , Jan Peters

Learning to solve complex manipulation tasks from visual observations is a dominant challenge for real-world robot learning. Although deep reinforcement learning algorithms have recently demonstrated impressive results in this context, they…

Robotics · Computer Science 2022-01-20 Eugenio Chisari , Tim Welschehold , Joschka Boedecker , Wolfram Burgard , Abhinav Valada

Compared to traditional imitation learning methods such as DAgger and DART, intervention-based imitation offers a more convenient and sample efficient data collection process to users. In this paper, we introduce Reinforced…

Robotics · Computer Science 2022-03-30 Rom Parnichkun , Matthew N. Dailey , Atsushi Yamashita

Interactive Imitation Learning (IIL) typically relies on extensive human involvement for both offline demonstration and online interaction. Prior work primarily focuses on reducing human effort in passive monitoring rather than active…

Robotics · Computer Science 2026-03-16 Chengjie Zhang , Chao Tang , Wenlong Dong , Dehao Huang , Aoxiang Gu , Hong Zhang

One of the biggest challenges that complicates applied supervised machine learning is the need for huge amounts of labeled data. Active Learning (AL) is a well-known standard method for efficiently obtaining labeled data by first labeling…

Machine Learning · Computer Science 2021-08-18 Julius Gonsior , Maik Thiele , Wolfgang Lehner

A novel skill learning approach is proposed that allows a robot to acquire human-like visuospatial skills for object manipulation tasks. Visuospatial skills are attained by observing spatial relationships among objects through…

Robotics · Computer Science 2017-06-06 S. Reza Ahmadzadeh , Fulvio Mastrogiovanni , Petar Kormushev

Previous imitation learning policies predict future actions at every control step, whether in smooth motion phases or precise, contact-rich operation phases. This uniform treatment is wasteful: most steps in a manipulation trajectory…

Robotics · Computer Science 2026-05-18 Mingtong Dai , Guanqi Peng , Yongjie Bai , Feng Yan , Chunjie Chen , Lingbo Liu , Liang Lin , Xinyu Wu

Imitation learning from human demonstrations is an effective paradigm for robot manipulation, but acquiring large datasets is costly and resource-intensive, especially for long-horizon tasks. To address this issue, we propose SkillMimicGen…

Robotics · Computer Science 2024-10-25 Caelan Garrett , Ajay Mandlekar , Bowen Wen , Dieter Fox

When faced with accomplishing a task, human experts exhibit intentional behavior. Their unique intents shape their plans and decisions, resulting in experts demonstrating diverse behaviors to accomplish the same task. Due to the…

Machine Learning · Computer Science 2024-04-29 Sangwon Seo , Vaibhav Unhelkar

Adversarial Imitation Learning (AIL) is a broad family of imitation learning methods designed to mimic expert behaviors from demonstrations. While AIL has shown state-of-the-art performance on imitation learning with only small number of…

Machine Learning · Computer Science 2020-02-21 Ruohan Wang , Carlo Ciliberto , Pierluigi Amadori , Yiannis Demiris

Imitation learning (IL) algorithms have shown promising results for robots to learn skills from expert demonstrations. However, they need multi-task demonstrations to be provided at once for acquiring diverse skills, which is difficult in…

Robotics · Computer Science 2021-10-19 Chongkai Gao , Haichuan Gao , Shangqi Guo , Tianren Zhang , Feng Chen

Imitation learning has achieved great success in many sequential decision-making tasks, in which a neural agent is learned by imitating collected human demonstrations. However, existing algorithms typically require a large number of…

Machine Learning · Computer Science 2023-06-14 Tianxiang Zhao , Wenchao Yu , Suhang Wang , Lu Wang , Xiang Zhang , Yuncong Chen , Yanchi Liu , Wei Cheng , Haifeng Chen

Robotic skills can be learned via imitation learning (IL) using user-provided demonstrations, or via reinforcement learning (RL) using large amountsof autonomously collected experience.Both methods have complementarystrengths and…

Recent works in robotic manipulation through reinforcement learning (RL) or imitation learning (IL) have shown potential for tackling a range of tasks e.g., opening a drawer or a cupboard. However, these techniques generalize poorly to…

Robotics · Computer Science 2023-03-10 Kai Lu , Bo Yang , Bing Wang , Andrew Markham

Assistive robots should be able to wash, fold or iron clothes. However, due to the variety, deformability and self-occlusions of clothes, creating robot systems for cloth manipulation is challenging. Synthetic data is a promising direction…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Thomas Lips , Victor-Louis De Gusseme , Francis wyffels

High-quality and representative data is essential for both Imitation Learning (IL)- and Reinforcement Learning (RL)-based motion planning tasks. For real robots, it is challenging to collect enough qualified data either as demonstrations…

Robotics · Computer Science 2023-06-13 Sha Luo , Lambert Schomaker