English
Related papers

Related papers: Deep Imitation Learning for Bimanual Robotic Manip…

200 papers

This work aims to learn how to perform complex robot manipulation tasks that are composed of several, consecutively executed low-level sub-tasks, given as input a few visual demonstrations of the tasks performed by a person. The sub-tasks…

Robotics · Computer Science 2022-03-09 Junchi Liang , Bowen Wen , Kostas Bekris , Abdeslam Boularias

The field of robotic manipulation has advanced significantly in recent years. At the sensing level, several novel tactile sensors have been developed, capable of providing accurate contact information. On a methodological level, learning…

Robotics · Computer Science 2026-04-21 Niklas Funk , Changqi Chen , Tim Schneider , Georgia Chalvatzaki , Roberto Calandra , Jan Peters

Deep imitation learning is promising for robot manipulation because it only requires demonstration samples. In this study, deep imitation learning is applied to tasks that require force feedback. However, existing demonstration methods have…

Robotics · Computer Science 2024-02-27 Heecheol Kim , Yoshiyuki Ohmura , Akihiko Nagakubo , Yasuo Kuniyoshi

We propose a model-free deep reinforcement learning method that leverages a small amount of demonstration data to assist a reinforcement learning agent. We apply this approach to robotic manipulation tasks and train end-to-end visuomotor…

Active localization is the problem of generating robot actions that allow it to maximally disambiguate its pose within a reference map. Traditional approaches to this use an information-theoretic criterion for action selection and…

Robotics · Computer Science 2019-03-06 Sai Krishna , Keehong Seo , Dhaivat Bhatt , Vincent Mai , Krishna Murthy , Liam Paull

Deep reinforcement learning enables algorithms to learn complex behavior, deal with continuous action spaces and find good strategies in environments with high dimensional state spaces. With deep reinforcement learning being an active area…

Machine Learning · Computer Science 2018-10-17 Winfried Lötzsch

Deep reinforcement learning (RL) has emerged as a promising approach for autonomously acquiring complex behaviors from low level sensor observations. Although a large portion of deep RL research has focused on applications in video games…

Robotics · Computer Science 2021-02-08 Julian Ibarz , Jie Tan , Chelsea Finn , Mrinal Kalakrishnan , Peter Pastor , Sergey Levine

In this paper, we study the problem of enabling a vision-based robotic manipulation system to generalize to novel tasks, a long-standing challenge in robot learning. We approach the challenge from an imitation learning perspective, aiming…

Grasping is a complex process involving knowledge of the object, the surroundings, and of oneself. While humans are able to integrate and process all of the sensory information required for performing this task, equipping machines with this…

Robotics · Computer Science 2017-01-12 Matthew Veres , Medhat Moussa , Graham W. Taylor

Deep learning has provided new ways of manipulating, processing and analyzing data. It sometimes may achieve results comparable to, or surpassing human expert performance, and has become a source of inspiration in the era of artificial…

We aim to enable robot to learn object manipulation by imitation. Given external observations of demonstrations on object manipulations, we believe that two underlying problems to address in learning by imitation is 1) segment a given…

Robotics · Computer Science 2017-11-21 Zhen Zeng , Benjamin Kuipers

Robots that can operate autonomously in a human living environment are necessary to have the ability to handle various tasks flexibly. One crucial element is coordinated bimanual movements that enable functions that are difficult to perform…

Robotics · Computer Science 2025-03-19 Tomohiro Motoda , Ryo Hanai , Ryoichi Nakajo , Masaki Murooka , Floris Erich , Yukiyasu Domae

We describe an ongoing project in learning to perform primitive actions from demonstrations using an interactive interface. In our previous work, we have used demonstrations captured from humans performing actions as training samples for a…

Robotics · Computer Science 2018-10-02 Tuan Do , Nikhil Krishnaswamy , Kyeongmin Rim , James Pustejovsky

Robotic manipulation in complex open-world scenarios requires both reliable physical manipulation skills and effective and generalizable perception. In this paper, we propose a method where general purpose pretrained visual models serve as…

Robotics · Computer Science 2017-09-27 Coline Devin , Pieter Abbeel , Trevor Darrell , Sergey Levine

Model-based reinforcement learning attempts to use an available or learned model to improve the data efficiency of reinforcement learning. This work proposes a one-step lookback approach that jointly learns the deep incremental model and…

Robotics · Computer Science 2025-02-28 Cong Li

Human-robot interaction benefits greatly from multimodal sensor inputs as they enable increased robustness and generalization accuracy. Despite this observation, few HRI methods are capable of efficiently performing inference for multimodal…

Robotics · Computer Science 2019-08-15 Joseph Campbell , Simon Stepputtis , Heni Ben Amor

Mapping the surrounding environment is essential for the successful operation of autonomous robots. While extensive research has focused on mapping geometric structures and static objects, the environment is also influenced by the movement…

Robotics · Computer Science 2023-09-04 Junyi Shi , Tomasz Piotr Kucner

We introduce a simple new method for visual imitation learning, which allows a novel robot manipulation task to be learned from a single human demonstration, without requiring any prior knowledge of the object being interacted with. Our…

Robotics · Computer Science 2021-06-11 Edward Johns

Imitation learning enables robots to learn and replicate human behavior from training data. Recent advances in machine learning enable end-to-end learning approaches that directly process high-dimensional observation data, such as images.…

Robotics · Computer Science 2024-01-22 Koki Yamane , Sho Sakaino , Toshiaki Tsuji

Deep imitation learning is promising for solving dexterous manipulation tasks because it does not require an environment model and pre-programmed robot behavior. However, its application to dual-arm manipulation tasks remains challenging.…

Robotics · Computer Science 2025-05-23 Heecheol Kim , Yoshiyuki Ohmura , Yasuo Kuniyoshi