English
Related papers

Related papers: Teaching contact-rich tasks from visual demonstrat…

200 papers

Learning to manipulate objects efficiently, particularly those involving sustained contact (e.g., pushing, sliding) and articulated parts (e.g., drawers, doors), presents significant challenges. Traditional methods, such as robot-centric…

Robotics · Computer Science 2025-03-18 Shijie Fang , Wenchang Gao , Shivam Goel , Christopher Thierauf , Matthias Scheutz , Jivko Sinapov

Dexterous manipulation of objects through fine control of physical contacts is essential for many important tasks of daily living. A fundamental ability underlying fine contact control is compliant control, \textit{i.e.}, controlling the…

Robotics · Computer Science 2023-05-30 Jinda Cui , Jiawei Xu , David Saldaña , Jeff Trinkle

Learning from demonstrations is a promising paradigm for transferring knowledge to robots. However, learning mobile manipulation tasks directly from a human teacher is a complex problem as it requires learning models of both the overall…

Robotics · Computer Science 2019-08-28 Tim Welschehold , Nichola Abdo , Christian Dornhege , Wolfram Burgard

Everyday contact-rich tasks, such as peeling, cleaning, and writing, demand multimodal perception for effective and precise task execution. However, these present a novel challenge to robots as they lack the ability to combine these…

Robotics · Computer Science 2024-10-28 Mythra V. Balakuntala , Upinder Kaur , Xin Ma , Juan Wachs , Richard M. Voyles

Non-prehensile manipulation is challenging due to complex contact interactions between objects, the environment, and robots. Model-based approaches can efficiently generate complex trajectories of robots and objects under contact…

Robotics · Computer Science 2025-08-07 Yuki Shirai , Kei Ota , Devesh K. Jha , Diego Romeres

Compliant robot behavior is crucial for the realization of contact-rich manipulation tasks. In such tasks, it is important to ensure a high stiffness and force tracking accuracy during normal task execution as well as rapid adaptation and…

Robotics · Computer Science 2020-05-04 Jianfeng Gao , You Zhou , Tamim Asfour

General robot manipulation requires the handling of previously unseen objects. Learning a physically accurate model at test time can provide significant benefits in data efficiency, predictability, and reuse between tasks. Tactile sensing…

Robotics · Computer Science 2026-02-26 Ethan K. Gordon , Bruke Baraki , Hien Bui , Michael Posa

Constrained objects, such as doors and drawers are often complex and share a similar structure in the human environment. A robot needs to interact accurately with constrained objects to safely and successfully complete a task. Learning from…

Robotics · Computer Science 2021-03-18 Xiang Zhang , Matteo Saveriano , Justus Piater

Reinforcement learning shows great potential to solve complex contact-rich robot manipulation tasks. However, the safety of using RL in the real world is a crucial problem, since unexpected dangerous collisions might happen when the RL…

Robotics · Computer Science 2025-05-27 Xiang Zhu , Shucheng Kang , Jianyu Chen

Learning contact-rich manipulation skills is essential. Such skills require the robots to interact with the environment with feasible manipulation trajectories and suitable compliance control parameters to enable safe and stable contact.…

Robotics · Computer Science 2023-10-17 Xiang Zhang , Changhao Wang , Lingfeng Sun , Zheng Wu , Xinghao Zhu , Masayoshi Tomizuka

Contact-rich manipulation tasks are commonly found in modern manufacturing settings. However, manually designing a robot controller is considered hard for traditional control methods as the controller requires an effective combination of…

Robotics · Computer Science 2020-10-27 Yunlei Shi , Zhaopeng Chen , Hongxu Liu , Sebastian Riedel , Chunhui Gao , Qian Feng , Jun Deng , Jianwei Zhang

Contact-rich manipulation plays an important role in human daily activities, but uncertain parameters pose significant challenges for robots to achieve comparable performance through planning and control. To address this issue, domain…

Robotics · Computer Science 2024-10-16 Teng Xue , Amirreza Razmjoo , Suhan Shetty , Sylvain Calinon

Autonomous learning of object manipulation skills can enable robots to acquire rich behavioral repertoires that scale to the variety of objects found in the real world. However, current motion skill learning methods typically restrict the…

Robotics · Computer Science 2015-02-27 Sergey Levine , Nolan Wagener , Pieter Abbeel

In this letter, we investigate learning forward dynamics models and multi-step prediction of state variables (long-term prediction) for contact-rich manipulation. The problems are formulated in the context of model-based reinforcement…

Robotics · Computer Science 2020-09-29 Shahbaz Abdul Khader , Hang Yin , Pietro Falco , Danica Kragic

Contact-rich manipulation demands human-like integration of perception and force feedback: vision should guide task progress, while high-frequency interaction control must stabilize contact under uncertainty. Existing learning-based…

Contact-rich manipulation is difficult for robots to execute and requires accurate perception of the environment. In some scenarios, vision is occluded. The robot can then no longer obtain real-time scene state information through visual…

Robotics · Computer Science 2026-01-27 Gaozhao Wang , Xing Liu , Zhenduo Ye , Zhengxiong Liu , Panfeng Huang

Robots need to manipulate objects in constrained environments like shelves and cabinets when assisting humans in everyday settings like homes and offices. These constraints make manipulation difficult by reducing grasp accessibility, so…

Robotics · Computer Science 2022-11-01 Jacky Liang , Xianyi Cheng , Oliver Kroemer

Learning from Demonstration is increasingly used for transferring operator manipulation skills to robots. In practice, it is important to cater for limited data and imperfect human demonstrations, as well as underlying safety constraints.…

Robotics · Computer Science 2020-04-03 Ya-Yen Tsai , Bo Xiao , Edward Johns , Guang-Zhong Yang

Contact force in contact-rich environments is an essential modality for robots to perform general-purpose manipulation tasks, as it provides information to compensate for the deficiencies of visual and proprioceptive data in collision…

Robotics · Computer Science 2024-11-13 Bo Zhou , Ruixuan Jiao , Yi Li , Xiaogang Yuan , Fang Fang , Shihua Li

Non-prehensile manipulation such as pushing is typically subject to uncertain, non-smooth dynamics. However, modeling the uncertainty of the dynamics typically results in intractable belief dynamics, making data-efficient planning under…

Robotics · Computer Science 2024-06-28 Julius Jankowski , Lara Brudermüller , Nick Hawes , Sylvain Calinon