English
Related papers

Related papers: Robust Contact-rich Manipulation through Implicit …

200 papers

Rewards play a crucial role in reinforcement learning. To arrive at the desired policy, the design of a suitable reward function often requires significant domain expertise as well as trial-and-error. Here, we aim to minimize the effort…

Robotics · Computer Science 2020-11-18 Zheng Wu , Wenzhao Lian , Vaibhav Unhelkar , Masayoshi Tomizuka , Stefan Schaal

The empirical success of Reinforcement Learning (RL) in the setting of contact-rich manipulation leaves much to be understood from a model-based perspective, where the key difficulties are often attributed to (i) the explosion of contact…

Robotics · Computer Science 2023-03-01 Tao Pang , H. J. Terry Suh , Lujie Yang , Russ Tedrake

Successfully addressing a wide variety of tasks is a core ability of autonomous agents, requiring flexibly adapting the underlying decision-making strategies and, as we argue in this work, also adapting the perception modules. An analogical…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Pierre Marza , Laetitia Matignon , Olivier Simonin , Christian Wolf

Compliance plays a crucial role in manipulation, as it balances between the concurrent control of position and force under uncertainties. Yet compliance is often overlooked by today's visuomotor policies that solely focus on position…

The ability to reason about and predict the outcome of contacts is paramount to the successful execution of many robot tasks. Analytical rigid-body contact models are used extensively in planning and control due to their computational…

Robotics · Computer Science 2017-11-06 Nima Fazeli , Samuel Zapolsky , Evan Drumwright , Alberto Rodriguez

This paper comprehensively surveys research trends in imitation learning for contact-rich robotic tasks. Contact-rich tasks, which require complex physical interactions with the environment, represent a central challenge in robotics due to…

Robotics · Computer Science 2025-06-17 Toshiaki Tsuji , Yasuhiro Kato , Gokhan Solak , Heng Zhang , Tadej Petrič , Francesco Nori , Arash Ajoudani

Contact-rich manipulation depends on applying the correct grasp forces throughout the manipulation task, especially when handling fragile or deformable objects. Most existing imitation learning approaches often treat visuotactile feedback…

Robotics · Computer Science 2025-10-16 Erik Helmut , Niklas Funk , Tim Schneider , Cristiana de Farias , Jan Peters

Contact-rich manipulation tasks are commonly found in modern manufacturing settings. However, manually designing a robot controller is considered hard for traditional control methods as the controller requires an effective combination of…

Robotics · Computer Science 2020-10-27 Yunlei Shi , Zhaopeng Chen , Hongxu Liu , Sebastian Riedel , Chunhui Gao , Qian Feng , Jun Deng , Jianwei Zhang

Sampling-based motion planners have experienced much success due to their ability to efficiently and evenly explore the state space. However, for many tasks, it may be more efficient to not uniformly explore the state space, especially when…

Robotics · Computer Science 2018-06-07 Clark Zhang , Jinwook Huh , Daniel D. Lee

This paper proposes a simulation-based reinforcement learning algorithm for controlling systems with uncertain and varying system parameters. While simulators are useful for safely learning control policies, the reality gap remains a major…

Systems and Control · Electrical Eng. & Systems 2026-05-14 Junya Ikemoto

Generalist robot policies, trained on large and diverse datasets, have demonstrated the ability to generalize across a wide spectrum of behaviors, enabling a single policy to act in varied real-world environments. However, they still fall…

Robotics · Computer Science 2026-03-03 Yajat Yadav , Zhiyuan Zhou , Andrew Wagenmaker , Karl Pertsch , Sergey Levine

Contact-rich manipulation involves kinematic constraints on the task motion, typically with discrete transitions between these constraints during the task. Allowing the robot to detect and reason about these contact constraints can support…

Robotics · Computer Science 2023-04-05 Christian Hegeler , Filippo Rozzi , Loris Roveda , Kevin Haninger

Reinforcement Learning methods are capable of solving complex problems, but resulting policies might perform poorly in environments that are even slightly different. In robotics especially, training and deployment conditions often vary and…

Machine Learning · Computer Science 2018-09-17 Isac Arnekvist , Danica Kragic , Johannes A. Stork

Autonomous learning of object manipulation skills can enable robots to acquire rich behavioral repertoires that scale to the variety of objects found in the real world. However, current motion skill learning methods typically restrict the…

Robotics · Computer Science 2015-02-27 Sergey Levine , Nolan Wagener , Pieter Abbeel

The successful operation of mobile robots requires them to adapt rapidly to environmental changes. To develop an adaptive decision-making tool for mobile robots, we propose a novel algorithm that combines meta-reinforcement learning…

Robotics · Computer Science 2022-07-21 Jaeuk Shin , Astghik Hakobyan , Mingyu Park , Yeoneung Kim , Gihun Kim , Insoon Yang

A reinforcement learning (RL) policy trained in a nominal environment could fail in a new/perturbed environment due to the existence of dynamic variations. Existing robust methods try to obtain a fixed policy for all envisioned dynamic…

Machine Learning · Computer Science 2022-03-10 Yikun Cheng , Pan Zhao , Manan Gandhi , Bo Li , Evangelos Theodorou , Naira Hovakimyan

We present a deep learning method for composite and task-driven motion control for physically simulated characters. In contrast to existing data-driven approaches using reinforcement learning that imitate full-body motions, we learn…

Graphics · Computer Science 2023-05-08 Pei Xu , Xiumin Shang , Victor Zordan , Ioannis Karamouzas

It is doubtful that animals have perfect inverse models of their limbs (e.g., what muscle contraction must be applied to every joint to reach a particular location in space). However, in robot control, moving an arm's end-effector to a…

Robotics · Computer Science 2022-09-19 Justus Huebotter , Serge Thill , Marcel van Gerven , Pablo Lanillos

Reinforcement learning has emerged as a promising methodology for training robot controllers. However, most results have been limited to simulation due to the need for a large number of samples and the lack of automated-yet-safe data…

Robotics · Computer Science 2018-03-29 Kendall Lowrey , Svetoslav Kolev , Jeremy Dao , Aravind Rajeswaran , Emanuel Todorov

Pre-trained generalist policies are rapidly gaining relevance in robot learning due to their promise of fast adaptation to novel, in-domain tasks. This adaptation often relies on collecting new demonstrations for a specific task of interest…

Machine Learning · Computer Science 2025-06-24 Marco Bagatella , Jonas Hübotter , Georg Martius , Andreas Krause