English
Related papers

Related papers: Transferable Force-Torque Dynamics Model for Peg-i…

200 papers

Reinforcement Learning methods are capable of solving complex problems, but resulting policies might perform poorly in environments that are even slightly different. In robotics especially, training and deployment conditions often vary and…

Machine Learning · Computer Science 2018-09-17 Isac Arnekvist , Danica Kragic , Johannes A. Stork

Legged robots have enormous potential in their range of capabilities, from navigating unstructured terrains to high-speed running. However, designing robust controllers for highly agile dynamic motions remains a substantial challenge for…

Robotics · Computer Science 2023-04-20 Laura Smith , J. Chase Kew , Tianyu Li , Linda Luu , Xue Bin Peng , Sehoon Ha , Jie Tan , Sergey Levine

Designing reinforcement learning (RL) problems that can produce delicate and precise manipulation policies requires careful choice of the reward function, state, and action spaces. Much prior work on applying RL to manipulation tasks has…

Robotics · Computer Science 2019-08-26 Patrick Varin , Lev Grossman , Scott Kuindersma

Robotic manipulation is essential for modernizing factories and automating industrial tasks like polishing, which require advanced tactile abilities. These robots must be easily set up, safely work with humans, learn tasks autonomously, and…

Robotics · Computer Science 2024-08-26 Anran Zhang , Kübra Karacan , Hamid Sadeghian , Yansong Wu , Fan Wu , Sami Haddadin

In the peg insertion task, human pays attention to the seam between the peg and the hole and tries to fill it continuously with visual feedback. By imitating the human behavior, we design architectures with position and orientation…

Robotics · Computer Science 2022-04-21 Liang Xie , Hongxiang Yu , Yinghao Zhao , Haodong Zhang , Zhongxiang Zhou , Minhang Wang , Yue Wang , Rong Xiong

Sim-to-real transfer for contact-rich manipulation remains challenging due to the inherent discrepancy in contact dynamics. While existing methods often rely on costly real-world data or utilize blind compliance through fixed controllers,…

Robotics · Computer Science 2026-02-17 Yifei Yang , Anzhe Chen , Zhenjie Zhu , Kechun Xu , Yunxuan Mao , Yufei Wei , Lu Chen , Rong Xiong , Yue Wang

While classic control theory offers state of the art solutions in many problem scenarios, it is often desired to improve beyond the structure of such solutions and surpass their limitations. To this end, residual policy learning (RPL)…

Robotics · Computer Science 2021-08-09 Alireza Ranjbar , Ngo Anh Vien , Hanna Ziesche , Joschka Boedecker , Gerhard Neumann

Generating dynamic motions for legged robots remains a challenging problem. While reinforcement learning has achieved notable success in various legged locomotion tasks, producing highly dynamic behaviors often requires extensive reward…

Robotics · Computer Science 2026-01-01 Dongyun Kang , Min-Gyu Kim , Tae-Gyu Song , Hajun Kim , Sehoon Ha , Hae-Won Park

This paper presents, for the first time, a method for learning in-contact tasks from a teleoperated demonstration with a hydraulic manipulator. Due to the use of extremely powerful hydraulic manipulator, a force-reflected bilateral…

Robotics · Computer Science 2018-09-05 Markku Suomalainen , Janne Koivumäki , Santeri Lampinen , Ville Kyrki , Jouni Mattila

Model-based reinforcement learning attempts to use an available or learned model to improve the data efficiency of reinforcement learning. This work proposes a one-step lookback approach that jointly learns the deep incremental model and…

Robotics · Computer Science 2025-02-28 Cong Li

Much like humans, robots should have the ability to leverage knowledge from previously learned tasks in order to learn new tasks quickly in new and unfamiliar environments. Despite this, most robot learning approaches have focused on…

Robotics · Computer Science 2018-10-09 Stephen James , Michael Bloesch , Andrew J. Davison

In this paper, we review the question of which action space is best suited for controlling a real biped robot in combination with Sim2Real training. Position control has been popular as it has been shown to be more sample efficient and…

Robotics · Computer Science 2023-09-01 Donghyeon Kim , Glen Berseth , Mathew Schwartz , Jaeheung Park

Sample-efficient generalisation of reinforcement learning approaches have always been a challenge, especially, for complex scenes with many components. In this work, we introduce Plug and Play Markov Decision Processes, an object-based…

Machine Learning · Computer Science 2021-08-23 Majid Abdolshah , Hung Le , Thommen Karimpanal George , Sunil Gupta , Santu Rana , Svetha Venkatesh

This article reviews contemporary methods for integrating force, including both proprioception and tactile sensing, in robot manipulation policy learning. We conduct a comparative analysis on various approaches for sensing force, data…

Robotics · Computer Science 2025-04-17 William Xie , Nikolaus Correll

We investigate an experiential learning paradigm for acquiring an internal model of intuitive physics. Our model is evaluated on a real-world robotic manipulation task that requires displacing objects to target locations by poking. The…

Computer Vision and Pattern Recognition · Computer Science 2017-02-17 Pulkit Agrawal , Ashvin Nair , Pieter Abbeel , Jitendra Malik , Sergey Levine

Learning-based control methods typically assume stationary system dynamics, an assumption often violated in real-world systems due to drift, wear, or changing operating conditions. We study reinforcement learning for control under…

Machine Learning · Computer Science 2026-04-03 Klemens Iten , Bruce Lee , Chenhao Li , Lenart Treven , Andreas Krause , Bhavya Sukhija

It is well-known that inverse dynamics models can improve tracking performance in robot control. These models need to precisely capture the robot dynamics, which consist of well-understood components, e.g., rigid body dynamics, and effects…

Robotics · Computer Science 2022-05-30 Moritz Reuss , Niels van Duijkeren , Robert Krug , Philipp Becker , Vaisakh Shaj , Gerhard Neumann

Modelling of contact-rich tasks is challenging and cannot be entirely solved using classical control approaches due to the difficulty of constructing an analytic description of the contact dynamics. Additionally, in a manipulation task like…

Robotics · Computer Science 2019-09-27 Ioanna Mitsioni , Yiannis Karayiannidis , Johannes A. Stork , Danica Kragic

Precise object manipulation and placement is a common problem for household robots, surgery robots, and robots working on in-situ construction. Prior work using computer vision, depth sensors, and reinforcement learning lacks the ability to…

Robotics · Computer Science 2024-04-30 Osher Lerner , Zachary Tam , Michael Equi

Learning-based methods have improved locomotion skills of quadruped robots through deep reinforcement learning. However, the sim-to-real gap and low sample efficiency still limit the skill transfer. To address this issue, we propose an…

Robotics · Computer Science 2024-03-19 Haojie Shi , Tingguang Li , Qingxu Zhu , Jiapeng Sheng , Lei Han , Max Q. -H. Meng