English
Related papers

Related papers: Learning Dense Rewards for Contact-Rich Manipulati…

200 papers

Reward shaping is one of the most effective methods to tackle the crucial yet challenging problem of credit assignment in Reinforcement Learning (RL). However, designing shaping functions usually requires much expert knowledge and…

Machine Learning · Computer Science 2019-01-29 Haosheng Zou , Tongzheng Ren , Dong Yan , Hang Su , Jun Zhu

We present a deep learning method for composite and task-driven motion control for physically simulated characters. In contrast to existing data-driven approaches using reinforcement learning that imitate full-body motions, we learn…

Graphics · Computer Science 2023-05-08 Pei Xu , Xiumin Shang , Victor Zordan , Ioannis Karamouzas

Reinforcement learning (RL) has been widely used in text generation to alleviate the exposure bias issue or to utilize non-parallel datasets. The reward function plays an important role in making RL training successful. However, previous…

Machine Learning · Computer Science 2023-01-19 Yongchang Hao , Yuxin Liu , Lili Mou

Teaching robots novel skills with demonstrations via human-in-the-loop data collection techniques like kinesthetic teaching or teleoperation puts a heavy burden on human supervisors. In contrast to this paradigm, it is often significantly…

Robotics · Computer Science 2024-04-24 Daniel Yang , Davin Tjia , Jacob Berg , Dima Damen , Pulkit Agrawal , Abhishek Gupta

In this letter, we investigate learning forward dynamics models and multi-step prediction of state variables (long-term prediction) for contact-rich manipulation. The problems are formulated in the context of model-based reinforcement…

Robotics · Computer Science 2020-09-29 Shahbaz Abdul Khader , Hang Yin , Pietro Falco , Danica Kragic

Reward shaping is an effective technique for incorporating domain knowledge into reinforcement learning (RL). Existing approaches such as potential-based reward shaping normally make full use of a given shaping reward function. However,…

Machine Learning · Computer Science 2020-11-06 Yujing Hu , Weixun Wang , Hangtian Jia , Yixiang Wang , Yingfeng Chen , Jianye Hao , Feng Wu , Changjie Fan

When a person is not satisfied with how a robot performs a task, they can intervene to correct it. Reward learning methods enable the robot to adapt its reward function online based on such human input, but they rely on handcrafted…

Robotics · Computer Science 2021-01-13 Andreea Bobu , Marius Wiggert , Claire Tomlin , Anca D. Dragan

Reinforcement learning provides a powerful and general framework for decision making and control, but its application in practice is often hindered by the need for extensive feature and reward engineering. Deep reinforcement learning…

Machine Learning · Computer Science 2018-08-15 Justin Fu , Katie Luo , Sergey Levine

In the last decade, Deep Reinforcement Learning has evolved into a powerful tool for complex sequential decision-making problems. It combines deep learning's proficiency in processing rich input signals with reinforcement learning's…

Machine Learning · Computer Science 2024-12-11 Julien Roy

Dexterous manipulation requires careful reasoning over extrinsic contacts. The prevalence of deforming tools in human environments, the use of deformable sensors, and the increasing number of soft robots yields a need for approaches that…

Robotics · Computer Science 2025-05-19 Mark Van der Merwe , Miquel Oller , Dmitry Berenson , Nima Fazeli

Contact-rich manipulation plays an important role in human daily activities, but uncertain parameters pose significant challenges for robots to achieve comparable performance through planning and control. To address this issue, domain…

Robotics · Computer Science 2024-10-16 Teng Xue , Amirreza Razmjoo , Suhan Shetty , Sylvain Calinon

Deep Reinforcement Learning has shown significant progress in extracting useful representations from high-dimensional inputs albeit using hand-crafted auxiliary tasks and pseudo rewards. Automatically learning such representations in an…

Machine Learning · Computer Science 2023-06-28 Somjit Nath , Gopeshh Raaj Subbaraj , Khimya Khetarpal , Samira Ebrahimi Kahou

Contact-rich manipulation involves kinematic constraints on the task motion, typically with discrete transitions between these constraints during the task. Allowing the robot to detect and reason about these contact constraints can support…

Robotics · Computer Science 2023-04-05 Christian Hegeler , Filippo Rozzi , Loris Roveda , Kevin Haninger

Intelligent agents must be able to think fast and slow to perform elaborate manipulation tasks. Reinforcement Learning (RL) has led to many promising results on a range of challenging decision-making tasks. However, in real-world robotics,…

Robotics · Computer Science 2021-10-22 Maximilian Ulmer , Elie Aljalbout , Sascha Schwarz , Sami Haddadin

As people learn to navigate the world, autonomic nervous system (e.g., "fight or flight") responses provide intrinsic feedback about the potential consequence of action choices (e.g., becoming nervous when close to a cliff edge or driving…

Artificial Intelligence · Computer Science 2019-03-25 Daniel McDuff , Ashish Kapoor

Pushing objects through cluttered scenes is a challenging task, especially when the objects to be pushed have initially unknown dynamics and touching other entities has to be avoided to reduce the risk of damage. In this paper, we approach…

Robotics · Computer Science 2022-07-18 Nils Dengler , David Großklaus , Maren Bennewitz

Reinforcement learning (RL), particularly in sparse reward settings, often requires prohibitively large numbers of interactions with the environment, thereby limiting its applicability to complex problems. To address this, several prior…

Machine Learning · Computer Science 2020-11-20 Prasoon Goyal , Scott Niekum , Raymond J. Mooney

Deep reinforcement learning in partially observable environments is a difficult task in itself, and can be further complicated by a sparse reward signal. Most tasks involving navigation in three-dimensional environments provide the agent…

Machine Learning · Computer Science 2023-10-17 Matvey Gerasyov , Ilya Makarov

Object handover is an important skill that we use daily when interacting with other humans. To deploy robots in collaborative setting, like houses, being able to receive and handing over objects safely and efficiently becomes a crucial…

Robotics · Computer Science 2025-06-23 Daniel Frau-Alfaro , Julio Castaño-Amoros , Santiago Puente , Pablo Gil , Roberto Calandra

Safety is a crucial property of every robotic platform: any control policy should always comply with actuator limits and avoid collisions with the environment and humans. In reinforcement learning, safety is even more fundamental for…

Robotics · Computer Science 2023-03-02 Puze Liu , Kuo Zhang , Davide Tateo , Snehal Jauhri , Zhiyuan Hu , Jan Peters , Georgia Chalvatzaki