English
Related papers

Related papers: Robust Visual Sim-to-Real Transfer for Robotic Man…

200 papers

Sim-to-real transfer is a fundamental challenge in robot reinforcement learning. Discrepancies between simulation and reality can significantly impair policy performance, especially if it receives high-dimensional inputs such as dense depth…

Robotics · Computer Science 2025-05-20 Hang Yu , Christophe De Wagter , Guido C. H. E de Croon

The industrial application of Deep Reinforcement Learning (DRL) is frequently slowed down because of the inability to generate the experience required to train the models. Collecting data often involves considerable time and economic effort…

Robotics · Computer Science 2025-01-27 Lucía Güitta-López , Jaime Boal , Álvaro J. López-López

Learning robotic manipulation policies directly in the real world can be expensive and time-consuming. While reinforcement learning (RL) policies trained in simulation present a scalable alternative, effective sim-to-real transfer remains…

Robotics · Computer Science 2026-03-09 Maggie Wang , Stephen Tian , Aiden Swann , Ola Shorinwa , Jiajun Wu , Mac Schwager

This paper proposes a novel alternative to existing sim-to-real methods for training control policies with simulated experiences. Prior sim-to-real methods for legged robots mostly rely on the domain randomization approach, where a fixed…

Robotics · Computer Science 2026-03-26 Junhyeok Rui Cha , Woohyun Cha , Jaeyong Shin , Donghyeon Kim , Jaeheung Park

In order to practically implement the door opening task, a policy ought to be robust to a wide distribution of door types and environment settings. Reinforcement Learning (RL) with Domain Randomization (DR) is a promising technique to…

Robotics · Computer Science 2022-05-25 Yusuke Urakami , Alec Hodgkinson , Casey Carlin , Randall Leu , Luca Rigazio , Pieter Abbeel

Sim-to-real transfer remains a significant challenge in robotics due to the discrepancies between simulated and real-world dynamics. Traditional methods like Domain Randomization often fail to capture fine-grained dynamics, limiting their…

Robotics · Computer Science 2025-03-04 Xilun Zhang , Shiqi Liu , Peide Huang , William Jongwon Han , Yiqi Lyu , Mengdi Xu , Ding Zhao

The sim-to-real gap remains a critical challenge in robotics, hindering the deployment of algorithms trained in simulation to real-world systems. This paper introduces a novel Real-Sim-Real (RSR) loop framework leveraging differentiable…

Robotics · Computer Science 2025-03-19 Lu Shi , Yuxuan Xu , Shiyu Wang , Jinhao Huang , Wenhao Zhao , Yufei Jia , Zike Yan , Weibin Gu , Guyue Zhou

End-to-end visual-based imitation learning has been widely applied in autonomous driving. When deploying the trained visual-based driving policy, a deterministic command is usually directly applied without considering the uncertainty of the…

Robotics · Computer Science 2019-07-19 Lei Tai , Peng Yun , Yuying Chen , Congcong Liu , Haoyang Ye , Ming Liu

Domain randomization (DR), which entails training a policy with randomized dynamics, has proven to be a simple yet effective algorithm for reducing the gap between simulation and the real world. However, DR often requires careful tuning of…

Robotic manipulation of cloth is a challenging task due to the high dimensionality of the configuration space and the complexity of dynamics affected by various material properties. The effect of complex dynamics is even more pronounced in…

Robotics · Computer Science 2023-02-09 Julius Hietala , David Blanco-Mulero , Gokhan Alcan , Ville Kyrki

Deep Reinforcement Learning (RL) has been explored and verified to be effective in solving decision-making tasks in various domains, such as robotics, transportation, recommender systems, etc. It learns from the interaction with…

Machine Learning · Computer Science 2025-03-11 Longchao Da , Justin Turnau , Thirulogasankar Pranav Kutralingam , Alvaro Velasquez , Paulo Shakarian , Hua Wei

Training vision-based manipulation policies that are robust across diverse visual environments remains an important and unresolved challenge in robot learning. Current approaches often sidestep the problem by relying on invariant…

Robotics · Computer Science 2025-05-20 Sumeet Batra , Gaurav Sukhatme

We propose a model-free deep reinforcement learning method that leverages a small amount of demonstration data to assist a reinforcement learning agent. We apply this approach to robotic manipulation tasks and train end-to-end visuomotor…

Learning-based approaches, particularly reinforcement learning (RL), have become widely used for developing control policies for autonomous agents, such as locomotion policies for legged robots. RL training typically maximizes a predefined…

Robotics · Computer Science 2025-04-23 Dylan Khor , Bowen Weng

Reinforcement learning (RL) can automate a wide variety of robotic skills, but learning each new skill requires considerable real-world data collection and manual representation engineering to design policy classes or features. Using deep…

Machine Learning · Computer Science 2016-09-23 Coline Devin , Abhishek Gupta , Trevor Darrell , Pieter Abbeel , Sergey Levine

Learned representations in deep reinforcement learning (DRL) have to extract task-relevant information from complex observations, balancing between robustness to distraction and informativeness to the policy. Such stable and rich…

Machine Learning · Computer Science 2021-10-28 Mete Kemertas , Tristan Aumentado-Armstrong

The advent of tactile sensors in robotics has sparked many ideas on how robots can leverage direct contact measurements of their environment interactions to improve manipulation tasks. An important line of research in this regard is that of…

Robotics · Computer Science 2023-11-14 Luca Lach , Robert Haschke , Davide Tateo , Jan Peters , Helge Ritter , Júlia Borràs , Carme Torras

Learning generalizable robot manipulation policies, especially for complex multi-fingered humanoids, remains a significant challenge. Existing approaches primarily rely on extensive data collection and imitation learning, which are…

Robotics · Computer Science 2025-09-03 Toru Lin , Kartik Sachdev , Linxi Fan , Jitendra Malik , Yuke Zhu

Deep reinforcement learning (RL) has made it possible to solve complex robotics problems using neural networks as function approximators. However, the policies trained on stationary environments suffer in terms of generalization when…

Robotics · Computer Science 2021-11-09 Aditya M. Deshpande , Ali A. Minai , Manish Kumar

Domain randomization is a simple, effective, and flexible scheme for obtaining robust feedback policies aimed at reducing the sim-to-real gap due to model mismatch. While domain randomization methods have yielded impressive demonstrations…

Systems and Control · Electrical Eng. & Systems 2026-03-17 Alex Nguyen-Le , Nikolai Matni