English
Related papers

Related papers: DoShiCo Challenge: Domain Shift in Control Predict…

200 papers

Practitioners often rely on compute-intensive domain randomization to ensure reinforcement learning policies trained in simulation can robustly transfer to the real world. Due to unmodeled nonlinearities in the real system, however, even…

Machine Learning · Computer Science 2020-02-27 Gabriel I. Fernandez , Colin Togashi , Dennis W. Hong , Lin F. Yang

Deep reinforcement learning provides a promising approach for vision-based control of real-world robots. However, the generalization of such models depends critically on the quantity and variety of data available for training. This data can…

Machine Learning · Computer Science 2019-02-12 Katie Kang , Suneel Belkhale , Gregory Kahn , Pieter Abbeel , Sergey Levine

Training a deep network policy for robot manipulation is notoriously costly and time consuming as it depends on collecting a significant amount of real world data. To work well in the real world, the policy needs to see many instances of…

Robotics · Computer Science 2019-06-24 Xinchen Yan , Mohi Khansari , Jasmine Hsu , Yuanzheng Gong , Yunfei Bai , Sören Pirk , Honglak Lee

Deep networks devour millions of precisely annotated images to build their complex and powerful representations. Unfortunately, tasks like autonomous driving have virtually no real-world training data. Repeatedly crashing a car into a tree…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Brady Zhou , Nimit Kalra , Philipp Krähenbühl

Learning visuomotor policies in simulation is much safer and cheaper than in the real world. However, due to discrepancies between the simulated and real data, simulator-trained policies often fail when transferred to real robots. One…

Robotics · Computer Science 2023-07-31 Ricardo Garcia , Robin Strudel , Shizhe Chen , Etienne Arlaud , Ivan Laptev , Cordelia Schmid

Visual navigation tasks in real-world environments often require both self-motion and place recognition feedback. While deep reinforcement learning has shown success in solving these perception and decision-making problems in an end-to-end…

Robotics · Computer Science 2020-03-03 Marvin Chancán , Michael Milford

Deep Reinforcement Learning (RL) is mainly studied in a setting where the training and the testing environments are similar. But in many practical applications, these environments may differ. For instance, in control systems, the robot(s)…

Machine Learning · Computer Science 2022-10-25 Jean-Baptiste Gaya , Laure Soulier , Ludovic Denoyer

Dexterous manipulation is physics-intensive and highly sensitive to modeling errors and perception noise, making sim-to-real transfer prohibitively challenging. Domain randomization (DR) is commonly used to improve the robustness of learned…

Robotics · Computer Science 2026-05-12 Kejia Ren , Gaotian Wang , Andrew S. Morgan , Kaiyu Hang

We explore sim-to-real transfer of deep reinforcement learning controllers for a heavy vehicle with active suspensions designed for traversing rough terrain. While related research primarily focuses on lightweight robots with electric…

Sim-to-real transfer remains a major challenge in reinforcement learning (RL) for robotics, as policies trained in simulation often fail to generalize to the real world due to discrepancies in environment dynamics. Domain Randomization (DR)…

Robotics · Computer Science 2025-11-07 Marco Iannotta , Yuxuan Yang , Johannes A. Stork , Erik Schaffernicht , Todor Stoyanov

Behavior cloning has shown promise for robot manipulation, but real-world demonstrations are costly to acquire at scale. While simulated data offers a scalable alternative, particularly with advances in automated demonstration generation,…

Robotics · Computer Science 2026-01-19 Shuo Cheng , Liqian Ma , Zhenyang Chen , Ajay Mandlekar , Caelan Garrett , Danfei Xu

There has been an increasing interest in 3D indoor navigation, where a robot in an environment moves to a target according to an instruction. To deploy a robot for navigation in the physical world, lots of training data is required to learn…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Fengda Zhu , Linchao Zhu , Yi Yang

Real-world robotics problems often occur in domains that differ significantly from the robot's prior training environment. For many robotic control tasks, real world experience is expensive to obtain, but data is easy to collect in either…

Computer Vision and Pattern Recognition · Computer Science 2017-05-29 Eric Tzeng , Coline Devin , Judy Hoffman , Chelsea Finn , Pieter Abbeel , Sergey Levine , Kate Saenko , Trevor Darrell

Computer simulation provides an automatic and safe way for training robotic control policies to achieve complex tasks such as locomotion. However, a policy trained in simulation usually does not transfer directly to the real hardware due to…

Machine Learning · Computer Science 2018-12-05 Wenhao Yu , C. Karen Liu , Greg Turk

Transferring learning-based models to the real world remains one of the hardest problems in model-free control theory. Due to the cost of data collection on a real robot and the limited sample efficiency of Deep Reinforcement Learning…

Robotics · Computer Science 2020-05-01 Thomas Chaffre , Julien Moras , Adrien Chan-Hon-Tong , Julien Marzat

Studies that broaden drone applications into complex tasks require a stable control framework. Recently, deep reinforcement learning (RL) algorithms have been exploited in many studies for robot control to accomplish complex tasks.…

Deep Reinforcement Learning has proved to be able to solve many control tasks in different fields, but the behavior of these systems is not always as expected when deployed in real-world scenarios. This is mainly due to the lack of domain…

Robotics · Computer Science 2021-04-29 Alessandro Paolo Capasso , Giulio Bacchiani , Alberto Broggi

Learning control policies in simulation enables rapid, safe, and cost-effective development of advanced robotic capabilities. However, transferring these policies to the real world remains difficult due to the sim-to-real gap, where…

Robotics · Computer Science 2026-01-16 Jiahe Pan , Jiaxu Xing , Rudolf Reiter , Yifan Zhai , Elie Aljalbout , Davide Scaramuzza

Multi-robot navigation is a challenging task in which multiple robots must be coordinated simultaneously within dynamic environments. We apply deep reinforcement learning (DRL) to learn a decentralized end-to-end policy which maps raw…

Robotics · Computer Science 2022-09-08 Christian Jestel , Hartmut Surmann , Jonas Stenzel , Oliver Urbann , Marius Brehler

Deep reinforcement learning is an effective tool to learn robot control policies from scratch. However, these methods are notorious for the enormous amount of required training data which is prohibitively expensive to collect on real…

Machine Learning · Computer Science 2021-12-07 Julien Brosseit , Benedikt Hahner , Fabio Muratore , Michael Gienger , Jan Peters