English
Related papers

Related papers: Adapting control policies from simulation to reali…

200 papers

We consider the problem of transferring policies to the real world by training on a distribution of simulated scenarios. Rather than manually tuning the randomization of simulations, we adapt the simulation parameter distribution using a…

Robotics · Computer Science 2019-03-07 Yevgen Chebotar , Ankur Handa , Viktor Makoviychuk , Miles Macklin , Jan Issac , Nathan Ratliff , Dieter Fox

Learning to control robots directly based on images is a primary challenge in robotics. However, many existing reinforcement learning approaches require iteratively obtaining millions of robot samples to learn a policy, which can take…

Robotics · Computer Science 2019-08-02 AJ Piergiovanni , Alan Wu , Michael S. Ryoo

Reinforcement learning has emerged as a promising methodology for training robot controllers. However, most results have been limited to simulation due to the need for a large number of samples and the lack of automated-yet-safe data…

Robotics · Computer Science 2018-03-29 Kendall Lowrey , Svetoslav Kolev , Jeremy Dao , Aravind Rajeswaran , Emanuel Todorov

In robotics, gradient-free optimization algorithms (e.g. evolutionary algorithms) are often used only in simulation because they require the evaluation of many candidate solutions. Nevertheless, solutions obtained in simulation often do not…

Robotics · Computer Science 2013-07-09 Jean-Baptiste Mouret , Sylvain Koos , Stéphane Doncieux

Learning robot control policies from physics simulations is of great interest to the robotics community as it may render the learning process faster, cheaper, and safer by alleviating the need for expensive real-world experiments. However,…

Robotics · Computer Science 2021-06-22 Fabio Muratore , Michael Gienger , Jan Peters

Robotic cutting, or milling, plays a significant role in applications such as disassembly, decommissioning, and demolition. Planning and control of cutting in real-world scenarios in uncertain environments is a complex task, with the…

Robotics · Computer Science 2024-09-09 Jamie Hathaway , Rustam Stolkin , Alireza Rastegarpanah

Reinforcement learning (RL) can automate a wide variety of robotic skills, but learning each new skill requires considerable real-world data collection and manual representation engineering to design policy classes or features. Using deep…

Machine Learning · Computer Science 2016-09-23 Coline Devin , Abhishek Gupta , Trevor Darrell , Pieter Abbeel , Sergey Levine

Modern reinforcement learning methods suffer from low sample efficiency and unsafe exploration, making it infeasible to train robotic policies entirely on real hardware. In this work, we propose to address the problem of sim-to-real domain…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Karol Arndt , Murtaza Hazara , Ali Ghadirzadeh , Ville Kyrki

The rise of deep learning has caused a paradigm shift in robotics research, favoring methods that require large amounts of data. Unfortunately, it is prohibitively expensive to generate such data sets on a physical platform. Therefore,…

Robotics · Computer Science 2022-01-19 Fabio Muratore , Fabio Ramos , Greg Turk , Wenhao Yu , Michael Gienger , Jan Peters

Learning-based approaches to robotic manipulation are limited by the scalability of data collection and accessibility of labels. In this paper, we present a multi-task domain adaptation framework for instance grasping in cluttered scenes by…

Machine Learning · Computer Science 2018-03-06 Kuan Fang , Yunfei Bai , Stefan Hinterstoisser , Silvio Savarese , Mrinal Kalakrishnan

Despite recent progress in Reinforcement Learning for robotics applications, many tasks remain prohibitively difficult to solve because of the expensive interaction cost. Transfer learning helps reduce the training time in the target domain…

Robotics · Computer Science 2023-10-16 Yash Shukla , Bharat Kesari , Shivam Goel , Robert Wright , Jivko Sinapov

This paper focuses on transferring control policies between robot manipulators with different morphology. While reinforcement learning (RL) methods have shown successful results in robot manipulation tasks, transferring a trained policy…

Robotics · Computer Science 2024-06-05 Tianyu Wang , Dwait Bhatt , Xiaolong Wang , Nikolay Atanasov

Learning effective visuomotor policies for robots purely from data is challenging, but also appealing since a learning-based system should not require manual tuning or calibration. In the case of a robot operating in a real environment the…

Robotics · Computer Science 2018-10-12 Homanga Bharadhwaj , Zihan Wang , Yoshua Bengio , Liam Paull

Reinforcement learning often requires extensive training data. Simulation-to-real transfer offers a promising approach to address this challenge in robotics. While differentiable simulators offer improved sample efficiency through exact…

Robotics · Computer Science 2024-12-02 Severin Bochem , Eduardo Gonzalez-Sanchez , Yves Bicker , Gabriele Fadini

This paper focuses on the problem of detecting and reacting to changes in the distribution of a sensorimotor controller's observables. The key idea is the design of switching policies that can take conformal quantiles as input, which we…

Dexterous manipulation is physics-intensive and highly sensitive to modeling errors and perception noise, making sim-to-real transfer prohibitively challenging. Domain randomization (DR) is commonly used to improve the robustness of learned…

Robotics · Computer Science 2026-05-12 Kejia Ren , Gaotian Wang , Andrew S. Morgan , Kaiyu Hang

Domain randomization has emerged as a fundamental technique in reinforcement learning (RL) to facilitate the transfer of policies from simulation to real-world robotic applications. Many existing domain randomization approaches have been…

For a robot to learn a good policy, it often requires expensive equipment (such as sophisticated sensors) and a prepared training environment conducive to learning. However, it is seldom possible to perfectly equip robots for economic…

Artificial Intelligence · Computer Science 2019-07-19 Hélène Plisnier , Denis Steckelmacher , Diederik Roijers , Ann Nowé

Collecting training data from the physical world is usually time-consuming and even dangerous for fragile robots, and thus, recent advances in robot learning advocate the use of simulators as the training platform. Unfortunately, the…

Current vision-based robotics simulation benchmarks have significantly advanced robotic manipulation research. However, robotics is fundamentally a real-world problem, and evaluation for real-world applications has lagged behind in…

Robotics · Computer Science 2025-08-18 Xuning Yang , Clemens Eppner , Jonathan Tremblay , Dieter Fox , Stan Birchfield , Fabio Ramos