English
Related papers

Related papers: Assessing Transferability from Simulation to Reali…

200 papers

We present a novel solution to the problem of simulation-to-real transfer, which builds on recent advances in robot skill decomposition. Rather than focusing on minimizing the simulation-reality gap, we learn a set of diverse policies that…

Machine Learning · Computer Science 2018-11-15 Ryan Julian , Eric Heiden , Zhanpeng He , Hejia Zhang , Stefan Schaal , Joseph J. Lim , Gaurav Sukhatme , Karol Hausman

We focus on developing efficient and reliable policy optimization strategies for robot learning with real-world data. In recent years, policy gradient methods have emerged as a promising paradigm for training control policies in simulation.…

Machine Learning · Computer Science 2023-11-07 Tyler Westenbroek , Jacob Levy , David Fridovich-Keil

Policy constraint methods to offline reinforcement learning (RL) typically utilize parameterization or regularization that constrains the policy to perform actions within the support set of the behavior policy. The elaborative designs of…

Machine Learning · Computer Science 2022-10-13 Jialong Wu , Haixu Wu , Zihan Qiu , Jianmin Wang , Mingsheng Long

We present an online model-based reinforcement learning algorithm suitable for controlling complex robotic systems directly in the real world. Unlike prevailing sim-to-real pipelines that rely on extensive offline simulation and model-free…

Robotics · Computer Science 2026-05-07 Fang Nan , Hao Ma , Qinghua Guan , Josie Hughes , Michael Muehlebach , Marco Hutter

The rise of deep learning has caused a paradigm shift in robotics research, favoring methods that require large amounts of data. Unfortunately, it is prohibitively expensive to generate such data sets on a physical platform. Therefore,…

Robotics · Computer Science 2022-01-19 Fabio Muratore , Fabio Ramos , Greg Turk , Wenhao Yu , Michael Gienger , Jan Peters

Learning from Demonstration is increasingly used for transferring operator manipulation skills to robots. In practice, it is important to cater for limited data and imperfect human demonstrations, as well as underlying safety constraints.…

Robotics · Computer Science 2020-04-03 Ya-Yen Tsai , Bo Xiao , Edward Johns , Guang-Zhong Yang

Robot control policies learned in simulation do not often transfer well to the real world. Many existing solutions to this sim-to-real problem, such as the Grounded Action Transformation (GAT) algorithm, seek to correct for or ground these…

Robotics · Computer Science 2020-08-05 Siddharth Desai , Haresh Karnan , Josiah P. Hanna , Garrett Warnell , Peter Stone

Reinforcement learning in partially observable domains is challenging due to the lack of observable state information. Thankfully, learning offline in a simulator with such state information is often possible. In particular, we propose a…

Robotics · Computer Science 2022-11-11 Hai Nguyen , Andrea Baisero , Dian Wang , Christopher Amato , Robert Platt

Deep reinforcement learning algorithms can perform poorly in real-world tasks due to the discrepancy between source and target environments. This discrepancy is commonly viewed as the disturbance in transition dynamics. Many existing…

Machine Learning · Computer Science 2021-12-21 Yufei Kuang , Miao Lu , Jie Wang , Qi Zhou , Bin Li , Houqiang Li

In robotics, gradient-free optimization algorithms (e.g. evolutionary algorithms) are often used only in simulation because they require the evaluation of many candidate solutions. Nevertheless, solutions obtained in simulation often do not…

Robotics · Computer Science 2013-07-09 Jean-Baptiste Mouret , Sylvain Koos , Stéphane Doncieux

Policy Optimization (PO) is a widely used approach to address continuous control tasks. In this paper, we introduce the notion of mediator feedback that frames PO as an online learning problem over the policy space. The additional available…

Machine Learning · Computer Science 2020-12-16 Alberto Maria Metelli , Matteo Papini , Pierluca D'Oro , Marcello Restelli

In this work we propose an approach to learn a robust policy for solving the pivoting task. Recently, several model-free continuous control algorithms were shown to learn successful policies without prior knowledge of the dynamics of the…

Robotics · Computer Science 2017-03-03 Rika Antonova , Silvia Cruciani , Christian Smith , Danica Kragic

The paper presents a complete pipeline for learning continuous motion control policies for a mobile robot when only a non-differentiable physics simulator of robot-terrain interactions is available. The multi-modal state estimation of the…

Robotics · Computer Science 2022-06-22 Martin Pecka , Karel Zimmermann , Matěj Petrlík , Tomáš Svoboda

This paper proposes an approach to domain transfer based on a pairwise loss function that helps transfer control policies learned in simulation onto a real robot. We explore the idea in the context of a 'category level' manipulation task…

Robotics · Computer Science 2018-10-30 Ulrich Viereck , Xingchao Peng , Kate Saenko , Robert Platt

Randomization is currently a widely used approach in Sim2Real transfer for data-driven learning algorithms in robotics. Still, most Sim2Real studies report results for a specific randomization technique and often on a highly customized…

In this work, we propose a data-driven approach to optimize the parameters of a simulation such that control policies can be directly transferred from simulation to a real-world quadrotor. Our neural network-based policies take only onboard…

Robotics · Computer Science 2022-12-29 Sven Gronauer , Matthias Kissel , Luca Sacchetto , Mathias Korte , Klaus Diepold

Current vision-based robotics simulation benchmarks have significantly advanced robotic manipulation research. However, robotics is fundamentally a real-world problem, and evaluation for real-world applications has lagged behind in…

Robotics · Computer Science 2025-08-18 Xuning Yang , Clemens Eppner , Jonathan Tremblay , Dieter Fox , Stan Birchfield , Fabio Ramos

Vision and learning have made significant progress that could improve robotics policies for complex tasks and environments. Learning deep neural networks for image understanding, however, requires large amounts of domain-specific visual…

Machine Learning · Computer Science 2019-07-31 Alexander Pashevich , Robin Strudel , Igor Kalevatykh , Ivan Laptev , Cordelia Schmid

Being able to transfer existing skills to new situations is a key capability when training robots to operate in unpredictable real-world environments. A successful transfer algorithm should not only minimize the number of samples that the…

Robotics · Computer Science 2020-12-15 Wenhao Yu , C. Karen Liu , Greg Turk

Simulation has recently become key for deep reinforcement learning to safely and efficiently acquire general and complex control policies from visual and proprioceptive inputs. Tactile information is not usually considered despite its…

Robotics · Computer Science 2021-11-02 Alex Church , John Lloyd , Raia Hadsell , Nathan F. Lepora