English
Related papers

Related papers: Policy Transfer with Strategy Optimization

200 papers

Deep reinforcement learning with domain randomization learns a control policy in various simulations with randomized physical and sensor model parameters to become transferable to the real world in a zero-shot setting. However, a huge…

Robotics · Computer Science 2023-04-11 Yuki Kadokawa , Lingwei Zhu , Yoshihisa Tsurumine , Takamitsu Matsubara

We propose a method to predict the sim-to-real transfer performance of RL policies. Our transfer metric simplifies the selection of training setups (such as algorithm, hyperparameters, randomizations) and policies in simulation, without the…

Machine Learning · Computer Science 2020-09-29 Lei M. Zhang , Matthias Plappert , Wojciech Zaremba

Sim-to-real transfer remains a major challenge in reinforcement learning (RL) for robotics, as policies trained in simulation often fail to generalize to the real world due to discrepancies in environment dynamics. Domain Randomization (DR)…

Robotics · Computer Science 2025-11-07 Marco Iannotta , Yuxuan Yang , Johannes A. Stork , Erik Schaffernicht , Todor Stoyanov

Ensuring generalization to unseen environments remains a challenge. Domain shift can lead to substantially degraded performance unless shifts are well-exercised within the available training environments. We introduce a simple robust…

Machine Learning · Computer Science 2021-10-20 Yilun Xu , Tommi Jaakkola

Transfer Learning (TL) is a powerful tool that enables robots to transfer learned policies across different environments, tasks, or embodiments. To further facilitate this process, efforts have been made to combine it with Learning from…

Robotics · Computer Science 2025-03-18 Muhan Hou , Koen Hindriks , A. E. Eiben , Kim Baraka

The burgeoning fields of robot learning and embodied AI have triggered an increasing demand for large quantities of data. However, collecting sufficient unbiased data from the target domain remains a challenge due to costly data collection…

Robotics · Computer Science 2024-08-28 Haoyi Niu , Jianming Hu , Guyue Zhou , Xianyuan Zhan

Understanding the gap between simulation and reality is critical for reinforcement learning with legged robots, which are largely trained in simulation. However, recent work has resulted in sometimes conflicting conclusions with regard to…

Robotics · Computer Science 2021-03-26 Zhaoming Xie , Xingye Da , Michiel van de Panne , Buck Babich , Animesh Garg

Modern reinforcement learning methods suffer from low sample efficiency and unsafe exploration, making it infeasible to train robotic policies entirely on real hardware. In this work, we propose to address the problem of sim-to-real domain…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Karol Arndt , Murtaza Hazara , Ali Ghadirzadeh , Ville Kyrki

In recent years, domain randomization over dynamics parameters has gained a lot of traction as a method for sim-to-real transfer of reinforcement learning policies in robotic manipulation; however, finding optimal randomization…

Robotics · Computer Science 2023-01-13 Gabriele Tiboni , Karol Arndt , Ville Kyrki

End-to-end approaches to autonomous driving have high sample complexity and are difficult to scale to realistic urban driving. Simulation can help end-to-end driving systems by providing a cheap, safe, and diverse training environment. Yet…

Robotics · Computer Science 2018-12-14 Matthias Müller , Alexey Dosovitskiy , Bernard Ghanem , Vladlen Koltun

Despite recent progress in Reinforcement Learning for robotics applications, many tasks remain prohibitively difficult to solve because of the expensive interaction cost. Transfer learning helps reduce the training time in the target domain…

Robotics · Computer Science 2023-10-16 Yash Shukla , Bharat Kesari , Shivam Goel , Robert Wright , Jivko Sinapov

The data-driven approach to robot control has been gathering pace rapidly, yet generalization to unseen task domains remains a critical challenge. We argue that the key to generalization is representations that are (i) rich enough to…

Robotics · Computer Science 2023-12-05 Bo Ai , Zhanxin Wu , David Hsu

Deep reinforcement learning has recently seen huge success across multiple areas in the robotics domain. Owing to the limitations of gathering real-world data, i.e., sample inefficiency and the cost of collecting it, simulation environments…

Machine Learning · Computer Science 2021-07-09 Wenshuai Zhao , Jorge Peña Queralta , Tomi Westerlund

We present a novel solution to the problem of simulation-to-real transfer, which builds on recent advances in robot skill decomposition. Rather than focusing on minimizing the simulation-reality gap, we learn a set of diverse policies that…

Machine Learning · Computer Science 2018-11-15 Ryan Julian , Eric Heiden , Zhanpeng He , Hejia Zhang , Stefan Schaal , Joseph J. Lim , Gaurav Sukhatme , Karol Hausman

How can robots learn and adapt to new tasks and situations with little data? Systematic exploration and simulation are crucial tools for efficient robot learning. We present a novel black-box policy search algorithm focused on…

Robotics · Computer Science 2025-02-11 Shiming He , Alexander von Rohr , Dominik Baumann , Ji Xiang , Sebastian Trimpe

Learning controllers for bipedal robots is a challenging problem, often requiring expert knowledge and extensive tuning of parameters that vary in different situations. Recently, deep reinforcement learning has shown promise at…

Robotics · Computer Science 2018-10-01 Tianyu Li , Akshara Rai , Hartmut Geyer , Christopher G. Atkeson

This paper focuses on transferring control policies between robot manipulators with different morphology. While reinforcement learning (RL) methods have shown successful results in robot manipulation tasks, transferring a trained policy…

Robotics · Computer Science 2024-06-05 Tianyu Wang , Dwait Bhatt , Xiaolong Wang , Nikolay Atanasov

Deploying machine learning algorithms for robot tasks in real-world applications presents a core challenge: overcoming the domain gap between the training and the deployment environment. This is particularly difficult for visuomotor…

Robotics · Computer Science 2024-07-25 Weiyao Wang , Gregory D. Hager

In most real world scenarios, a policy trained by reinforcement learning in one environment needs to be deployed in another, potentially quite different environment. However, generalization across different environments is known to be hard.…

Machine Learning · Computer Science 2021-04-12 Nicklas Hansen , Rishabh Jangir , Yu Sun , Guillem Alenyà , Pieter Abbeel , Alexei A. Efros , Lerrel Pinto , Xiaolong Wang

Efficiently training control policies for robots is a major challenge that can greatly benefit from utilizing knowledge gained from training similar systems through cross-embodiment knowledge transfer. In this work, we focus on accelerating…

Robotics · Computer Science 2026-02-18 Welf Rehberg , Mihir Kulkarni , Philipp Weiss , Kostas Alexis