English
Related papers

Related papers: Policy Transfer via Kinematic Domain Randomization…

200 papers

The ability to transfer a policy from one environment to another is a promising avenue for efficient robot learning in realistic settings where task supervision is not available. This can allow us to take advantage of environments well…

Robotics · Computer Science 2021-07-02 Grace Zhang , Linghan Zhong , Youngwoon Lee , Joseph J. Lim

We propose a method to predict the sim-to-real transfer performance of RL policies. Our transfer metric simplifies the selection of training setups (such as algorithm, hyperparameters, randomizations) and policies in simulation, without the…

Machine Learning · Computer Science 2020-09-29 Lei M. Zhang , Matthias Plappert , Wojciech Zaremba

Randomization is currently a widely used approach in Sim2Real transfer for data-driven learning algorithms in robotics. Still, most Sim2Real studies report results for a specific randomization technique and often on a highly customized…

In recent years, domain randomization over dynamics parameters has gained a lot of traction as a method for sim-to-real transfer of reinforcement learning policies in robotic manipulation; however, finding optimal randomization…

Robotics · Computer Science 2023-01-13 Gabriele Tiboni , Karol Arndt , Ville Kyrki

Varying dynamics parameters in simulation is a popular Domain Randomization (DR) approach for overcoming the reality gap in Reinforcement Learning (RL). Nevertheless, DR heavily hinges on the choice of the sampling distribution of the…

Machine Learning · Computer Science 2024-03-27 Gabriele Tiboni , Pascal Klink , Jan Peters , Tatiana Tommasi , Carlo D'Eramo , Georgia Chalvatzaki

Physics simulators have shown great promise for conveniently learning reinforcement learning policies in safe, unconstrained environments. However, transferring the acquired knowledge to the real world can be challenging due to the reality…

Robotics · Computer Science 2022-06-30 Gabriele Tiboni , Karol Arndt , Giuseppe Averta , Ville Kyrki , Tatiana Tommasi

There has been an increasing interest in 3D indoor navigation, where a robot in an environment moves to a target according to an instruction. To deploy a robot for navigation in the physical world, lots of training data is required to learn…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Fengda Zhu , Linchao Zhu , Yi Yang

Vision and learning have made significant progress that could improve robotics policies for complex tasks and environments. Learning deep neural networks for image understanding, however, requires large amounts of domain-specific visual…

Machine Learning · Computer Science 2019-07-31 Alexander Pashevich , Robin Strudel , Igor Kalevatykh , Ivan Laptev , Cordelia Schmid

Generalizing policies across different domains with dynamics mismatch poses a significant challenge in reinforcement learning. For example, a robot learns the policy in a simulator, but when it is deployed in the real world, the dynamics of…

Machine Learning · Computer Science 2023-10-16 Kang Xu , Chenjia Bai , Xiaoteng Ma , Dong Wang , Bin Zhao , Zhen Wang , Xuelong Li , Wei Li

Deploying machine learning algorithms for robot tasks in real-world applications presents a core challenge: overcoming the domain gap between the training and the deployment environment. This is particularly difficult for visuomotor…

Robotics · Computer Science 2024-07-25 Weiyao Wang , Gregory D. Hager

Policies trained in simulation often fail when transferred to the real world due to the `reality gap' where the simulator is unable to accurately capture the dynamics and visual properties of the real world. Current approaches to tackle…

Robotics · Computer Science 2021-05-21 Yuqing Du , Olivia Watkins , Trevor Darrell , Pieter Abbeel , Deepak Pathak

Sim-to-real transfer remains a significant challenge in robotics due to the discrepancies between simulated and real-world dynamics. Traditional methods like Domain Randomization often fail to capture fine-grained dynamics, limiting their…

Robotics · Computer Science 2025-03-04 Xilun Zhang , Shiqi Liu , Peide Huang , William Jongwon Han , Yiqi Lyu , Mengdi Xu , Ding Zhao

Simulation parameter settings such as contact models and object geometry approximations are critical to training robust robotic policies capable of transferring from simulation to real-world deployment. Previous approaches typically…

Robotics · Computer Science 2023-10-03 Allen Z. Ren , Hongkai Dai , Benjamin Burchfiel , Anirudha Majumdar

Learning robot control policies from physics simulations is of great interest to the robotics community as it may render the learning process faster, cheaper, and safer by alleviating the need for expensive real-world experiments. However,…

Robotics · Computer Science 2021-06-22 Fabio Muratore , Michael Gienger , Jan Peters

Domain randomisation is a very popular method for visual sim-to-real transfer in robotics, due to its simplicity and ability to achieve transfer without any real-world images at all. Nonetheless, a number of design choices must be made to…

Robotics · Computer Science 2021-05-24 Raghad Alghonaim , Edward Johns

Contact-rich manipulation plays an important role in human daily activities, but uncertain parameters pose significant challenges for robots to achieve comparable performance through planning and control. To address this issue, domain…

Robotics · Computer Science 2024-10-16 Teng Xue , Amirreza Razmjoo , Suhan Shetty , Sylvain Calinon

It is vital to learn effective policies that can be transferred to different domains with dynamics discrepancies in reinforcement learning (RL). In this paper, we consider dynamics adaptation settings where there exists dynamics mismatch…

Machine Learning · Computer Science 2024-05-27 Jiafei Lyu , Chenjia Bai , Jingwen Yang , Zongqing Lu , Xiu Li

Dexterous manipulation has seen remarkable progress in recent years, with policies capable of executing many complex and contact-rich tasks in simulation. However, transferring these policies from simulation to real world remains a…

Robotics · Computer Science 2025-05-05 Shuqi Zhao , Ke Yang , Yuxin Chen , Chenran Li , Yichen Xie , Xiang Zhang , Changhao Wang , Masayoshi Tomizuka

Humanoids have the potential to be the ideal embodiment in environments designed for humans. Thanks to the structural similarity to the human body, they benefit from rich sources of demonstration data, e.g., collected via teleoperation,…

Robotics · Computer Science 2024-11-05 Oleg Kaidanov , Firas Al-Hafez , Yusuf Suvari , Boris Belousov , Jan Peters

In this paper, we deal with the reality gap from a novel perspective, targeting transferring Deep Reinforcement Learning (DRL) policies learned in simulated environments to the real-world domain for visual control tasks. Instead of adopting…

Robotics · Computer Science 2019-01-17 Jingwei Zhang , Lei Tai , Peng Yun , Yufeng Xiong , Ming Liu , Joschka Boedecker , Wolfram Burgard