English
Related papers

Related papers: Sim-to-Real Transfer with Incremental Environment …

200 papers

Developing control policies in simulation is often more practical and safer than directly running experiments in the real world. This applies to policies obtained from planning and optimization, and even more so to policies obtained from…

Recently, model-free reinforcement learning algorithms have been shown to solve challenging problems by learning from extensive interaction with the environment. A significant issue with transferring this success to the robotics domain is…

Artificial Intelligence · Computer Science 2017-11-30 Jake Bruce , Niko Suenderhauf , Piotr Mirowski , Raia Hadsell , Michael Milford

Solving complex problems using reinforcement learning necessitates breaking down the problem into manageable tasks and learning policies to solve these tasks. These policies, in turn, have to be controlled by a master policy that takes…

Artificial Intelligence · Computer Science 2022-08-09 Ambedkar Dukkipati , Rajarshi Banerjee , Ranga Shaarad Ayyagari , Dhaval Parmar Udaybhai

Deep reinforcement learning has proven to be successful for learning tasks in simulated environments, but applying same techniques for robots in real-world domain is more challenging, as they require hours of training. To address this,…

Machine Learning · Computer Science 2020-03-24 Janne Karttunen , Anssi Kanervisto , Ville Kyrki , Ville Hautamäki

We address the challenge of enhancing navigation autonomy for planetary space rovers using reinforcement learning (RL). The ambition of future space missions necessitates advanced autonomous navigation capabilities for rovers to meet…

This work studies reinforcement learning in the Sim-to-Real setting, in which an agent is first trained on a number of simulators before being deployed in the real world, with the aim of decreasing the real-world sample complexity…

Machine Learning · Computer Science 2019-10-28 Yuren Zhong , Aniket Anand Deshmukh , Clayton Scott

Autonomous navigation in dynamic environments is a complex but essential task for autonomous robots, with recent deep reinforcement learning approaches showing promising results. However, the complexity of the real world makes it infeasible…

Robotics · Computer Science 2025-04-29 Diego Martinez-Baselga , Luis Riazuelo , Luis Montano

Learning effective visuomotor policies for robots purely from data is challenging, but also appealing since a learning-based system should not require manual tuning or calibration. In the case of a robot operating in a real environment the…

Robotics · Computer Science 2018-10-12 Homanga Bharadhwaj , Zihan Wang , Yoshua Bengio , Liam Paull

Vision and learning have made significant progress that could improve robotics policies for complex tasks and environments. Learning deep neural networks for image understanding, however, requires large amounts of domain-specific visual…

Machine Learning · Computer Science 2019-07-31 Alexander Pashevich , Robin Strudel , Igor Kalevatykh , Ivan Laptev , Cordelia Schmid

The industrial application of Deep Reinforcement Learning (DRL) is frequently slowed down because of the inability to generate the experience required to train the models. Collecting data often involves considerable time and economic effort…

Robotics · Computer Science 2025-01-27 Lucía Güitta-López , Jaime Boal , Álvaro J. López-López

We study the challenging problem of releasing a robot in a previously unseen environment, and having it follow unconstrained natural language navigation instructions. Recent work on the task of Vision-and-Language Navigation (VLN) has…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Peter Anderson , Ayush Shrivastava , Joanne Truong , Arjun Majumdar , Devi Parikh , Dhruv Batra , Stefan Lee

Training self-driving cars is often challenging since they require a vast amount of labeled data in multiple real-world contexts, which is computationally and memory intensive. Researchers often resort to driving simulators to train the…

Artificial Intelligence · Computer Science 2022-12-01 Avinash Amballa , Advaith P. , Pradip Sasmal , Sumohana Channappayya

This work focuses on enhancing the generalization performance of deep reinforcement learning-based robot navigation in unseen environments. We present a novel data augmentation approach called scenario augmentation, which enables robots to…

Robotics · Computer Science 2025-03-04 Shanze Wang , Mingao Tan , Zhibo Yang , Xianghui Wang , Xiaoyu Shen , Hailong Huang , Wei Zhang

Reinforcement learning (RL) is playing an increasingly important role in fields such as robotic control and autonomous driving. However, the gap between simulation and the real environment remains a major obstacle to the practical…

Machine Learning · Computer Science 2025-06-17 Zhilin Lin , Shiliang Sun

Deep reinforcement learning has the potential to train robots to perform complex tasks in the real world without requiring accurate models of the robot or its environment. A practical approach is to train agents in simulation, and then…

Machine Learning · Computer Science 2022-10-26 Tianhong Dai , Kai Arulkumaran , Tamara Gerbert , Samyakh Tukra , Feryal Behbahani , Anil Anthony Bharath

Deep reinforcement learning has made significant progress in robotic manipulation tasks and it works well in the ideal disturbance-free environment. However, in a real-world environment, both internal and external disturbances are…

Robotics · Computer Science 2020-11-09 Pingcheng Jian , Chao Yang , Di Guo , Huaping Liu , Fuchun Sun

Reliable autonomous navigation across the unstructured terrains of distant planetary surfaces is a critical enabler for future space exploration. However, the deployment of learning-based controllers is hindered by the inherent sim-to-real…

Robotics · Computer Science 2025-10-22 Andrej Orsula , Matthieu Geist , Miguel Olivares-Mendez , Carol Martinez

Despite recent advances in Reinforcement Learning (RL), many problems, especially real-world tasks, remain prohibitively expensive to learn. To address this issue, several lines of research have explored how tasks, or data samples…

Robotics · Computer Science 2022-04-12 Yash Shukla , Christopher Thierauf , Ramtin Hosseini , Gyan Tatiya , Jivko Sinapov

Deep reinforcement learning models are notoriously data hungry, yet real-world data is expensive and time consuming to obtain. The solution that many have turned to is to use simulation for training before deploying the robot in a real…

Robotics · Computer Science 2021-03-01 Joanne Truong , Sonia Chernova , Dhruv Batra

Reinforcement learning is considered as a promising direction for driving policy learning. However, training autonomous driving vehicle with reinforcement learning in real environment involves non-affordable trial-and-error. It is more…

Artificial Intelligence · Computer Science 2017-09-27 Xinlei Pan , Yurong You , Ziyan Wang , Cewu Lu