English
Related papers

Related papers: VR-Goggles for Robots: Real-to-sim Domain Adaptati…

200 papers

Modern reinforcement learning methods suffer from low sample efficiency and unsafe exploration, making it infeasible to train robotic policies entirely on real hardware. In this work, we propose to address the problem of sim-to-real domain…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Karol Arndt , Murtaza Hazara , Ali Ghadirzadeh , Ville Kyrki

The data-driven approach to robot control has been gathering pace rapidly, yet generalization to unseen task domains remains a critical challenge. We argue that the key to generalization is representations that are (i) rich enough to…

Robotics · Computer Science 2023-12-05 Bo Ai , Zhanxin Wu , David Hsu

Pre-training for Reinforcement Learning (RL) with purely video data is a valuable yet challenging problem. Although in-the-wild videos are readily available and inhere a vast amount of prior world knowledge, the absence of action…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Hao Luo , Bohan Zhou , Zongqing Lu

A commercial robot, trained by its manufacturer to recognize a predefined number and type of objects, might be used in many settings, that will in general differ in their illumination conditions, background, type and degree of clutter, and…

Computer Vision and Pattern Recognition · Computer Science 2018-02-27 Gabriele Angeletti , Barbara Caputo , Tatiana Tommasi

Deep Reinforcement Learning (DRL) has shown remarkable success in solving complex tasks across various research fields. However, transferring DRL agents to the real world is still challenging due to the significant discrepancies between…

Machine Learning · Computer Science 2024-10-22 Dianzhao Li , Ostap Okhrin

Reinforcement learning (RL) is a promising solution for autonomous vehicles to deal with complex and uncertain traffic environments. The RL training process is however expensive, unsafe, and time consuming. Algorithms are often developed…

Robotics · Computer Science 2022-11-29 Kevin Voogd , Jean Pierre Allamaa , Javier Alonso-Mora , Tong Duy Son

This chapter addresses the critical challenge of simulation-to-reality (sim-to-real) transfer for deep reinforcement learning (DRL) in bipedal locomotion. After contextualizing the problem within various control architectures, we dissect…

Robotics · Computer Science 2025-11-11 Lingfan Bao , Tianhu Peng , Chengxu Zhou

Training visual control policies from scratch on a new robot typically requires generating large amounts of robot-specific data. How might we leverage data previously collected on another robot to reduce or even completely remove this need…

Machine Learning · Computer Science 2022-10-18 Edward S. Hu , Kun Huang , Oleh Rybkin , Dinesh Jayaraman

Reinforcement learning has shown a wide usage in robotics tasks, such as insertion and grasping. However, without a practical sim2real strategy, the policy trained in simulation could fail on the real task. There are also wide researches in…

Robotics · Computer Science 2022-06-07 Yiwen Chen , Xue Li , Sheng Guo , Xian Yao Ng , Marcelo Ang

Autonomous navigation in unstructured environments is essential for field and planetary robotics, where robots must efficiently reach goals while avoiding obstacles under uncertain conditions. Conventional algorithmic approaches often…

Robotics · Computer Science 2025-10-28 Shreya Santra , Thomas Robbins , Kazuya Yoshida

Mobile network that millions of people use every day is one of the most complex systems in the world. Optimization of mobile network to meet exploding customer demand and reduce capital/operation expenditures poses great challenges. Despite…

Artificial Intelligence · Computer Science 2018-12-07 Yongxi Tan , Jin Yang , Xin Chen , Qitao Song , Yunjun Chen , Zhangxiang Ye , Zhenqiang Su

The success of deep reinforcement learning (RL) and imitation learning (IL) in vision-based robotic manipulation typically hinges on the expense of large scale data collection. With simulation, data to train a policy can be collected…

Robotics · Computer Science 2021-07-06 Daniel Ho , Kanishka Rao , Zhuo Xu , Eric Jang , Mohi Khansari , Yunfei Bai

Reinforcement learning (RL) can automate a wide variety of robotic skills, but learning each new skill requires considerable real-world data collection and manual representation engineering to design policy classes or features. Using deep…

Machine Learning · Computer Science 2016-09-23 Coline Devin , Abhishek Gupta , Trevor Darrell , Pieter Abbeel , Sergey Levine

Deep Reinforcement Learning (DRL) aims to create intelligent agents that can learn to solve complex problems efficiently in a real-world environment. Typically, two learning goals: adaptation and generalization are used for baselining DRL…

Machine Learning · Computer Science 2022-02-18 Pamul Yadav , Ashutosh Mishra , Junyong Lee , Shiho Kim

Autonomous driving relies on a huge volume of real-world data to be labeled to high precision. Alternative solutions seek to exploit driving simulators that can generate large amounts of labeled data with a plethora of content variations.…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 David Acuna , Jonah Philion , Sanja Fidler

The ability to transfer a policy from one environment to another is a promising avenue for efficient robot learning in realistic settings where task supervision is not available. This can allow us to take advantage of environments well…

Robotics · Computer Science 2021-07-02 Grace Zhang , Linghan Zhong , Youngwoon Lee , Joseph J. Lim

There has been an increasing interest in 3D indoor navigation, where a robot in an environment moves to a target according to an instruction. To deploy a robot for navigation in the physical world, lots of training data is required to learn…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Fengda Zhu , Linchao Zhu , Yi Yang

Reinforcement Learning (RL), among other learning-based methods, represents powerful tools to solve complex robotic tasks (e.g., actuation, manipulation, navigation, etc.), with the need for real-world data to train these systems as one of…

Robotics · Computer Science 2020-07-28 Kenzo Lobos-Tsunekawa , Tatsuya Harada

We explore sim-to-real transfer of deep reinforcement learning controllers for a heavy vehicle with active suspensions designed for traversing rough terrain. While related research primarily focuses on lightweight robots with electric…

This paper proposes a novel Reinforcement Learning (RL) approach for sim-to-real policy transfer of Vertical Take-Off and Landing Unmanned Aerial Vehicle (VTOL-UAV). The proposed approach is designed for VTOL-UAV landing on offshore docking…

Robotics · Computer Science 2024-08-01 Ali M. Ali , Aryaman Gupta , Hashim A. Hashim