English
Related papers

Related papers: Understanding Domain Randomization for Sim-to-real…

200 papers

Autonomous driving relies on a huge volume of real-world data to be labeled to high precision. Alternative solutions seek to exploit driving simulators that can generate large amounts of labeled data with a plethora of content variations.…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 David Acuna , Jonah Philion , Sanja Fidler

Employing machine learning models in the real world requires collecting large amounts of data, which is both time consuming and costly to collect. A common approach to circumvent this is to leverage existing, similar data-sets with large…

Computer Vision and Pattern Recognition · Computer Science 2020-09-07 Michael Lomnitz , Zigfried Hampel-Arias , Nina Lopatina , Felipe A. Mejia

Learning a generalist control policy for dexterous manipulation typically relies on large-scale datasets. Given the high cost of real-world data collection, a practical alternative is to generate synthetic data through simulation. However,…

Robotics · Computer Science 2026-03-25 Ruixing Jin , Zicheng Zhu , Ruixiang Ouyang , Sheng Xu , Bo Yue , Zhizheng Wu , Guiliang Liu

To address the computational challenges of Model Predictive Control (MPC), recent research has studied using imitation learning to approximate MPC with a computationally efficient Deep Neural Network (DNN). However, this introduces a common…

Systems and Control · Electrical Eng. & Systems 2026-03-19 Seungtaek Kim , Jonghyup Lee , Kyoungseok Han , Seibum B. Choi

Reinforcement Learning (RL) has been widely explored in Traffic Signal Control (TSC) applications, however, still no such system has been deployed in practice. A key barrier to progress in this area is the reality gap, the discrepancy that…

Machine Learning · Computer Science 2023-07-24 Arthur Müller , Matthia Sabatelli

We study the challenging problem of releasing a robot in a previously unseen environment, and having it follow unconstrained natural language navigation instructions. Recent work on the task of Vision-and-Language Navigation (VLN) has…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Peter Anderson , Ayush Shrivastava , Joanne Truong , Arjun Majumdar , Devi Parikh , Dhruv Batra , Stefan Lee

In sim-to-real Reinforcement Learning (RL), a policy is trained in a simulated environment and then deployed on the physical system. The main challenge of sim-to-real RL is to overcome the reality gap - the discrepancies between the real…

Robotics · Computer Science 2023-06-13 Nghia Vuong , Quang-Cuong Pham

This paper proposes a simulation-based reinforcement learning algorithm for controlling systems with uncertain and varying system parameters. While simulators are useful for safely learning control policies, the reality gap remains a major…

Systems and Control · Electrical Eng. & Systems 2026-05-14 Junya Ikemoto

Imitation learning methods need significant human supervision to learn policies robust to changes in object poses, physical disturbances, and visual distractors. Reinforcement learning, on the other hand, can explore the environment…

Robotics · Computer Science 2024-11-26 Marcel Torne , Anthony Simeonov , Zechu Li , April Chan , Tao Chen , Abhishek Gupta , Pulkit Agrawal

Model-based RL is a promising approach for real-world robotics due to its improved sample efficiency and generalization capabilities compared to model-free RL. However, effective model-based RL solutions for vision-based real-world…

Robotics · Computer Science 2023-11-08 Jun Yamada , Marc Rigter , Jack Collins , Ingmar Posner

Model-based reinforcement learning methods learn a dynamics model with real data sampled from the environment and leverage it to generate simulated data to derive an agent. However, due to the potential distribution mismatch between…

Machine Learning · Computer Science 2020-10-29 Jian Shen , Han Zhao , Weinan Zhang , Yong Yu

Advancements in graphics technology has increased the use of simulated data for training machine learning models. However, the simulated data often differs from real-world data, creating a distribution gap that can decrease the efficacy of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Charles Y Zhang , Ashish Shrivastava

The engineering community currently encounters significant challenges in the development of intelligent transportation algorithms that can be transferred from simulation to reality with minimal effort. This can be achieved by robustifying…

Robotics · Computer Science 2024-09-11 Chinmay Vilas Samak , Tanmay Vilas Samak , Venkat Krovi

In this paper, we explore the utilization of natural language to drive transfer for reinforcement learning (RL). Despite the wide-spread application of deep RL techniques, learning generalized policy representations that work across domains…

Computation and Language · Computer Science 2018-12-07 Karthik Narasimhan , Regina Barzilay , Tommi Jaakkola

Deep reinforcement learning (DRL) has achieved groundbreaking successes in a wide variety of robotic applications. A natural consequence is the adoption of this paradigm for safety-critical tasks, where human safety and expensive hardware…

Robotics · Computer Science 2022-06-22 Davide Corsi , Raz Yerushalmi , Guy Amir , Alessandro Farinelli , David Harel , Guy Katz

We present a reinforcement learning-based solution to autonomously race on a miniature race car platform. We show that a policy that is trained purely in simulation using a relatively simple vehicle model, including model randomization, can…

Robotics · Computer Science 2021-05-10 Eugenio Chisari , Alexander Liniger , Alisa Rupenyan , Luc Van Gool , John Lygeros

Robots which make use of soft or compliant inter- actions often leverage tendon-driven actuation which enables actuators to be placed more flexibly, and compliance to be maintained. However, controlling complex tendon systems is…

Robotics · Computer Science 2026-03-05 Valentin Yuryev , Josie Hughes

The large demand for simulated data has made the reality gap a problem on the forefront of robotics. We propose a method to traverse the gap by tuning available simulation parameters. Through the optimisation of physics engine parameters,…

Robotics · Computer Science 2020-03-04 Jack Collins , Ross Brown , Jurgen Leitner , David Howard

Particle physics or High Energy Physics (HEP) studies the elementary constituents of matter and their interactions with each other. Machine Learning (ML) has played an important role in HEP analysis and has proven extremely successful in…

Machine Learning · Computer Science 2019-12-18 Marouen Baalouch , Maxime Defurne , Jean-Philippe Poli , Noëlie Cherrier

Robot learning requires a considerable amount of high-quality data to realize the promise of generalization. However, large data sets are costly to collect in the real world. Physics simulators can cheaply generate vast data sets with broad…