English
Related papers

Related papers: Crossing The Gap: A Deep Dive into Zero-Shot Sim-t…

200 papers

Computer simulation provides an automatic and safe way for training robotic control policies to achieve complex tasks such as locomotion. However, a policy trained in simulation usually does not transfer directly to the real hardware due to…

Machine Learning · Computer Science 2018-12-05 Wenhao Yu , C. Karen Liu , Greg Turk

Although reinforcement learning (RL) can solve many challenging sequential decision making problems, achieving zero-shot transfer across related tasks remains a challenge. The difficulty lies in finding a good representation for the current…

Machine Learning · Computer Science 2025-03-24 Tyler Ingebrand , Amy Zhang , Ufuk Topcu

Tactile sensors are believed to be essential in robotic manipulation, and prior works often rely on experts to reason the sensor feedback and design a controller. With the recent advancement in data-driven approaches, complicated…

Robotics · Computer Science 2023-05-24 Ya-Yen Tsai , Bidan Huang , Yu Zheng , Lei Han , Wang Wei Lee , Edward Johns

Simulation especially real-time simulation have been widely used for the design and testing of real-time systems. The advancement of simulation tools has largely attributed to the evolution of computing technologies. With the reduced cost…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-05-07 Xi Zheng

Humans throw and catch objects all the time. However, such a seemingly common skill introduces a lot of challenges for robots to achieve: The robots need to operate such dynamic actions at high-speed, collaborate precisely, and interact…

Robotics · Computer Science 2023-09-12 Binghao Huang , Yuanpei Chen , Tianyu Wang , Yuzhe Qin , Yaodong Yang , Nikolay Atanasov , Xiaolong Wang

Simulations are valuable tools for empirically evaluating the properties of statistical methods and are primarily employed in methodological research to draw general conclusions about methods. In addition, they can often be useful to…

Other Statistics · Statistics 2025-10-08 Anne-Laure Boulesteix , Patrick Callahan , Luzia Hanssum , Vincent Gaertner , Eva Hoster

The gap between simulation and the real-world restrains many machine learning breakthroughs in computer vision and reinforcement learning from being applicable in the real world. In this work, we tackle this gap for the specific case of…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Klaas Kelchtermans , Tinne Tuytelaars

We study the challenging problem of releasing a robot in a previously unseen environment, and having it follow unconstrained natural language navigation instructions. Recent work on the task of Vision-and-Language Navigation (VLN) has…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Peter Anderson , Ayush Shrivastava , Joanne Truong , Arjun Majumdar , Devi Parikh , Dhruv Batra , Stefan Lee

Recent work has demonstrated the ability of deep reinforcement learning (RL) algorithms to learn complex robotic behaviours in simulation, including in the domain of multi-fingered manipulation. However, such models can be challenging to…

This paper studies the problem of autonomous exploration under localization uncertainty for a mobile robot with 3D range sensing. We present a framework for self-learning a high-performance exploration policy in a single simulation…

Robotics · Computer Science 2021-05-12 Fanfei Chen , Paul Szenher , Yewei Huang , Jinkun Wang , Tixiao Shan , Shi Bai , Brendan Englot

Bimanual manipulation with tactile feedback will be key to human-level robot dexterity. However, this topic is less explored than single-arm settings, partly due to the availability of suitable hardware along with the complexity of…

Robotics · Computer Science 2023-07-14 Yijiong Lin , Alex Church , Max Yang , Haoran Li , John Lloyd , Dandan Zhang , Nathan F. Lepora

Robot control policies learned in simulation do not often transfer well to the real world. Many existing solutions to this sim-to-real problem, such as the Grounded Action Transformation (GAT) algorithm, seek to correct for or ground these…

Robotics · Computer Science 2020-08-05 Siddharth Desai , Haresh Karnan , Josiah P. Hanna , Garrett Warnell , Peter Stone

In this paper, we address the problem of tactile sim-to-real policy transfer for contact-rich tasks. Existing methods primarily focus on vision-based sensors and emphasize image rendering quality while providing overly simplistic models of…

Robotics · Computer Science 2026-03-03 An Dang , Jayjun Lee , Mustafa Mukadam , X. Alice Wu , Bernadette Bucher , Manikantan Nambi , Nima Fazeli

Deep learning and reinforcement learning methods have been shown to enable learning of flexible and complex robot controllers. However, the reliance on large amounts of training data often requires data collection to be carried out in…

Robotics · Computer Science 2020-04-02 Zihan Ding , Nathan F. Lepora , Edward Johns

We propose a novel approach to the 'reality gap' problem, i.e., modifying a robot simulation so that its performance becomes more similar to observed real world phenomena. This problem arises whether the simulation is being used by human…

Robotics · Computer Science 2020-05-11 Damian Lyons , James Finocchiaro , Michael Novitzky , Christopher Korpela

Despite recent advances in Reinforcement Learning (RL), many problems, especially real-world tasks, remain prohibitively expensive to learn. To address this issue, several lines of research have explored how tasks, or data samples…

Robotics · Computer Science 2022-04-12 Yash Shukla , Christopher Thierauf , Ramtin Hosseini , Gyan Tatiya , Jivko Sinapov

Dexterous manipulation has seen remarkable progress in recent years, with policies capable of executing many complex and contact-rich tasks in simulation. However, transferring these policies from simulation to real world remains a…

Robotics · Computer Science 2025-05-05 Shuqi Zhao , Ke Yang , Yuxin Chen , Chenran Li , Yichen Xie , Xiang Zhang , Changhao Wang , Masayoshi Tomizuka

In recent years, reinforcement learning (RL) has shown remarkable success in robotics when a fast and accurate simulator is available for a given task. When using RL and simulation, more simulator realism is generally beneficial but becomes…

Robotics · Computer Science 2026-04-17 Yunfu Deng , Yuhao Li , Josiah P. Hanna

Simulation provides a safe and efficient way to generate useful data for learning complex robotic tasks. However, matching simulation and real-world dynamics can be quite challenging, especially for systems that have a large number of…

Robotics · Computer Science 2021-03-16 Visak Kumar , Sehoon Ha , C. Karen Liu

Large real-world robot datasets hold great potential to train generalist robot models, but scaling real-world human data collection is time-consuming and resource-intensive. Simulation has great potential in supplementing large-scale data,…