English
Related papers

Related papers: Quantification of Sim2Real Gap via Neural Simulati…

200 papers

Learning policies in simulation is promising for reducing human effort when training robot controllers. This is especially true for soft robots that are more adaptive and safe but also more difficult to accurately model and control. The…

Robotics · Computer Science 2021-07-27 Kun Wang , Mridul Aanjaneya , Kostas Bekris

This paper presents a correspondence-free, function-based sim-to-real learning method for controlling deformable freeform surfaces. Unlike traditional sim-to-real transfer methods that strongly rely on marker points with full…

The discrepancies between reality and simulation impede the optimisation and scalability of solid-state quantum devices. Disorder induced by the unpredictable distribution of material defects is one of the major contributions to the reality…

Reinforcement learning (RL) is playing an increasingly important role in fields such as robotic control and autonomous driving. However, the gap between simulation and the real environment remains a major obstacle to the practical…

Machine Learning · Computer Science 2025-06-17 Zhilin Lin , Shiliang Sun

In sim-to-real Reinforcement Learning (RL), a policy is trained in a simulated environment and then deployed on the physical system. The main challenge of sim-to-real RL is to overcome the reality gap - the discrepancies between the real…

Robotics · Computer Science 2023-06-13 Nghia Vuong , Quang-Cuong Pham

Automated driving systems are an integral part of the automotive industry. Tools such as Robot Operating System and simulators support their development. However, in the end, the developers must test their algorithms on a real vehicle. To…

Robotics · Computer Science 2024-12-17 Jiri Vlasak , Jaroslav Klapálek , Adam Kollarčík , Michal Sojka , Zdeněk Hanzálek

The robotics field is evolving towards data-driven, end-to-end learning, inspired by multimodal large models. However, reliance on expensive real-world data limits progress. Simulators offer cost-effective alternatives, but the gap between…

Robotics · Computer Science 2025-12-23 Hongwei Fan , Hang Dai , Jiyao Zhang , Jinzhou Li , Qiyang Yan , Yujie Zhao , Mingju Gao , Jinghang Wu , Hao Tang , Hao Dong

Recently Quantum Computation has generated a lot of interest due to the discovery of a quantum algorithm which can factor large numbers in polynomial time. The usefulness of a quantum com puter is limited by the effect of errors. Simulation…

Quantum Physics · Physics 2007-05-23 Kevin M. Obenland , Alvin M. Despain

The main challenge in learning image-conditioned robotic policies is acquiring a visual representation conducive to low-level control. Due to the high dimensionality of the image space, learning a good visual representation requires a…

Robotics · Computer Science 2024-07-03 Albert Yu , Adeline Foote , Raymond Mooney , Roberto Martín-Martín

Policies trained in simulation often fail when transferred to the real world due to the `reality gap' where the simulator is unable to accurately capture the dynamics and visual properties of the real world. Current approaches to tackle…

Robotics · Computer Science 2021-05-21 Yuqing Du , Olivia Watkins , Trevor Darrell , Pieter Abbeel , Deepak Pathak

Precise robotic grasping of several novel objects is a huge challenge in manufacturing, automation, and logistics. Most of the current methods for model-free grasping are disadvantaged by the sparse data in grasping datasets and by errors…

Robotics · Computer Science 2023-01-31 Lei Zhang , Kaixin Bai , Zhaopeng Chen , Yunlei Shi , Jianwei Zhang

Advancements in graphics technology has increased the use of simulated data for training machine learning models. However, the simulated data often differs from real-world data, creating a distribution gap that can decrease the efficacy of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Charles Y Zhang , Ashish Shrivastava

Contact-rich manipulation tasks often exhibit a large sim-to-real gap. For instance, industrial assembly tasks frequently involve tight insertions where the clearance is less than 0.1 mm and can even be negative when dealing with a…

Robotics · Computer Science 2024-03-04 Xiang Zhang , Masayoshi Tomizuka , Hui Li

As the computer vision matures into a systems science and engineering discipline, there is a trend in leveraging latest advances in computer graphics simulations for performance evaluation, learning, and inference. However, there is an open…

Computer Vision and Pattern Recognition · Computer Science 2015-12-04 V S R Veeravasarapu , Rudra Narayan Hota , Constantin Rothkopf , Ramesh Visvanathan

A considerable amount of research is concerned with the generation of realistic sensor data. LiDAR point clouds are generated by complex simulations or learned generative models. The generated data is usually exploited to enable or improve…

Computer Vision and Pattern Recognition · Computer Science 2022-09-01 Larissa T. Triess , Christoph B. Rist , David Peter , J. Marius Zöllner

In this work we investigate and demonstrate benefits of a Bayesian approach to imitation learning from multiple sensor inputs, as applied to the task of opening office doors with a mobile manipulator. Augmenting policies with additional…

Robotics · Computer Science 2022-02-16 Yuqing Du , Daniel Ho , Alexander A. Alemi , Eric Jang , Mohi Khansari

Humanoid whole-body control (WBC) policies trained in simulation often suffer from the sim-to-real gap, which fundamentally arises from simulator inductive bias, the inherent assumptions and limitations of any single simulator. These biases…

Robotics · Computer Science 2025-10-15 Zixing Lei , Zibo Zhou , Sheng Yin , Yueru Chen , Qingyao Xu , Weixin Li , Yunhong Wang , Bowei Tang , Wei Jing , Siheng Chen

Cotraining with demonstration data generated both in simulation and on real hardware has emerged as a promising recipe for scaling imitation learning in robotics. This work seeks to elucidate basic principles of this sim-and-real cotraining…

Robotics · Computer Science 2025-08-07 Adam Wei , Abhinav Agarwal , Boyuan Chen , Rohan Bosworth , Nicholas Pfaff , Russ Tedrake

Learning-based robotic systems demand rigorous validation to assure reliable performance, but extensive real-world testing is often prohibitively expensive, and if conducted may still yield insufficient data for high-confidence guarantees.…

Robotics · Computer Science 2025-09-05 Rachel Luo , Heng Yang , Michael Watson , Apoorva Sharma , Sushant Veer , Edward Schmerling , Marco Pavone