English
Related papers

Related papers: Towards Mitigating Sim2Real Gaps: A Formal Quantit…

200 papers

Realistic physics engines play a crucial role for learning to manipulate deformable objects such as garments in simulation. By doing so, researchers can circumvent challenges such as sensing the deformation of the object in the realworld.…

Robotics · Computer Science 2025-12-23 David Blanco-Mulero , Oriol Barbany , Gokhan Alcan , Adrià Colomé , Carme Torras , Ville Kyrki

Simulators are indispensable for research in autonomous systems such as self-driving cars, autonomous robots, and drones. Despite significant progress in various simulation aspects, such as graphical realism, an evident gap persists between…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Stefanos Pasios , Nikos Nikolaidis

For the shape control of deformable free-form surfaces, simulation plays a crucial role in establishing the mapping between the actuation parameters and the deformed shapes. The differentiation of this forward kinematic mapping is usually…

Robotics · Computer Science 2024-05-16 Yingjun Tian , Guoxin Fang , Renbo Su , Weiming Wang , Simeon Gill , Andrew Weightman , Charlie C. L. Wang

The manual design of soft robots and their controllers is notoriously challenging, but it could be augmented---or, in some cases, entirely replaced---by automated design tools. Machine learning algorithms can automatically propose, test,…

The vast majority of stochastic simulation models are imperfect in that they fail to exactly emulate real system dynamics. The inexactness of the simulation model, or model discrepancy, can impact the predictive accuracy and usefulness of…

Methodology · Statistics 2017-07-21 Matthew Plumlee , Henry Lam

Simulations are valuable tools for empirically evaluating the properties of statistical methods and are primarily employed in methodological research to draw general conclusions about methods. In addition, they can often be useful to…

Other Statistics · Statistics 2025-10-08 Anne-Laure Boulesteix , Patrick Callahan , Luzia Hanssum , Vincent Gaertner , Eva Hoster

In order to mitigate the sample complexity of real-world reinforcement learning, common practice is to first train a policy in a simulator where samples are cheap, and then deploy this policy in the real world, with the hope that it…

Machine Learning · Computer Science 2024-10-29 Andrew Wagenmaker , Kevin Huang , Liyiming Ke , Byron Boots , Kevin Jamieson , Abhishek Gupta

One fundamental difficulty in robotic learning is the sim-real gap problem. In this work, we propose to use segmentation as the interface between perception and control, as a domain-invariant state representation. We identify two sources of…

Robotics · Computer Science 2020-05-19 Mengyuan Yan , Qingyun Sun , Iuri Frosio , Stephen Tyree , Jan Kautz

As NLP evaluation shifts from static benchmarks to multi-turn interactive settings, LLM-based simulators have become widely used as user proxies, serving two roles: generating user turns and providing evaluation signals. Yet, these…

Artificial Intelligence · Computer Science 2026-03-13 Xuhui Zhou , Weiwei Sun , Qianou Ma , Yiqing Xie , Jiarui Liu , Weihua Du , Sean Welleck , Yiming Yang , Graham Neubig , Sherry Tongshuang Wu , Maarten Sap

With the increasing safety validation requirements for the release of a self-driving car, alternative approaches, such as simulation-based testing, are emerging in addition to conventional real-world testing. In order to rely on virtual…

Robotics · Computer Science 2021-06-22 Anthony Ngo , Max Paul Bauer , Michael Resch

Sim-to-real gap has long posed a significant challenge for robot learning in simulation, preventing the deployment of learned models in the real world. Previous work has primarily focused on domain randomization and system identification to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Ziyang Xie , Zhizheng Liu , Zhenghao Peng , Wayne Wu , Bolei Zhou

In the context of autonomous navigation of terrestrial robots, the creation of realistic models for agent dynamics and sensing is a widespread habit in the robotics literature and in commercial applications, where they are used for model…

To address the computational challenges of Model Predictive Control (MPC), recent research has studied using imitation learning to approximate MPC with a computationally efficient Deep Neural Network (DNN). However, this introduces a common…

Systems and Control · Electrical Eng. & Systems 2026-03-19 Seungtaek Kim , Jonghyup Lee , Kyoungseok Han , Seibum B. Choi

Zero-shot sim-to-real transfer of tasks with complex dynamics is a highly challenging and unsolved problem. A number of solutions have been proposed in recent years, but we have found that many works do not present a thorough evaluation in…

Robotics · Computer Science 2020-08-18 Eugene Valassakis , Zihan Ding , Edward Johns

Despite the substantial progress in deep learning, its adoption in industrial robotics projects remains limited, primarily due to challenges in data acquisition and labeling. Previous sim2real approaches using domain randomization require…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Kaixin Bai , Lei Zhang , Zhaopeng Chen , Fang Wan , Jianwei Zhang

Simulation-based verification algorithms can provide formal safety guarantees for nonlinear and hybrid systems. The previous algorithms rely on user provided model annotations called discrepancy function, which are crucial for computing…

Systems and Control · Computer Science 2015-02-09 Chuchu Fan , Sayan Mitra

Many simulation based Bounded Model Checking approaches to System Level Formal Verification (SLFV) have been devised. Typically such approaches exploit the capability of simulators to save computation time by saving and restoring the state…

Software Engineering · Computer Science 2015-09-25 Toni Mancini , Federico Mari , Annalisa Massini , Igor Melatti , Enrico Tronci

The DARPA Transfer from Imprecise and Abstract Models to Autonomous Technologies (TIAMAT) program aims to address rapid and robust transfer of autonomy technologies across dynamic and complex environments, goals, and platforms. Existing…

Robotics · Computer Science 2025-03-17 Erfaun Noorani , Zachary Serlin , Ben Price , Alvaro Velasquez

Policies trained in simulation often fail when transferred to the real world due to the `reality gap' where the simulator is unable to accurately capture the dynamics and visual properties of the real world. Current approaches to tackle…

Robotics · Computer Science 2021-05-21 Yuqing Du , Olivia Watkins , Trevor Darrell , Pieter Abbeel , Deepak Pathak

As user simulators are increasingly used for interactive training and evaluation of AI assistants, it is essential that they represent the diverse behaviors of real users. While existing works train user simulators to generate human-like…

Computation and Language · Computer Science 2026-05-11 Shuhaib Mehri , Philippe Laban , Sumuk Shashidhar , Marwa Abdulhai , Sergey Levine , Michel Galley , Dilek Hakkani-Tür