English
Related papers

Related papers: Towards Sim2Real Transfer of Autonomy Algorithms u…

200 papers

The concept of a digital twin (DT) plays a pivotal role in the ongoing digital transformation and has achieved significant strides for various wireless applications in recent years. In particular, the field of autonomous vehicles is a…

Networking and Internet Architecture · Computer Science 2024-01-18 Kui Wang , Tao Yu , Zongdian Li , Kei Sakaguchi , Omar Hashash , Walid Saad

End-to-end approaches to autonomous driving have high sample complexity and are difficult to scale to realistic urban driving. Simulation can help end-to-end driving systems by providing a cheap, safe, and diverse training environment. Yet…

Robotics · Computer Science 2018-12-14 Matthias Müller , Alexey Dosovitskiy , Bernard Ghanem , Vladlen Koltun

In the vehicular mixed reality (MR) Metaverse, the distance between physical and virtual entities can be overcome by fusing the physical and virtual environments with multi-dimensional communications in autonomous driving systems. Assisted…

Artificial Intelligence · Computer Science 2023-02-17 Minrui Xu , Dusit Niyato , Junlong Chen , Hongliang Zhang , Jiawen Kang , Zehui Xiong , Shiwen Mao , Zhu Han

Automated driving systems are an integral part of the automotive industry. Tools such as Robot Operating System and simulators support their development. However, in the end, the developers must test their algorithms on a real vehicle. To…

Robotics · Computer Science 2024-12-17 Jiri Vlasak , Jaroslav Klapálek , Adam Kollarčík , Michal Sojka , Zdeněk Hanzálek

Autonomous driving promises to transform road transport. Multi-vehicle and multi-lane scenarios, however, present unique challenges due to constrained navigation and unpredictable vehicle interactions. Learning-based methods---such as deep…

Robotics · Computer Science 2020-02-12 Rupert Mitchell , Jenny Fletcher , Jacopo Panerati , Amanda Prorok

Sim-to-real is a mainstream method to cope with the large number of trials needed by typical deep reinforcement learning methods. However, transferring a policy trained in simulation to actual hardware remains an open challenge due to the…

Robotics · Computer Science 2023-12-11 Shimpei Masuda , Kuniyuki Takahashi

Sim-to-real gap has long posed a significant challenge for robot learning in simulation, preventing the deployment of learned models in the real world. Previous work has primarily focused on domain randomization and system identification to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Ziyang Xie , Zhizheng Liu , Zhenghao Peng , Wayne Wu , Bolei Zhou

Despite recent advances in Reinforcement Learning (RL), many problems, especially real-world tasks, remain prohibitively expensive to learn. To address this issue, several lines of research have explored how tasks, or data samples…

Robotics · Computer Science 2022-04-12 Yash Shukla , Christopher Thierauf , Ramtin Hosseini , Gyan Tatiya , Jivko Sinapov

Reinforcement learning encounters many challenges when applied directly in the real world. Sim-to-real transfer is widely used to transfer the knowledge learned from simulation to the real world. Domain randomization -- one of the most…

Machine Learning · Computer Science 2022-03-15 Xiaoyu Chen , Jiachen Hu , Chi Jin , Lihong Li , Liwei Wang

Societal-scale deployment of autonomous vehicles requires them to coexist with human drivers, necessitating mutual understanding and coordination among these entities. However, purely real-world or simulation-based experiments cannot be…

Robotics · Computer Science 2025-02-04 Tanmay Vilas Samak , Chinmay Vilas Samak , Venkat Narayan Krovi

We introduce real-is-sim, a new approach to integrating simulation into behavior cloning pipelines. In contrast to real-only methods, which lack the ability to safely test policies before deployment, and sim-to-real methods, which require…

High-fidelity and controllable 3D simulation is essential for addressing the long-tail data scarcity in Autonomous Driving (AD), yet existing methods struggle to simultaneously achieve photorealistic rendering and interactive traffic…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Zhiyuan Liu , Daocheng Fu , Pinlong Cai , Lening Wang , Ying Liu , Yilong Ren , Botian Shi , Jianqiang Wang

Recent advances in autonomous system simulation platforms have significantly enhanced the safe and scalable testing of driving policies. However, existing simulators do not yet fully meet the needs of future transportation…

Scenario-based testing using simulations is a cornerstone of Autonomous Vehicles (AVs) software validation. So far, developers needed to choose between low-fidelity 2D simulators to explore the scenario space efficiently, and high-fidelity…

Robotics · Computer Science 2025-05-21 Marc Kaufeld , Korbinian Moller , Alessio Gambi , Paolo Arcaini , Johannes Betz

Designing and evaluating in-vehicle interfaces requires experimental platforms that combine ecological validity with experimental control. Driving simulators are widely used for this purpose. However, they face a fundamental trade-off:…

Human-Computer Interaction · Computer Science 2026-03-10 Patrick Ebel , Michał Patryk Miazga , Martin Lorenz , Timur Getselev , Pavlo Bazilinskyy , Celine Conzen

Ensuring the safety of self-driving cars remains a major challenge due to the complexity and unpredictability of real-world driving environments. Traditional testing methods face significant limitations, such as the oracle problem, which…

Robotics · Computer Science 2025-10-09 Tony Zhang , Burak Kantarci , Umair Siddique

With growing complexity and criticality of automated driving functions in road traffic and their operational design domains (ODD), there is increasing demand for covering significant proportions of development, validation, and verification…

Recent success in legged robot locomotion is attributed to the integration of reinforcement learning and physical simulators. However, these policies often encounter challenges when deployed in real-world environments due to sim-to-real…

Robotics · Computer Science 2025-06-04 Shaoting Zhu , Linzhan Mou , Derun Li , Baijun Ye , Runhan Huang , Hang Zhao

Widespread adoption of autonomous vehicles will not become a reality until solutions are developed that enable these intelligent agents to co-exist with humans. This includes safely and efficiently interacting with human-driven vehicles,…

Robotics · Computer Science 2021-07-05 Behrad Toghi , Rodolfo Valiente , Dorsa Sadigh , Ramtin Pedarsani , Yaser P. Fallah

This paper presents a safe imitation learning approach for autonomous vehicle driving, with attention on real-life human driving data and experimental validation. In order to increase occupant's acceptance and gain drivers' trust, the…

Systems and Control · Electrical Eng. & Systems 2021-10-11 Flavia Sofia Acerbo , Mohsen Alirezaei , Herman Van der Auweraer , Tong Duy Son