English
Related papers

Related papers: RealEngine: Simulating Autonomous Driving in Reali…

200 papers

In the past two decades, autonomous driving has been catalyzed into reality by the growing capabilities of machine learning. This paradigm shift possesses significant potential to transform the future of mobility and reshape our society as…

Robotics · Computer Science 2022-10-21 Richard Chakra

Simulation has the potential to massively scale evaluation of self-driving systems enabling rapid development as well as safe deployment. To close the gap between simulation and the real world, we need to simulate realistic multi-agent…

Robotics · Computer Science 2021-01-19 Simon Suo , Sebastian Regalado , Sergio Casas , Raquel Urtasun

Autonomous driving relies on a huge volume of real-world data to be labeled to high precision. Alternative solutions seek to exploit driving simulators that can generate large amounts of labeled data with a plethora of content variations.…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 David Acuna , Jonah Philion , Sanja Fidler

Learning contextual and spatial environmental representations enhances autonomous vehicle's hazard anticipation and decision-making in complex scenarios. Recent perception systems enhance spatial understanding with sensor fusion but often…

Robotics · Computer Science 2024-01-18 Shoaib Azam , Farzeen Munir , Ville Kyrki , Moongu Jeon , Witold Pedrycz

Autonomous driving has rapidly evolved through synergistic developments in hardware and artificial intelligence. This comprehensive review investigates traffic datasets and simulators as dual pillars supporting autonomous vehicle (AV)…

Robotics · Computer Science 2025-08-28 Supriya Sarker , Brent Maples , Iftekharul Islam , Muyang Fan , Christos Papadopoulos , Weizi Li

Simulation forms the backbone of modern self-driving development. Simulators help develop, test, and improve driving systems without putting humans, vehicles, or their environment at risk. However, simulators face a major challenge: They…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Shuhan Tan , Boris Ivanovic , Xinshuo Weng , Marco Pavone , Philipp Kraehenbuehl

Machine learning based autonomous driving systems often face challenges with safety-critical scenarios that are rare in real-world data, hindering their large-scale deployment. While increasing real-world training data coverage could…

Machine Learning · Computer Science 2024-09-13 Yuan Yin , Pegah Khayatan , Éloi Zablocki , Alexandre Boulch , Matthieu Cord

Even as technology and performance gains are made in the sphere of automated driving, safety concerns remain. Vehicle simulation has long been seen as a tool to overcome the cost associated with a massive amount of on-road testing for…

Robotics · Computer Science 2024-05-14 Joe Beck , Shean Huff , Subhadeep Chakraborty

We propose FreeSim, a camera simulation method for autonomous driving. FreeSim emphasizes high-quality rendering from viewpoints beyond the recorded ego trajectories. In such viewpoints, previous methods have unacceptable degradation…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Lue Fan , Hao Zhang , Qitai Wang , Hongsheng Li , Zhaoxiang Zhang

This paper addresses the challenge of ensuring realistic traffic conditions by proposing a methodology that systematically identifies traffic simulation requirements. Using a structured approach based on sub-goals in each study phase,…

Software Engineering · Computer Science 2025-10-17 Sven Tarlowski , Lutz Eckstein

Visual augmentation has become a crucial technique for enhancing the visual robustness of imitation learning. However, existing methods are often limited by prerequisites such as camera calibration or the need for controlled environments…

Robotics · Computer Science 2025-07-15 Chengbo Yuan , Suraj Joshi , Shaoting Zhu , Hang Su , Hang Zhao , Yang Gao

Simulators play a crucial role in autonomous driving, offering significant time, cost, and labor savings. Over the past few years, the number of simulators for autonomous driving has grown substantially. However, there is a growing concern…

Robotics · Computer Science 2024-03-26 Yueyuan Li , Wei Yuan , Songan Zhang , Weihao Yan , Qiyuan Shen , Chunxiang Wang , Ming Yang

Safely interacting with humans is a significant challenge for autonomous driving. The performance of this interaction depends on machine learning-based modules of an autopilot, such as perception, behavior prediction, and planning. These…

Artificial Intelligence · Computer Science 2020-12-01 Jay Shenoy , Edward Kim , Xiangyu Yue , Taesung Park , Daniel Fremont , Alberto Sangiovanni-Vincentelli , Sanjit Seshia

Controllable synthetic data generation can substantially lower the annotation cost of training data. Prior works use diffusion models to generate driving images conditioned on the 3D object layout. However, those models are trained on…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Yunsong Zhou , Michael Simon , Zhenghao Peng , Sicheng Mo , Hongzi Zhu , Minyi Guo , Bolei Zhou

With the rapid advancement of autonomous driving technology, a lack of data has become a major obstacle to enhancing perception model accuracy. Researchers are now exploring controllable data generation using world models to diversify…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Xinqing Li , Ruiqi Song , Qingyu Xie , Ye Wu , Nanxin Zeng , Yunfeng Ai

Detecting a diverse range of objects under various driving scenarios is essential for the effectiveness of autonomous driving systems. However, the real-world data collected often lacks the necessary diversity presenting a long-tail…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Aqeel Anwar , Tae Eun Choe , Zian Wang , Sanja Fidler , Minwoo Park

Virtual scenario-based testing methods to validate autonomous driving systems are predominantly centred around collision avoidance, and lack a comprehensive approach to evaluate optimal driving behaviour holistically. Furthermore, current…

Robotics · Computer Science 2024-08-01 Kethan Reddy , Elias Nassif , Panagiotis Angeloudis , Mohammed Quddus , Washington Ochieng

Simulation plays a crucial role in the rapid development and safe deployment of autonomous vehicles. Realistic traffic agent models are indispensable for bridging the gap between simulation and the real world. Many existing approaches for…

While self-supervised pretraining has reduced vision systems' reliance on synthetic data, simulation remains an indispensable tool for closed-loop optimization and rigorous out-of-distribution (OOD) evaluation. However, modern simulation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Wufei Ma , Chloe Wang , Siyi Chen , Jiawei Peng , Patrick Li , Alan Yuille

The adoption of self-driving cars will certainly revolutionize our lives, even though they may take more time to become fully autonomous than initially predicted. The first vehicles are already present in certain cities of the world, as…

Human-Computer Interaction · Computer Science 2023-06-07 Carlos Crispim-Junior , Romain Guesdon , Christophe Jallais , Florent Laroche , Stephanie Souche-Le Corvec , Laure Tougne Rodet