English
Related papers

Related papers: RealEngine: Simulating Autonomous Driving in Reali…

200 papers

Scenario-based testing using simulations is a cornerstone of Autonomous Vehicles (AVs) software validation. So far, developers needed to choose between low-fidelity 2D simulators to explore the scenario space efficiently, and high-fidelity…

Robotics · Computer Science 2025-05-21 Marc Kaufeld , Korbinian Moller , Alessio Gambi , Paolo Arcaini , Johannes Betz

Simulation has played an important role in efficiently evaluating self-driving vehicles in terms of scalability. Existing methods mostly rely on heuristic-based simulation, where traffic participants follow certain human-encoded rules that…

Robotics · Computer Science 2022-08-10 Wei-Jer Chang , Yeping Hu , Chenran Li , Wei Zhan , Masayoshi Tomizuka

Simulators are an essential tool for behavioural and interaction research on driving, due to the safety, cost, and experimental control issues of on-road driving experiments. The most advanced simulators use expensive 360 degree projections…

Human-Computer Interaction · Computer Science 2022-01-10 Gustavo Silvera , Abhijat Biswas , Henny Admoni

We describe an open-source simulator that creates sensor irradiance and sensor images of typical automotive scenes in urban settings. The purpose of the system is to support camera design and testing for automotive applications. The user…

Computer Vision and Pattern Recognition · Computer Science 2019-02-13 Zhenyi Liu , Minghao Shen , Jiaqi Zhang , Shuangting Liu , Henryk Blasinski , Trisha Lian , Brian Wandell

Microscopic traffic simulation has become an important tool for autonomous driving training and testing. Although recent data-driven approaches advance realistic behavior generation, their learning still relies primarily on a single…

Artificial Intelligence · Computer Science 2025-03-11 Shenyu Zhang , Jiaguo Tian , Zhengbang Zhu , Shan Huang , Jucheng Yang , Weinan Zhang

Developing and testing algorithms for autonomous vehicles in real world is an expensive and time consuming process. Also, in order to utilize recent advances in machine intelligence and deep learning we need to collect a large amount of…

Robotics · Computer Science 2017-07-19 Shital Shah , Debadeepta Dey , Chris Lovett , Ashish Kapoor

Over the past few years there is a growing interest in the learning-based self driving system. To ensure safety, such systems are first developed and validated in simulators before being deployed in the real world. However, most of the…

Robotics · Computer Science 2021-03-15 Quanyi Li , Zhenghao Peng , Qihang Zhang , Chunxiao Liu , Bolei Zhou

Today's driving world models can generate remarkably realistic dash-cam videos, yet no single model excels universally. Some generate photorealistic textures but violate basic physics; others maintain geometric consistency but fail when…

Diffusion models have made substantial progress in facilitating image generation and editing. As the technology matures, we see its potential in the context of driving simulations to enhance the simulated experience. In this paper, we…

Human-Computer Interaction · Computer Science 2024-10-08 Fanjun Bu , Hiroshi Yasuda

Recent advancements in world models have revolutionized dynamic environment simulation, allowing systems to foresee future states and assess potential actions. In autonomous driving, these capabilities help vehicles anticipate the behavior…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Anthony Chen , Wenzhao Zheng , Yida Wang , Xueyang Zhang , Kun Zhan , Peng Jia , Kurt Keutzer , Shanghang Zhang

With the increasing integration of intelligent driving functions into serial-produced vehicles, ensuring their functionality and robustness poses greater challenges. Compared to traditional road testing, scenario-based virtual testing…

Robotics · Computer Science 2025-10-29 Li Li , Tobias Brinkmann , Till Temmen , Markus Eisenbarth , Jakob Andert

Extracting interesting scenarios from real-world data as well as generating failure cases is important for the development and testing of autonomous systems. We propose efficient mechanisms to both characterize and generate testing…

Simulation is an essential tool to develop and benchmark autonomous vehicle planning software in a safe and cost-effective manner. However, realistic simulation requires accurate modeling of nuanced and complex multi-agent interactive…

Designing and evaluating in-vehicle interfaces requires experimental platforms that combine ecological validity with experimental control. Driving simulators are widely used for this purpose. However, they face a fundamental trade-off:…

Human-Computer Interaction · Computer Science 2026-03-10 Patrick Ebel , Michał Patryk Miazga , Martin Lorenz , Timur Getselev , Pavlo Bazilinskyy , Celine Conzen

There are many artificial intelligence algorithms for autonomous driving, but directly installing these algorithms on vehicles is unrealistic and expensive. At the same time, many of these algorithms need an environment to train and…

Robotics · Computer Science 2023-01-03 Wei Cao , Liguo Zhou , Yuhong Huang , Alois Knoll

In this study, we introduce the DriveEnv-NeRF framework, which leverages Neural Radiance Fields (NeRF) to enable the validation and faithful forecasting of the efficacy of autonomous driving agents in a targeted real-world scene. Standard…

Robotics · Computer Science 2024-05-31 Mu-Yi Shen , Chia-Chi Hsu , Hao-Yu Hou , Yu-Chen Huang , Wei-Fang Sun , Chia-Che Chang , Yu-Lun Liu , Chun-Yi Lee

Motion forecasting for agents in autonomous driving is highly challenging due to the numerous possibilities for each agent's next action and their complex interactions in space and time. In real applications, motion forecasting takes place…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Nan Song , Bozhou Zhang , Xiatian Zhu , Li Zhang

Simulation is an integral part in the process of developing autonomous vehicles and advantageous for training, validation, and verification of driving functions. Even though simulations come with a series of benefits compared to real-world…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Ferdinand Mütsch , Helen Gremmelmaier , Nicolas Becker , Daniel Bogdoll , Marc René Zofka , J. Marius Zöllner

Diffusion models are advancing autonomous driving by enabling realistic data synthesis, predictive end-to-end planning, and closed-loop simulation, with a primary focus on temporally consistent generation. However, large-scale 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Yu Yang , Alan Liang , Jianbiao Mei , Yukai Ma , Yong Liu , Gim Hee Lee

For end-to-end autonomous driving (E2E-AD), the evaluation system remains an open problem. Existing closed-loop evaluation protocols usually rely on simulators like CARLA being less realistic; while NAVSIM using real-world vision data, yet…

Robotics · Computer Science 2024-12-16 Junqi You , Xiaosong Jia , Zhiyuan Zhang , Yutao Zhu , Junchi Yan