English
Related papers

Related papers: RealEngine: Simulating Autonomous Driving in Reali…

200 papers

Autonomous systems require identifying the environment and it has a long way to go before putting it safely into practice. In autonomous driving systems, the detection of obstacles and traffic lights are of importance as well as lane…

Robotics · Computer Science 2021-06-30 Namig Aliyev , Oguzhan Sezer , Mehmet Turan Guzel

We present a novel method for testing the safety of self-driving vehicles in simulation. We propose an alternative to sensor simulation, as sensor simulation is expensive and has large domain gaps. Instead, we directly simulate the outputs…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Kelvin Wong , Qiang Zhang , Ming Liang , Bin Yang , Renjie Liao , Abbas Sadat , Raquel Urtasun

Autonomous driving vehicles provide a vast potential for realizing use cases in the on-road and off-road domains. Consequently, remarkable solutions exist to autonomous systems' environmental perception and control. Nevertheless, proof of…

Robotics · Computer Science 2024-03-29 Patrick Wolf

End-to-end (E2E) autonomous driving (AD) models require diverse, high-quality data to perform well across various driving scenarios. However, collecting large-scale real-world data is expensive and time-consuming, making high-fidelity…

Robotics · Computer Science 2025-03-25 Junhao Ge , Zuhong Liu , Longteng Fan , Yifan Jiang , Jiaqi Su , Yiming Li , Zhejun Zhang , Siheng Chen

High-quality traffic flow generation is the core module in building simulators for autonomous driving. However, the majority of available simulators are incapable of replicating traffic patterns that accurately reflect the various features…

Rare and challenging driving scenarios are critical for autonomous vehicle development. Since they are difficult to encounter, simulating or generating them using generative models is a popular approach. Following previous efforts to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Arthur Hubert , Gamal Elghazaly , Raphaël Frank

Autonomous driving in an unregulated urban crowd is an outstanding challenge, especially, in the presence of many aggressive, high-speed traffic participants. This paper presents SUMMIT, a high-fidelity simulator that facilitates the…

Robotics · Computer Science 2020-03-16 Panpan Cai , Yiyuan Lee , Yuanfu Luo , David Hsu

The generation of corner cases has become increasingly crucial for efficiently testing autonomous vehicles prior to road deployment. However, existing methods struggle to accommodate diverse testing requirements and often lack the ability…

Robotics · Computer Science 2024-09-11 Qiujing Lu , Xuanhan Wang , Yiwei Jiang , Guangming Zhao , Mingyue Ma , Shuo Feng

Multi-sensor fusion plays a critical role in enhancing perception for autonomous driving, overcoming individual sensor limitations, and enabling comprehensive environmental understanding. This paper first formalizes multi-sensor fusion…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Chuheng Wei , Ziye Qin , Ziyan Zhang , Guoyuan Wu , Matthew J. Barth

The advent of Vision-Language Models (VLMs) has significantly advanced end-to-end autonomous driving, demonstrating powerful reasoning abilities for high-level behavior planning tasks. However, existing methods are often constrained by a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Weicheng Zheng , Xiaofei Mao , Nanfei Ye , Pengxiang Li , Kun Zhan , Xianpeng Lang , Hang Zhao

Simulation agents are essential for designing and testing systems that interact with humans, such as autonomous vehicles (AVs). These agents serve various purposes, from benchmarking AV performance to stress-testing system limits, but all…

Artificial Intelligence · Computer Science 2025-05-21 Daphne Cornelisse , Aarav Pandya , Kevin Joseph , Joseph Suárez , Eugene Vinitsky

Ensuring the quality of automated driving systems is a major challenge the automotive industry is facing. In this context, quality defines the degree to which an object meets expectations and requirements. Especially, automated vehicles at…

Software Engineering · Computer Science 2022-04-11 Barbara Schütt , Markus Steimle , Birte Kramer , Danny Behnecke , Eric Sax

Generating high-fidelity and controllable synthetic data is critical for advancing end-to-end autonomous driving, particularly for addressing the long tail of rare safety-critical scenarios. Existing occupancy-guided methods typically rely…

Robotics · Computer Science 2026-05-26 Haiming Zhang , Junfei Zhou , Feng Jiang , Jingzhong Li , Zhenglong Guo , Penglin Dai , Jifeng Dai , Yan Xie , Benjin Zhu

Predicting the future motion of surrounding agents is essential for autonomous vehicles (AVs) to operate safely in dynamic, human-robot-mixed environments. Context information, such as road maps and surrounding agents' states, provides…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Yang Zhou , Hao Shao , Letian Wang , Steven L. Waslander , Hongsheng Li , Yu Liu

Autonomous vehicles hold great promise in improving the future of transportation. The driving models used in these vehicles are based on neural networks, which can be difficult to validate. However, ensuring the safety of these models is…

Robotics · Computer Science 2023-09-14 Maximilian Zipfl , Sven Spickermann , J. Marius Zöllner

Recent advancements in video generation have substantially improved visual quality and temporal coherence, making these models increasingly appealing for applications such as autonomous driving, particularly in the context of driving…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Chun-Peng Chang , Chen-Yu Wang , Julian Schmidt , Holger Caesar , Alain Pagani

In the field of Autonomous Driving, the system controlling the vehicle can be seen as an agent acting in a complex environment and thus naturally fits into the modern framework of Reinforcement Learning. However, learning to drive can be a…

Artificial Intelligence · Computer Science 2018-11-26 Patrick Klose , Rudolf Mester

Comprehensive situational awareness is essential for autonomous vehicles operating in safety-critical environments, as it enables the identification and mitigation of potential risks. Although recent Multimodal Large Language Models (MLLMs)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Sainithin Artham , Shankar Gangisetty , Avijit Dasgupta , C. V. Jawahar

Autonomous vehicles (AVs) are being rapidly introduced into our lives. However, public misunderstanding and mistrust have become prominent issues hindering the acceptance of these driverless technologies. The primary objective of this study…

Human-Computer Interaction · Computer Science 2023-02-20 Zhijie Qiao , Helen Loeb , Venkata Gurrla , Matt Lebermann , Johannes Betz , Rahul Mangharam

Realistic scene reconstruction and view synthesis are essential for advancing autonomous driving systems by simulating safety-critical scenarios. 3D Gaussian Splatting excels in real-time rendering and static scene reconstructions but…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Mustafa Khan , Hamidreza Fazlali , Dhruv Sharma , Tongtong Cao , Dongfeng Bai , Yuan Ren , Bingbing Liu