English
Related papers

Related papers: UniSim: A Neural Closed-Loop Sensor Simulator

200 papers

In the past few decades, autonomous driving algorithms have made significant progress in perception, planning, and control. However, evaluating individual components does not fully reflect the performance of entire systems, highlighting the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Hongyu Zhou , Longzhong Lin , Jiabao Wang , Yichong Lu , Dongfeng Bai , Bingbing Liu , Yue Wang , Andreas Geiger , Yiyi Liao

As self-driving systems become better, simulating scenarios where the autonomy stack may fail becomes more important. Traditionally, those scenarios are generated for a few scenes with respect to the planning module that takes ground-truth…

Self-driving vehicles (SDVs) must be rigorously tested on a wide range of scenarios to ensure safe deployment. The industry typically relies on closed-loop simulation to evaluate how the SDV interacts on a corpus of synthetic and real…

Robotics · Computer Science 2023-11-03 Jay Sarva , Jingkang Wang , James Tu , Yuwen Xiong , Sivabalan Manivasagam , Raquel Urtasun

Development of applications related to closed-loop control requires either testing on the field or on a realistic simulator, with the latter being more convenient, inexpensive, safe, and leading to shorter development cycles. To address…

Benchmarking vision-based driving policies is challenging. On one hand, open-loop evaluation with real data is easy, but these results do not reflect closed-loop performance. On the other, closed-loop evaluation is possible in simulation,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Daniel Dauner , Marcel Hallgarten , Tianyu Li , Xinshuo Weng , Zhiyu Huang , Zetong Yang , Hongyang Li , Igor Gilitschenski , Boris Ivanovic , Marco Pavone , Andreas Geiger , Kashyap Chitta

Simulation is essential to validate autonomous driving systems. However, a simple simulation, even for an extremely high number of simulated miles or hours, is not sufficient. We need well-founded criteria showing that simulation does…

Software Engineering · Computer Science 2023-01-24 Changwen Li , Joseph Sifakis , Qiang Wang , Rongjie Yan , Jian Zhang

Existing evaluation paradigms for Autonomous Vehicles (AVs) face critical limitations. Real-world evaluation is often challenging due to safety concerns and a lack of reproducibility, whereas closed-loop simulation can face insufficient…

Traffic simulation is essential for autonomous vehicle (AV) development, enabling comprehensive safety evaluation across diverse driving conditions. However, traditional rule-based simulators struggle to capture complex human interactions,…

Self-driving vehicles (SDVs) require accurate calibration of LiDARs and cameras to fuse sensor data accurately for autonomy. Traditional calibration methods typically leverage fiducials captured in a controlled and structured scene and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Ze Yang , George Chen , Haowei Zhang , Kevin Ta , Ioan Andrei Bârsan , Daniel Murphy , Sivabalan Manivasagam , Raquel Urtasun

We present a versatile NeRF-based simulator for testing autonomous driving (AD) software systems, designed with a focus on sensor-realistic closed-loop evaluation and the creation of safety-critical scenarios. The simulator learns from…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 William Ljungbergh , Adam Tonderski , Joakim Johnander , Holger Caesar , Kalle Åström , Michael Felsberg , Christoffer Petersson

Evaluating the performance of autonomous vehicle planning algorithms necessitates simulating long-tail safety-critical traffic scenarios. However, traditional methods for generating such scenarios often fall short in terms of…

Robotics · Computer Science 2024-08-08 Wei-Jer Chang , Francesco Pittaluga , Masayoshi Tomizuka , Wei Zhan , Manmohan Chandraker

We tackle the problem of producing realistic simulations of LiDAR point clouds, the sensor of preference for most self-driving vehicles. We argue that, by leveraging real data, we can simulate the complex world more realistically compared…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Sivabalan Manivasagam , Shenlong Wang , Kelvin Wong , Wenyuan Zeng , Mikita Sazanovich , Shuhan Tan , Bin Yang , Wei-Chiu Ma , Raquel Urtasun

Closed-loop simulation environments play a crucial role in the validation and enhancement of autonomous driving systems (ADS). However, certain challenges warrant significant attention, including balancing simulation accuracy with duration,…

Robotics · Computer Science 2025-02-14 Daocheng Fu , Naiting Zhong , Xu Han , Pinlong Cai , Licheng Wen , Song Mao , Botian Shi , Yu Qiao

Developing and testing algorithms for autonomous vehicles in real world is an expensive and time consuming process. Also, in order to utilize recent advances in machine intelligence and deep learning we need to collect a large amount of…

Robotics · Computer Science 2017-07-19 Shital Shah , Debadeepta Dey , Chris Lovett , Ashish Kapoor

Extracting interesting scenarios from real-world data as well as generating failure cases is important for the development and testing of autonomous systems. We propose efficient mechanisms to both characterize and generate testing…

Simulation stands as a cornerstone for safe and efficient autonomous driving development. At its core a simulation system ought to produce realistic, reactive, and controllable traffic patterns. In this paper, we propose ProSim, a…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Shuhan Tan , Boris Ivanovic , Yuxiao Chen , Boyi Li , Xinshuo Weng , Yulong Cao , Philipp Krähenbühl , Marco Pavone

Increasing the implemented SAE level of autonomy in road vehicles requires extensive simulations and verifications in a realistic simulation environment before proving ground and public road testing. The level of detail in the simulation…

Robotics · Computer Science 2023-06-02 Mustafa Ridvan Cantas , Levent Guvenc

There are many artificial intelligence algorithms for autonomous driving, but directly installing these algorithms on vehicles is unrealistic and expensive. At the same time, many of these algorithms need an environment to train and…

Robotics · Computer Science 2023-01-03 Wei Cao , Liguo Zhou , Yuhong Huang , Alois Knoll

Scenario-based testing for automated driving systems (ADS) must be able to simulate traffic scenarios that rely on interactions with other vehicles. Although many languages for high-level scenario modelling have been proposed, they lack the…

Realistic and controllable simulation is critical for advancing end-to-end autonomous driving, yet existing approaches often struggle to support novel view synthesis under large viewpoint changes or to ensure geometric consistency. We…

‹ Prev 1 2 3 10 Next ›