English
Related papers

Related papers: UniSim: A Neural Closed-Loop Sensor Simulator

200 papers

In the simulation-based testing and evaluation of autonomous vehicles (AVs), how background vehicles (BVs) drive directly influences the AV's driving behavior and further impacts the testing result. Existing simulation platforms use either…

Systems and Control · Electrical Eng. & Systems 2021-02-05 Lin Liu , Shuo Feng , Yiheng Feng , Xichan Zhu , Henry X. Liu

The emergence of 3D Gaussian Splatting for fast and high-quality novel view synthesize has opened up the possibility to construct photo-realistic simulations from video for robotic reinforcement learning. While the approach has been…

Robotics · Computer Science 2024-10-28 Liyou Zhou , Oleg Sinavski , Athanasios Polydoros

A primary hurdle of autonomous driving in urban environments is understanding complex and long-tail scenarios, such as challenging road conditions and delicate human behaviors. We introduce DriveVLM, an autonomous driving system leveraging…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Xiaoyu Tian , Junru Gu , Bailin Li , Yicheng Liu , Yang Wang , Zhiyong Zhao , Kun Zhan , Peng Jia , Xianpeng Lang , Hang Zhao

Simulation has played an important role in efficiently evaluating self-driving vehicles in terms of scalability. Existing methods mostly rely on heuristic-based simulation, where traffic participants follow certain human-encoded rules that…

Robotics · Computer Science 2022-08-10 Wei-Jer Chang , Yeping Hu , Chenran Li , Wei Zhan , Masayoshi Tomizuka

Autonomous vehicle (AV) planners must undergo rigorous evaluation before widespread deployment on public roads, particularly to assess their robustness against the uncertainty of human behaviors. While recent advancements in data-driven…

Artificial Intelligence · Computer Science 2025-06-06 Augusto Mondelli , Yueshan Li , Alessandro Zanardi , Emilio Frazzoli

Autonomous Vehicles (AV)'s wide-scale deployment appears imminent despite many safety challenges yet to be resolved. The modern autonomous vehicles will undoubtedly include machine learning and probabilistic techniques that add significant…

Robotics · Computer Science 2022-03-16 Dhanoop Karunakaran , Julie Stephany Berrio , Stewart Worrall , Eduardo Nebot

With increasing physical threats in recent years targeted at critical infrastructures, it is crucial to establish a reliable threat monitoring system integrating video surveillance and digital sensors based on cutting-edge technologies. A…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Zenjie Li , Barry Norton

Closed-loop simulation is essential for advancing end-to-end autonomous driving systems. Contemporary sensor simulation methods, such as NeRF and 3DGS, rely predominantly on conditions closely aligned with training data distributions, which…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Guosheng Zhao , Chaojun Ni , Xiaofeng Wang , Zheng Zhu , Xueyang Zhang , Yida Wang , Guan Huang , Xinze Chen , Boyuan Wang , Youyi Zhang , Wenjun Mei , Xingang Wang

Simulators are useful tools for testing automated driving controllers. Vehicle-in-the-loop (ViL) tests and digital twins (DTs) are widely used simulation technologies to facilitate the smooth deployment of controllers to physical vehicles.…

Virtual testing of automated driving systems (ADS) has become an essential part of testing procedures for all automation levels. As ADS from automation level 3 and up are very complex, virtual testing for such systems is inevitable. The…

Software Engineering · Computer Science 2021-03-26 Demin Nalic , Aleksa Pandurevic , Arno Eichberger , Branko Rogic

Testing is essential for verifying and validating control designs, especially in safety-critical applications. In particular, the control system governing an automated driving vehicle must be proven reliable enough for its acceptance on the…

Systems and Control · Electrical Eng. & Systems 2023-09-11 Mengjia Zhu , Alberto Bemporad , Maximilian Kneissl , Hasan Esen

Large-scale driving datasets such as Waymo Open Dataset and nuScenes substantially accelerate autonomous driving research, especially for perception tasks such as 3D detection and trajectory forecasting. Since the driving logs in these…

Robotics · Computer Science 2023-10-31 Quanyi Li , Zhenghao Peng , Lan Feng , Zhizheng Liu , Chenda Duan , Wenjie Mo , Bolei Zhou

This paper presents a scenario generation framework that creates diverse, parametrized, and safety-critical driving situations to validate the safety features of autonomous vehicles in simulation [15]. By modeling factors such as road…

Systems and Control · Electrical Eng. & Systems 2026-04-09 Kiruthiga Chandra Shekar , Aliasghar Moj Arab

Autonomous vehicle safety and reliability are the paramount requirements when developing autonomous vehicles. These requirements are guaranteed by massive functional and performance tests. Conducting these tests on real vehicles is…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-06-01 Jie Tang , Shaoshan Liu , Chao Wang , Quan Wang

Virtual scenario-based testing methods to validate autonomous driving systems are predominantly centred around collision avoidance, and lack a comprehensive approach to evaluate optimal driving behaviour holistically. Furthermore, current…

Robotics · Computer Science 2024-08-01 Kethan Reddy , Elias Nassif , Panagiotis Angeloudis , Mohammed Quddus , Washington Ochieng

With the rise of software-defined vehicles (SDVs), where software governs most vehicle functions alongside enhanced connectivity, the need for secure software updates has become increasingly critical. Software vulnerabilities can severely…

Cryptography and Security · Computer Science 2025-11-21 Martin Slind Hagen , Emil Lundqvist , Alex Phu , Yenan Wang , Kim Strandberg , Elad Michael Schiller

Developing embodied agents in simulation has been a key research topic in recent years. Exciting new tasks, algorithms, and benchmarks have been developed in various simulators. However, most of them assume deaf agents in silent…

Robotics · Computer Science 2023-09-19 Ruohan Gao , Hao Li , Gokul Dharan , Zhuzhu Wang , Chengshu Li , Fei Xia , Silvio Savarese , Li Fei-Fei , Jiajun Wu

Realistic simulation is critical for applications ranging from robotics to animation. Learned simulators have emerged as a possibility to capture real world physics directly from video data, but very often require privileged information…

Graphics · Computer Science 2025-08-12 Mikel Zhobro , Andreas René Geist , Georg Martius

Autonomous driving has rapidly evolved through synergistic developments in hardware and artificial intelligence. This comprehensive review investigates traffic datasets and simulators as dual pillars supporting autonomous vehicle (AV)…

Robotics · Computer Science 2025-08-28 Supriya Sarker , Brent Maples , Iftekharul Islam , Muyang Fan , Christos Papadopoulos , Weizi Li

Safe autonomous landing in urban cities is a necessity for the growing Unmanned Aircraft Systems (UAS) industry. In urgent situations, building rooftops, particularly flat rooftops, can provide local safe landing zones for small UAS. This…

Robotics · Computer Science 2019-03-12 Jeremy Castagno , Yu Yao , Ella Atkins