English
Related papers

Related papers: UniSim: A Neural Closed-Loop Sensor Simulator

200 papers

Simulation is pivotal in evaluating the performance of autonomous driving systems due to the advantages of high efficiency and low cost compared to on-road testing. Bridging the gap between simulation and the real world requires realistic…

Robotics · Computer Science 2025-06-17 Haojie Xin , Xiaodong Zhang , Renzhi Tang , Songyang Yan , Qianrui Zhao , Chunze Yang , Wen Cui , Zijiang Yang

Generating adversarial safety-critical scenarios is a pivotal method for testing autonomous driving systems, as it identifies potential weaknesses and enhances system robustness and reliability. However, existing approaches predominantly…

Robotics · Computer Science 2025-03-03 Yukuan Yang , Xucheng Lu , Zhili Zhang , Zepeng Wu , Guoqi Li , Lingzhong Meng , Yunzhi Xue

The kind of closed-loop verification likely to be required for autonomous vehicle (AV) safety testing is beyond the reach of traditional test methodologies and discrete verification. Validation puts the autonomous vehicle system to the test…

Machine Learning · Computer Science 2020-05-29 Hyun Jae Cho , Madhur Behl

We present Sim-on-Wheels, a safe, realistic, and vehicle-in-loop framework to test autonomous vehicles' performance in the real world under safety-critical scenarios. Sim-on-wheels runs on a self-driving vehicle operating in the physical…

Robotics · Computer Science 2023-06-16 Yuan Shen , Bhargav Chandaka , Zhi-hao Lin , Albert Zhai , Hang Cui , David Forsyth , Shenlong Wang

Scenario-based testing using simulations is a cornerstone of Autonomous Vehicles (AVs) software validation. So far, developers needed to choose between low-fidelity 2D simulators to explore the scenario space efficiently, and high-fidelity…

Robotics · Computer Science 2025-05-21 Marc Kaufeld , Korbinian Moller , Alessio Gambi , Paolo Arcaini , Johannes Betz

This report describes a new experimental setup for human-in-the-loop simulations. A force feedback simulator with four axis motion has been setup for real-time driving experiments. The simulator will move to simulate the forces a driver…

Systems and Control · Computer Science 2014-01-21 Katherine Driggs-Campbell , Guillaume Bellegarda , Victor Shia , S. Shankar Sastry , Ruzena Bajcsy

Scalable sensor simulation is an important yet challenging open problem for safety-critical domains such as self-driving. Current works in image simulation either fail to be photorealistic or do not model the 3D environment and the dynamic…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Yun Chen , Frieda Rong , Shivam Duggal , Shenlong Wang , Xinchen Yan , Sivabalan Manivasagam , Shangjie Xue , Ersin Yumer , Raquel Urtasun

Even as technology and performance gains are made in the sphere of automated driving, safety concerns remain. Vehicle simulation has long been seen as a tool to overcome the cost associated with a massive amount of on-road testing for…

Robotics · Computer Science 2024-05-14 Joe Beck , Shean Huff , Subhadeep Chakraborty

Scenario-based testing with driving simulators is extensively used to identify failing conditions of automated driving assistance systems (ADAS). However, existing studies have shown that repeated test execution in the same as well as in…

Software Engineering · Computer Science 2025-11-11 Lev Sorokin , Matteo Biagiola , Andrea Stocco

Realistic simulators are critical for training and verifying robotics systems. While most of the contemporary simulators are hand-crafted, a scaleable way to build simulators is to use machine learning to learn how the environment behaves…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Seung Wook Kim , Jonah Philion , Antonio Torralba , Sanja Fidler

Developing safety and efficiency applications for Connected and Automated Vehicles (CAVs) require a great deal of testing and evaluation. The need for the operation of these systems in critical and dangerous situations makes the burden of…

Multiagent Systems · Computer Science 2023-04-27 Ahura Jami , Mahdi Razzaghpour , Hussein Alnuweiri , Yaser P. Fallah

Interactive traffic simulation is crucial to autonomous driving systems by enabling testing for planners in a more scalable and safe way compared to real-world road testing. Existing approaches learn an agent model from large-scale driving…

Robotics · Computer Science 2022-10-27 Qiao Sun , Xin Huang , Brian C. Williams , Hang Zhao

Autonomous systems, such as self-driving vehicles, quadrupeds, and robot manipulators, are largely enabled by the rapid development of artificial intelligence. However, such systems involve several trustworthy challenges such as safety,…

Robotics · Computer Science 2023-05-02 Wenhao Ding

Autonomous driving system development is critically dependent on the ability to replay complex and diverse traffic scenarios in simulation. In such scenarios, the ability to accurately simulate the vehicle sensors such as cameras, lidar or…

Computer Vision and Pattern Recognition · Computer Science 2020-06-26 Zhenpei Yang , Yuning Chai , Dragomir Anguelov , Yin Zhou , Pei Sun , Dumitru Erhan , Sean Rafferty , Henrik Kretzschmar

Simulation has the potential to massively scale evaluation of self-driving systems enabling rapid development as well as safe deployment. To close the gap between simulation and the real world, we need to simulate realistic multi-agent…

Robotics · Computer Science 2021-01-19 Simon Suo , Sebastian Regalado , Sergio Casas , Raquel Urtasun

Autonomous Vehicle (AV) requires rigorous testing in safety-critical scenarios for safety validation, yet its validation is hindered by the high cost of field testing and the lack of fidelity in current simulations for rare safety-critical…

Robotics · Computer Science 2026-05-19 Hongyi Zhao , Shuo Wang , Qijie He , Ziyuan Pu

Data for training learning-enabled self-driving cars in the physical world are typically collected in a safe, normal environment. Such data distribution often engenders a strong bias towards safe driving, making self-driving cars unprepared…

Traffic simulation, complementing real-world data with a long-tail distribution, allows for effective evaluation and enhancement of the ability of autonomous vehicles to handle accident-prone scenarios. Simulating such safety-critical…

Robotics · Computer Science 2025-03-10 Zherui Huang , Xing Gao , Guanjie Zheng , Licheng Wen , Xuemeng Yang , Xiao Sun

With the motivation and the difficulties that currently exist in comprehending and utilizing the promising features of SNNs, we proposed a novel run-time multi-core architecture-based simulator called "RAVSim" (Runtime Analysis and…

Neural and Evolutionary Computing · Computer Science 2024-03-26 Sanaullah , Shamini Koravuna , Ulrich Rückert , Thorsten Jungeblut

The railway industry is searching for new ways to automate a number of complex train functions, such as object detection, track discrimination, and accurate train positioning, which require the artificial perception of the railway…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Gianluca D'Amico , Mauro Marinoni , Federico Nesti , Giulio Rossolini , Giorgio Buttazzo , Salvatore Sabina , Gianluigi Lauro