English
Related papers

Related papers: UniSim: A Neural Closed-Loop Sensor Simulator

200 papers

With deep learning and computer vision technology development, autonomous driving provides new solutions to improve traffic safety and efficiency. The importance of building high-quality datasets is self-evident, especially with the rise of…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Guohang Yan , Jiahao Pi , Jianfei Guo , Zhaotong Luo , Min Dou , Nianchen Deng , Qiusheng Huang , Daocheng Fu , Licheng Wen , Pinlong Cai , Xing Gao , Xinyu Cai , Bo Zhang , Xuemeng Yang , Yeqi Bai , Hongbin Zhou , Botian Shi

Control systems on unmanned vehicles are safety-critical systems whose requirements on reliability and safety are ever-increasing. Currently, testing a complex autonomous control system is an expensive and time-consuming process, which…

Systems and Control · Electrical Eng. & Systems 2019-08-08 Xunhua Dai , Chenxu Ke , Quan Quan , Kai-Yuan Cai

Achieving fully autonomous driving systems requires learning rational decisions in a wide span of scenarios, including safety-critical and out-of-distribution ones. However, such cases are underrepresented in real-world corpus collected by…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Haochen Tian , Tianyu Li , Haochen Liu , Jiazhi Yang , Yihang Qiu , Guang Li , Junli Wang , Yinfeng Gao , Zhang Zhang , Liang Wang , Hangjun Ye , Tieniu Tan , Long Chen , Hongyang Li

Spike cameras, with their exceptional temporal resolution, are revolutionizing high-speed visual applications. Large-scale synthetic datasets have significantly accelerated the development of these cameras, particularly in reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Liwen Hu , Lei Ma , Yijia Guo , Tiejun Huang

Real-world autonomous driving, particularly in urban environments with numerous corner cases, requires rigorous testing to ensure product safety and robustness. However, few studies have explored integrating adversarial scenario generation…

Robotics · Computer Science 2026-05-18 Chuancheng Zhang , Zhenhao Wang , Kaizheng Li , Yaran Lin , Qiang Guo , Bin Jiang

How can we reliably simulate future driving scenarios under a wide range of ego driving behaviors? Recent driving world models, developed exclusively on real-world driving data composed mainly of safe expert trajectories, struggle to follow…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Jiazhi Yang , Kashyap Chitta , Shenyuan Gao , Long Chen , Yuqian Shao , Xiaosong Jia , Hongyang Li , Andreas Geiger , Xiangyu Yue , Li Chen

With the rapid growth of urban transportation and the continuous progress in autonomous driving, a demand for robust benchmarking autonomous driving algorithms has emerged, calling for accurate modeling of large-scale urban traffic…

Robotics · Computer Science 2025-02-14 Yuheng Zhang , Tianjian Ouyang , Fudan Yu , Lei Qiao , Wei Wu , Jingtao Ding , Jian Yuan , Yong Li

Driving simulation plays a crucial role in developing reliable driving agents by providing controlled, evaluative environments. To enable meaningful assessments, a high-quality driving simulator must satisfy several key requirements:…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Junzhe Jiang , Nan Song , Jingyu Li , Xiatian Zhu , Li Zhang

We present a novel method for testing the safety of self-driving vehicles in simulation. We propose an alternative to sensor simulation, as sensor simulation is expensive and has large domain gaps. Instead, we directly simulate the outputs…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Kelvin Wong , Qiang Zhang , Ming Liang , Bin Yang , Renjie Liao , Abbas Sadat , Raquel Urtasun

Building simulation environments for developing and testing autonomous vehicles necessitates that the simulators accurately model the statistical realism of the real-world environment, including the interaction with other vehicles driven by…

Autonomous driving systems have achieved significant advances, and full autonomy within defined operational design domains near practical deployment. Expanding these domains requires addressing safety assurance under diverse conditions.…

Robotics · Computer Science 2025-11-13 Shunsuke Ito , Chaoran Zhao , Ryo Okamura , Takuya Azumi

In this work, we introduce \textbf{XSIM}, a sensor simulation framework for autonomous driving. XSIM extends 3DGUT splatting with a generalized rolling-shutter modeling tailored for autonomous driving applications. Our framework provides a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Nikolay Patakin , Arsenii Shirokov , Anton Konushin , Dmitry Senushkin

Realistic simulation is key to enabling safe and scalable development of % self-driving vehicles. A core component is simulating the sensors so that the entire autonomy system can be tested in simulation. Sensor simulation involves modeling…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Jingkang Wang , Sivabalan Manivasagam , Yun Chen , Ze Yang , Ioan Andrei Bârsan , Anqi Joyce Yang , Wei-Chiu Ma , Raquel Urtasun

We present a photo-realistic training and evaluation simulator (Sim4CV) with extensive applications across various fields of computer vision. Built on top of the Unreal Engine, the simulator integrates full featured physics based cars,…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Matthias Müller , Vincent Casser , Jean Lahoud , Neil Smith , Bernard Ghanem

Autonomous driving evaluation requires simulation environments that closely replicate actual road conditions, including real-world sensory data and responsive feedback loops. However, many existing simulations need to predict waypoints…

Robotics · Computer Science 2024-11-19 Tianyi Yan , Dongming Wu , Wencheng Han , Junpeng Jiang , Xia Zhou , Kun Zhan , Cheng-zhong Xu , Jianbing Shen

As connected autonomous vehicles (CAVs) become increasingly prevalent, there is a growing need for simulation platforms that can accurately evaluate CAV behavior in large-scale environments. In this paper, we propose Flowsim, a novel…

Networking and Internet Architecture · Computer Science 2023-06-12 Ye Tao , Ehsan Javanmardi , Jin Nakazato , Manabu Tsukada , Hiroshi Esaki

AutoDRIVE is envisioned to be an integrated research and education platform for scaled autonomous vehicles and related applications. This work is a stepping-stone towards achieving the greater goal of realizing such a platform.…

Robotics · Computer Science 2023-05-16 Tanmay Vilas Samak , Chinmay Vilas Samak , Ming Xie

As the foundation of closed-loop training and evaluation in autonomous driving, traffic simulation still faces two fundamental challenges: covariate shift introduced by open-loop imitation learning and limited capacity to reflect the…

Robotics · Computer Science 2026-02-03 Keyu Chen , Wenchao Sun , Hao Cheng , Zheng Fu , Sifa Zheng

Ensuring realistic traffic dynamics is a prerequisite for simulation platforms to evaluate the reliability of self-driving systems before deployment in the real world. Because most road users are human drivers, reproducing their diverse…

Robotics · Computer Science 2025-08-26 Wendi Li , Hao Wu , Han Gao , Bing Mao , Fengyuan Xu , Sheng Zhong

Current validation methods often rely on recorded data and basic functional checks, which may not be sufficient to encompass the scenarios an autonomous vehicle might encounter. In addition, there is a growing need for complex scenarios…

Robotics · Computer Science 2024-02-08 Marc Kaufeld , Rainer Trauth , Johannes Betz