English
Related papers

Related papers: Unified Sensor Simulation for Autonomous Driving

200 papers

Simulation systems have become an essential component in the development and validation of autonomous driving technologies. The prevailing state-of-the-art approach for simulation is to use game engines or high-fidelity computer graphics…

Computer Vision and Pattern Recognition · Computer Science 2020-10-30 Wei Li , Chengwei Pan , Rong Zhang , Jiaping Ren , Yuexin Ma , Jin Fang , Feilong Yan , Qichuan Geng , Xinyu Huang , Huajun Gong , Weiwei Xu , Guoping Wang , Dinesh Manocha , Ruigang Yang

Tracking and modeling unknown rigid objects in the environment play a crucial role in autonomous unmanned systems and virtual-real interactive applications. However, many existing Simultaneous Localization, Mapping and Moving Object…

Robotics · Computer Science 2023-10-03 Linghao Yang , Yanmin Wu , Yu Deng , Rui Tian , Xinggang Hu , Tiefeng Ma

Sparse Perception Models (SPMs) adopt a query-driven paradigm that forgoes explicit dense BEV or volumetric construction, enabling highly efficient computation and accelerated inference. In this paper, we introduce SQS, a novel query-based…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Haiming Zhang , Yiyao Zhu , Wending Zhou , Xu Yan , Yingjie Cai , Bingbing Liu , Shuguang Cui , Zhen Li

Feed-forward paradigms for 3D reconstruction have become a focus of recent research, which learn implicit, fixed view transformations to generate a single scene representation. However, their application to complex driving scenes reveals…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Haochen Yu , Qiankun Liu , Hongyuan Liu , Jianfei Jiang , Juntao Lyu , Jiansheng Chen , Huimin Ma

Predicting future trajectories of traffic agents in highly interactive environments is an essential and challenging problem for the safe operation of autonomous driving systems. On the basis of the fact that self-driving vehicles are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Chiho Choi , Joon Hee Choi , Jiachen Li , Srikanth Malla

Predicting future trajectories of traffic agents in highly interactive environments is an essential and challenging problem for the safe operation of autonomous driving systems. On the basis of the fact that self-driving vehicles are…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Chiho Choi , Joon Hee Choi , Srikanth Malla , Jiachen Li

We introduce the Visual Implicit Geometry Transformer (ViGT), an autonomous driving geometric model that estimates continuous 3D occupancy fields from surround-view camera rigs. ViGT represents a step towards foundational geometric models…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Arsenii Shirokov , Mikhail Kuznetsov , Danila Stepochkin , Egor Evdokimov , Daniil Glazkov , Nikolay Patakin , Anton Konushin , Dmitry Senushkin

Multi-sensor fusion is crucial for improving the performance and robustness of end-to-end autonomous driving systems. Existing methods predominantly adopt either attention-based flatten fusion or bird's eye view fusion through geometric…

Robotics · Computer Science 2025-10-29 Shuai Liu , Quanmin Liang , Zefeng Li , Boyang Li , Kai Huang

Ensuring realistic traffic dynamics is a prerequisite for simulation platforms to evaluate the reliability of self-driving systems before deployment in the real world. Because most road users are human drivers, reproducing their diverse…

Robotics · Computer Science 2025-08-26 Wendi Li , Hao Wu , Han Gao , Bing Mao , Fengyuan Xu , Sheng Zhong

LiDAR sensors are widely used in autonomous driving due to the reliable 3D spatial information. However, the data of LiDAR is sparse and the frequency of LiDAR is lower than that of cameras. To generate denser point clouds spatially and…

Computer Vision and Pattern Recognition · Computer Science 2021-12-09 Xudong Huang , Chunyu Lin , Haojie Liu , Lang Nie , Yao Zhao

Autonomous driving system development is critically dependent on the ability to replay complex and diverse traffic scenarios in simulation. In such scenarios, the ability to accurately simulate the vehicle sensors such as cameras, lidar or…

Computer Vision and Pattern Recognition · Computer Science 2020-06-26 Zhenpei Yang , Yuning Chai , Dragomir Anguelov , Yin Zhou , Pei Sun , Dumitru Erhan , Sean Rafferty , Henrik Kretzschmar

The recent surge in interest in autonomous driving stems from its rapidly developing capacity to enhance safety, efficiency, and convenience. A pivotal aspect of autonomous driving technology is its perceptual systems, where core algorithms…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Qi Zhang , Siyuan Gou , Wenbin Li

Driving simulation plays a crucial role in developing reliable driving agents by providing controlled, evaluative environments. To enable meaningful assessments, a high-quality driving simulator must satisfy several key requirements:…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Junzhe Jiang , Nan Song , Jingyu Li , Xiatian Zhu , Li Zhang

To enhance autonomous driving safety in complex scenarios, various methods have been proposed to simulate LiDAR point cloud data. Nevertheless, these methods often face challenges in producing high-quality, diverse, and controllable…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Tianyi Yan , Junbo Yin , Xianpeng Lang , Ruigang Yang , Cheng-Zhong Xu , Jianbing Shen

Visual SLAM algorithms achieve significant improvements through the exploration of 3D Gaussian Splatting (3DGS) representations, particularly in generating high-fidelity dense maps. However, they depend on a static environment assumption…

Robotics · Computer Science 2026-04-15 Yi Liu , Haoxuan Xu , Hongbo Duan , Keyu Fan , Zhengyang Zhang , Peiyu Zhuang , Pengting Luo , Houde Liu

Realistic simulation is key to enabling safe and scalable development of % self-driving vehicles. A core component is simulating the sensors so that the entire autonomy system can be tested in simulation. Sensor simulation involves modeling…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Jingkang Wang , Sivabalan Manivasagam , Yun Chen , Ze Yang , Ioan Andrei Bârsan , Anqi Joyce Yang , Wei-Chiu Ma , Raquel Urtasun

In the realm of autonomous driving, accurately detecting surrounding obstacles is crucial for effective decision-making. Traditional methods primarily rely on 3D bounding boxes to represent these obstacles, which often fail to capture the…

Robotics · Computer Science 2025-11-18 Chunyong Hu , Qi Luo , Jianyun Xu , Song Wang , Qiang Li , Sheng Yang

Perception systems play a crucial role in autonomous driving, incorporating multiple sensors and corresponding computer vision algorithms. 3D LiDAR sensors are widely used to capture sparse point clouds of the vehicle's surroundings.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Helin Cao , Sven Behnke

World models have demonstrated significant promise for data synthesis in autonomous driving. However, existing methods predominantly concentrate on single-modality generation, typically focusing on either multi-camera video or LiDAR…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Guosheng Zhao , Yaozeng Wang , Xiaofeng Wang , Zheng Zhu , Tingdong Yu , Guan Huang , Yongchen Zai , Ji Jiao , Changliang Xue , Xiaole Wang , Zhen Yang , Futang Zhu , Xingang Wang

We present DeSiRe-GS, a self-supervised gaussian splatting representation, enabling effective static-dynamic decomposition and high-fidelity surface reconstruction in complex driving scenarios. Our approach employs a two-stage optimization…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Chensheng Peng , Chengwei Zhang , Yixiao Wang , Chenfeng Xu , Yichen Xie , Wenzhao Zheng , Kurt Keutzer , Masayoshi Tomizuka , Wei Zhan