English
Related papers

Related papers: S-NeRF++: Autonomous Driving Simulation via Neural…

200 papers

We present EmerNeRF, a simple yet powerful approach for learning spatial-temporal representations of dynamic driving scenes. Grounded in neural fields, EmerNeRF simultaneously captures scene geometry, appearance, motion, and semantics via…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Jiawei Yang , Boris Ivanovic , Or Litany , Xinshuo Weng , Seung Wook Kim , Boyi Li , Tong Che , Danfei Xu , Sanja Fidler , Marco Pavone , Yue Wang

Neural rendering techniques combining machine learning with geometric reasoning have arisen as one of the most promising approaches for synthesizing novel views of a scene from a sparse set of images. Among these, stands out the Neural…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Albert Pumarola , Enric Corona , Gerard Pons-Moll , Francesc Moreno-Noguer

This paper focuses on scene reconstruction under nighttime conditions in autonomous driving simulation. Recent methods based on Neural Radiance Fields (NeRFs) and 3D Gaussian Splatting (3DGS) have achieved photorealistic modeling in…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Tae-Kyeong Kim , Xingxin Chen , Guile Wu , Chengjie Huang , Dongfeng Bai , Bingbing Liu

Nowadays, autonomous cars can drive smoothly in ordinary cases, and it is widely recognized that realistic sensor simulation will play a critical role in solving remaining corner cases by simulating them. To this end, we propose an…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Zirui Wu , Tianyu Liu , Liyi Luo , Zhide Zhong , Jianteng Chen , Hongmin Xiao , Chao Hou , Haozhe Lou , Yuantao Chen , Runyi Yang , Yuxin Huang , Xiaoyu Ye , Zike Yan , Yongliang Shi , Yiyi Liao , Hao Zhao

Combining reconstruction models with generative models has emerged as a promising paradigm for closed-loop simulation in autonomous driving. For example, ReconDreamer has demonstrated remarkable success in rendering large-scale maneuvers.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Guosheng Zhao , Xiaofeng Wang , Chaojun Ni , Zheng Zhu , Wenkang Qin , Guan Huang , Xingang Wang

Neural Radiance Fields (NeRFs) implicitly model continuous three-dimensional scenes using a set of images with known camera poses, enabling the rendering of photorealistic novel views. However, existing NeRF-based methods encounter…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Zhengyu Zou , Jingfeng Li , Hao Li , Xiaolei Hou , Jinwen Hu , Jingkun Chen , Lechao Cheng , Dingwen Zhang

Self-driving software pipelines include components that are learned from a significant number of training examples, yet it remains challenging to evaluate the overall system's safety and generalization performance. Together with scaling up…

The quality of three-dimensional reconstruction is a key factor affecting the effectiveness of its application in areas such as virtual reality (VR) and augmented reality (AR) technologies. Neural Radiance Fields (NeRF) can generate…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Qianqiu Tan , Tao Liu , Yinling Xie , Shuwan Yu , Baohua Zhang

Despite the recent success of Neural Radiance Field (NeRF), it is still challenging to render large-scale driving scenes with long trajectories, particularly when the rendering quality and efficiency are in high demand. Existing methods for…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Zhuopeng Li , Chenming Wu , Liangjun Zhang , Jianke Zhu

Photorealistic 3D scene reconstruction plays an important role in autonomous driving, enabling the generation of novel data from existing datasets to simulate safety-critical scenarios and expand training data without additional acquisition…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Pou-Chun Kung , Xianling Zhang , Katherine A. Skinner , Nikita Jaipuria

Realtime 4D reconstruction for dynamic scenes remains a crucial challenge for autonomous driving perception. Most existing methods rely on depth estimation through self-supervision or multi-modality sensor fusion. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Xin Fei , Wenzhao Zheng , Yueqi Duan , Wei Zhan , Masayoshi Tomizuka , Kurt Keutzer , Jiwen Lu

Implicit neural representations have shown compelling results in offline 3D reconstruction and also recently demonstrated the potential for online SLAM systems. However, applying them to autonomous 3D reconstruction, where a robot is…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Yunlong Ran , Jing Zeng , Shibo He , Lincheng Li , Yingfeng Chen , Gimhee Lee , Jiming Chen , Qi Ye

Autonomous driving system development is critically dependent on the ability to replay complex and diverse traffic scenarios in simulation. In such scenarios, the ability to accurately simulate the vehicle sensors such as cameras, lidar or…

Computer Vision and Pattern Recognition · Computer Science 2020-06-26 Zhenpei Yang , Yuning Chai , Dragomir Anguelov , Yin Zhou , Pei Sun , Dumitru Erhan , Sean Rafferty , Henrik Kretzschmar

3D surface reconstruction from images is essential for numerous applications. Recently, Neural Radiance Fields (NeRFs) have emerged as a promising framework for 3D modeling. However, NeRFs require accurate camera poses as input, and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Yiyang Chen , Siyan Dong , Xulong Wang , Lulu Cai , Youyi Zheng , Yanchao Yang

Closed-loop simulation is crucial for end-to-end autonomous driving. Existing sensor simulation methods (e.g., NeRF and 3DGS) reconstruct driving scenes based on conditions that closely mirror training data distributions. However, these…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Chaojun Ni , Guosheng Zhao , Xiaofeng Wang , Zheng Zhu , Wenkang Qin , Guan Huang , Chen Liu , Yuyin Chen , Yida Wang , Xueyang Zhang , Yifei Zhan , Kun Zhan , Peng Jia , Xianpeng Lang , Xingang Wang , Wenjun Mei

Simulation systems have become an essential component in the development and validation of autonomous driving technologies. The prevailing state-of-the-art approach for simulation is to use game engines or high-fidelity computer graphics…

Computer Vision and Pattern Recognition · Computer Science 2020-10-30 Wei Li , Chengwei Pan , Rong Zhang , Jiaping Ren , Yuexin Ma , Jin Fang , Feilong Yan , Qichuan Geng , Xinyu Huang , Huajun Gong , Weiwei Xu , Guoping Wang , Dinesh Manocha , Ruigang Yang

In the rapidly evolving landscape of digital content creation, the demand for fast, convenient, and autonomous methods of crafting detailed 3D reconstructions of humans has grown significantly. Addressing this pressing need, our AirNeRF…

Robotics · Computer Science 2024-07-16 Alexey Kotcov , Maria Dronova , Vladislav Cheremnykh , Sausar Karaf , Dzmitry Tsetserukou

We present DrivingGaussian++, an efficient and effective framework for realistic reconstructing and controllable editing of surrounding dynamic autonomous driving scenes. DrivingGaussian++ models the static background using incremental 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Yajiao Xiong , Xiaoyu Zhou , Yongtao Wan , Deqing Sun , Ming-Hsuan Yang

Learning-based 3D reconstruction has emerged as a transformative technique in autonomous driving, enabling precise modeling of environments through advanced neural representations. It has inspired pioneering solutions for vital tasks in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Liewen Liao , Weihao Yan , Wang Xu , Ming Yang , Songan Zhang , H. Eric Tseng

Spike cameras, leveraging spike-based integration sampling and high temporal resolution, offer distinct advantages over standard cameras. However, existing approaches reliant on spike cameras often assume optimal illumination, a condition…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Lin Zhu , Kangmin Jia , Yifan Zhao , Yunshan Qi , Lizhi Wang , Hua Huang