English
Related papers

Related papers: READ: Large-Scale Neural Scene Rendering for Auton…

200 papers

Neural reconstruction models for autonomous driving simulation have made significant strides in recent years, with dynamic models becoming increasingly prevalent. However, these models are typically limited to handling in-domain objects…

Autonomous driving is one of the most recent topics of interest which is aimed at replicating human driving behavior keeping in mind the safety issues. We approach the problem of learning synthetic driving using generative neural networks.…

Computer Vision and Pattern Recognition · Computer Science 2016-11-29 Arna Ghosh , Biswarup Bhattacharya , Somnath Basu Roy Chowdhury

We consider the problem of generating realistic traffic scenes automatically. Existing methods typically insert actors into the scene according to a set of hand-crafted heuristics and are limited in their ability to model the true…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Shuhan Tan , Kelvin Wong , Shenlong Wang , Sivabalan Manivasagam , Mengye Ren , Raquel Urtasun

In this paper, we introduce the first large-scale video prediction model in the autonomous driving discipline. To eliminate the restriction of high-cost data collection and empower the generalization ability of our model, we acquire massive…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Jiazhi Yang , Shenyuan Gao , Yihang Qiu , Li Chen , Tianyu Li , Bo Dai , Kashyap Chitta , Penghao Wu , Jia Zeng , Ping Luo , Jun Zhang , Andreas Geiger , Yu Qiao , Hongyang Li

Autonomous driving technology nowadays targets to level 4 or beyond, but the researchers are faced with some limitations for developing reliable driving algorithms in diverse challenges. To promote the autonomous vehicles to spread widely,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Hyeonjae Jeon , Junghyun Seo , Taesoo Kim , Sungho Son , Jungki Lee , Gyeungho Choi , Yongseob Lim

Autonomous Driving Systems (ADS) require diverse and safety-critical traffic scenarios for effective training and testing, but the existing data generation methods struggle to provide flexibility and scalability. We propose LASER, a novel…

Robotics · Computer Science 2024-10-25 Hao Gao , Jingyue Wang , Wenyang Fang , Jingwei Xu , Yunpeng Huang , Taolue Chen , Xiaoxing Ma

Neural rendering techniques promise efficient photo-realistic image synthesis while at the same time providing rich control over scene parameters by learning the physical image formation process. While several supervised methods have been…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Hassan Abu Alhaija , Siva Karthik Mustikovela , Justus Thies , Varun Jampani , Matthias Nießner , Andreas Geiger , Carsten Rother

Simulation is crucial for developing and evaluating autonomous vehicle (AV) systems. Recent literature builds on a new generation of generative models to synthesize highly realistic images for full-stack simulation. However, purely…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Zehao Zhu , Yuliang Zou , Chiyu Max Jiang , Bo Sun , Vincent Casser , Xiukun Huang , Jiahao Wang , Zhenpei Yang , Ruiqi Gao , Leonidas Guibas , Mingxing Tan , Dragomir Anguelov

The lack of generalization in learning-based autonomous driving applications is shown by the narrow range of road scenarios that vehicles can currently cover. A generalizable approach should capture many distinct road structures and…

Machine Learning · Computer Science 2025-04-25 Juan Carlos Climent Pardo

Robust and realistic rendering for large-scale road scenes is essential in autonomous driving simulation. Recently, 3D Gaussian Splatting (3D-GS) has made groundbreaking progress in neural rendering, but the general fidelity of large-scale…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Saining Zhang , Baijun Ye , Xiaoxue Chen , Yuantao Chen , Zongzheng Zhang , Cheng Peng , Yongliang Shi , Hao Zhao

Generating realistic and diverse road scenarios is essential for autonomous vehicle testing and validation. Nevertheless, owing to the complexity and variability of real-world road environments, creating authentic and varied scenarios for…

Robotics · Computer Science 2024-11-15 Junjie Zhou , Lin Wang , Qiang Meng , Xiaofan Wang

Realistic scene reconstruction and view synthesis are essential for advancing autonomous driving systems by simulating safety-critical scenarios. 3D Gaussian Splatting excels in real-time rendering and static scene reconstructions but…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Mustafa Khan , Hamidreza Fazlali , Dhruv Sharma , Tongtong Cao , Dongfeng Bai , Yuan Ren , Bingbing Liu

A powerful simulator highly decreases the need for real-world tests when training and evaluating autonomous vehicles. Data-driven simulators flourished with the recent advancement of conditional Generative Adversarial Networks (cGANs),…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Saeed Saadatnejad , Siyuan Li , Taylor Mordan , Alexandre Alahi

Generative models in Autonomous Driving (AD) enable diverse scene creation, yet existing methods fall short by only capturing a limited range of modalities, restricting the capability of generating controllable scenes for comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Yanhao Wu , Haoyang Zhang , Tianwei Lin , Lichao Huang , Shujie Luo , Rui Wu , Congpei Qiu , Wei Ke , Tong Zhang

Generating representative rear-end crash scenarios is crucial for safety assessments of Advanced Driver Assistance Systems (ADAS) and Automated Driving systems (ADS). However, existing methods for scenario generation face challenges such as…

Robotics · Computer Science 2024-06-25 Jian Wu , Carol Flannagan , Ulrich Sander , Jonas Bärgman

Recent advances in scene reconstruction have pushed toward highly realistic modeling of autonomous driving (AD) environments using 3D Gaussian splatting. However, the resulting reconstructions remain closely tied to the original…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Polina Karpikova , Daniil Selikhanovych , Kirill Struminsky , Ruslan Musaev , Maria Golitsyna , Dmitry Baranchuk

Indoor scene understanding is central to applications such as robot navigation and human companion assistance. Over the last years, data-driven deep neural networks have outperformed many traditional approaches thanks to their…

Computer Vision and Pattern Recognition · Computer Science 2017-07-04 Yinda Zhang , Shuran Song , Ersin Yumer , Manolis Savva , Joon-Young Lee , Hailin Jin , Thomas Funkhouser

Evaluating and training autonomous driving systems require diverse and scalable corner cases. However, most existing scene generation methods lack controllability, accuracy, and versatility, resulting in unsatisfactory generation results.…

Robotics · Computer Science 2024-10-11 Sheng Wang , Ge Sun , Fulong Ma , Tianshuai Hu , Qiang Qin , Yongkang Song , Lei Zhu , Junwei Liang

We propose a systematic learning-based approach to the generation of massive quantities of synthetic 3D scenes and arbitrary numbers of photorealistic 2D images thereof, with associated ground truth information, for the purposes of…

Computer Vision and Pattern Recognition · Computer Science 2018-06-21 Chenfanfu Jiang , Siyuan Qi , Yixin Zhu , Siyuan Huang , Jenny Lin , Lap-Fai Yu , Demetri Terzopoulos , Song-Chun Zhu

Multi-view image generation in autonomous driving demands consistent 3D scene understanding across camera views. Most existing methods treat this problem as a 2D image set generation task, lacking explicit 3D modeling. However, we argue…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Zeming Chen , Hang Zhao