English
Related papers

Related papers: FreeSim: Toward Free-viewpoint Camera Simulation i…

200 papers

Autonomous driving needs fast, scalable 4D reconstruction and re-simulation for training and evaluation, yet most methods for dynamic driving scenes still rely on per-scene optimization, known camera calibration, or short frame windows,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Xiaoxue Chen , Ziyi Xiong , Yuantao Chen , Gen Li , Nan Wang , Hongcheng Luo , Long Chen , Haiyang Sun , Bing Wang , Guang Chen , Hangjun Ye , Hongyang Li , Ya-Qin Zhang , Hao Zhao

Recent advancements in video generation have substantially improved visual quality and temporal coherence, making these models increasingly appealing for applications such as autonomous driving, particularly in the context of driving…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Chun-Peng Chang , Chen-Yu Wang , Julian Schmidt , Holger Caesar , Alain Pagani

Despite rapid progress in autonomous driving, reliable training and evaluation of driving systems remain fundamentally constrained by the lack of scalable and interactive simulation environments. Recent generative video models achieve…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yaoru Li , Federico Landi , Marco Godi , Xin Jin , Ruiju Fu , Yufei Ma , Muyang Sun , Heyu Si , Qi Guo

Conducting real road testing for autonomous driving algorithms can be expensive and sometimes impractical, particularly for small startups and research institutes. Thus, simulation becomes an important method for evaluating these…

As perception models continue to develop, the need for large-scale datasets increases. However, data annotation remains far too expensive to effectively scale and meet the demand. Synthetic datasets provide a solution to boost model…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Arpit Jadon , Haoran Wang , Phillip Thomas , Michael Stanley , S. Nathaniel Cibik , Rachel Laurat , Omar Maher , Lukas Hoyer , Ozan Unal , Dengxin Dai

Driving simulation plays a crucial role in developing reliable driving agents by providing controlled, evaluative environments. To enable meaningful assessments, a high-quality driving simulator must satisfy several key requirements:…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Junzhe Jiang , Nan Song , Jingyu Li , Xiatian Zhu , Li Zhang

With deep learning and computer vision technology development, autonomous driving provides new solutions to improve traffic safety and efficiency. The importance of building high-quality datasets is self-evident, especially with the rise of…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Guohang Yan , Jiahao Pi , Jianfei Guo , Zhaotong Luo , Min Dou , Nianchen Deng , Qiusheng Huang , Daocheng Fu , Licheng Wen , Pinlong Cai , Xing Gao , Xinyu Cai , Bo Zhang , Xuemeng Yang , Yeqi Bai , Hongbin Zhou , Botian Shi

Scene simulation in autonomous driving has gained significant attention because of its huge potential for generating customized data. However, existing editable scene simulation approaches face limitations in terms of user interaction…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Yuxi Wei , Zi Wang , Yifan Lu , Chenxin Xu , Changxing Liu , Hao Zhao , Siheng Chen , Yanfeng Wang

Ego-centric driving videos available online provide an abundant source of visual data for autonomous driving, yet their lack of annotations makes it difficult to learn representations that capture both semantic structure and 3D geometry.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Matthew Strong , Wei-Jer Chang , Quentin Herau , Jiezhi Yang , Yihan Hu , Chensheng Peng , Wei Zhan

Today, there are two major paradigms for vision-based autonomous driving systems: mediated perception approaches that parse an entire scene to make a driving decision, and behavior reflex approaches that directly map an input image to a…

Computer Vision and Pattern Recognition · Computer Science 2015-09-29 Chenyi Chen , Ari Seff , Alain Kornhauser , Jianxiong Xiao

We consider the problem of estimating an object's physical properties such as mass, friction, and elasticity directly from video sequences. Such a system identification problem is fundamentally ill-posed due to the loss of information…

Simulation systems have become an essential component in the development and validation of autonomous driving technologies. The prevailing state-of-the-art approach for simulation is to use game engines or high-fidelity computer graphics…

Computer Vision and Pattern Recognition · Computer Science 2020-10-30 Wei Li , Chengwei Pan , Rong Zhang , Jiaping Ren , Yuexin Ma , Jin Fang , Feilong Yan , Qichuan Geng , Xinyu Huang , Huajun Gong , Weiwei Xu , Guoping Wang , Dinesh Manocha , Ruigang Yang

Dynamic scene reconstruction for autonomous driving enables vehicles to perceive and interpret complex scene changes more precisely. Dynamic Neural Radiance Fields (NeRFs) have recently shown promising capability in scene modeling. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Yue Wen , Liang Song , Yijia Liu , Siting Zhu , Yanzi Miao , Lijun Han , Hesheng Wang

Synthesizing photo-realistic visual observations from an ego vehicle's driving trajectory is a critical step towards scalable training of self-driving models. Reconstruction-based methods create 3D scenes from driving logs and synthesize…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Jiageng Mao , Boyi Li , Boris Ivanovic , Yuxiao Chen , Yan Wang , Yurong You , Chaowei Xiao , Danfei Xu , Marco Pavone , Yue Wang

Existing evaluation paradigms for Autonomous Vehicles (AVs) face critical limitations. Real-world evaluation is often challenging due to safety concerns and a lack of reproducibility, whereas closed-loop simulation can face insufficient…

Vision-centric autonomous driving has demonstrated excellent performance with economical sensors. As the fundamental step, 3D perception aims to infer 3D information from 2D images based on 3D-2D projection. This makes driving perception…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Ye Li , Wenzhao Zheng , Xiaonan Huang , Kurt Keutzer

Interactive video generation has significant potential for scene simulation and video creation. However, existing methods often struggle with maintaining scene consistency during long video generation under dynamic camera control due to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Xinhang Gao , Junlin Guan , Shuhan Luo , Wenzhuo Li , Guanghuan Tan , Jiacheng Wang

Simulation is increasingly being used for generating large labelled datasets in many machine learning problems. Recent methods have focused on adjusting simulator parameters with the goal of maximising accuracy on a validation task, usually…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Harkirat Singh Behl , Atılım Güneş Baydin , Ran Gal , Philip H. S. Torr , Vibhav Vineet

Synthesis of diverse driving scenes serves as a crucial data augmentation technique for validating the robustness and generalizability of autonomous driving systems. Current methods aggregate high-definition (HD) maps and 3D bounding boxes…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Zhechao Wang , Yiming Zeng , Lufan Ma , Zeqing Fu , Chen Bai , Ziyao Lin , Cheng Lu

Spike cameras, with their exceptional temporal resolution, are revolutionizing high-speed visual applications. Large-scale synthetic datasets have significantly accelerated the development of these cameras, particularly in reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Liwen Hu , Lei Ma , Yijia Guo , Tiejun Huang