English
Related papers

Related papers: 4D Driving Scene Generation With Stereo Forcing

200 papers

Recent advancements in generative models have ignited substantial interest in dynamic 3D content creation (\ie, 4D generation). Existing approaches primarily rely on Score Distillation Sampling (SDS) to infer novel-view videos, typically…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Hanxin Zhu , Tianyu He , Xiqian Yu , Junliang Guo , Zhibo Chen , Jiang Bian

Perpetual view generation aims to synthesize a long-term video corresponding to an arbitrary camera trajectory solely from a single input image. Recent methods commonly utilize a pre-trained text-to-image diffusion model to synthesize new…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Bo Pan , Yang Chen , Yingwei Pan , Ting Yao , Wei Chen , Tao Mei

Recent progress in pre-trained diffusion models and 3D generation have spurred interest in 4D content creation. However, achieving high-fidelity 4D generation with spatial-temporal consistency remains a challenge. In this work, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Yifei Zeng , Yanqin Jiang , Siyu Zhu , Yuanxun Lu , Youtian Lin , Hao Zhu , Weiming Hu , Xun Cao , Yao Yao

Recent advancements in video generation have substantially improved visual quality and temporal coherence, making these models increasingly appealing for applications such as autonomous driving, particularly in the context of driving…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Chun-Peng Chang , Chen-Yu Wang , Julian Schmidt , Holger Caesar , Alain Pagani

Novel view synthesis requires strong 3D geometric consistency and the ability to generate visually coherent images across diverse viewpoints. While recent camera-controlled video diffusion models show promising results, they often suffer…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Minjun Kang , Inkyu Shin , Taeyeop Lee , Myungchul Kim , In So Kweon , Kuk-Jin Yoon

Recent advances in diffusion models have demonstrated exceptional capabilities in image and video generation, further improving the effectiveness of 4D synthesis. Existing 4D generation methods can generate high-quality 4D objects or scenes…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Bohan Zeng , Ling Yang , Siyu Li , Jiaming Liu , Zixiang Zhang , Juanxi Tian , Kaixin Zhu , Yongzhen Guo , Fu-Yun Wang , Minkai Xu , Stefano Ermon , Wentao Zhang

We study the problem of novel view synthesis from sparse source observations of a scene comprised of 3D objects. We propose a simple yet effective approach that is neither continuous nor implicit, challenging recent trends on view…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Pengsheng Guo , Miguel Angel Bautista , Alex Colburn , Liang Yang , Daniel Ulbricht , Joshua M. Susskind , Qi Shan

Representing and rendering dynamic scenes has been an important but challenging task. Especially, to accurately model complex motions, high efficiency is usually hard to guarantee. To achieve real-time dynamic scene rendering while also…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Guanjun Wu , Taoran Yi , Jiemin Fang , Lingxi Xie , Xiaopeng Zhang , Wei Wei , Wenyu Liu , Qi Tian , Xinggang Wang

Novel-view synthesis techniques achieve impressive results for static scenes but struggle when faced with the inconsistencies inherent to casual capture settings: varying illumination, scene motion, and other unintended effects that are…

Recent advances in 2D/3D generative models enable the generation of dynamic 3D objects from a single-view video. Existing approaches utilize score distillation sampling to form the dynamic scene as dynamic NeRF or dense 3D Gaussians.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Zijie Wu , Chaohui Yu , Yanqin Jiang , Chenjie Cao , Fan Wang , Xiang Bai

Recent generative video models achieve impressive visual quality but remain constrained by limited physical consistency and controllability. Existing video generation methods provide minimal physical control, and single-image-to-3D…

Graphics · Computer Science 2026-05-21 Xin Zhang , Yabo Chen , Yijie Fang , Wanying Qu , Haibin Huang , Chi Zhang , Feng Xu , Xuelong Li

Reconstructing dynamic 3D scenes with photorealistic detail and strong temporal coherence remains a significant challenge. Existing Gaussian splatting approaches for dynamic scene modeling often rely on per-frame optimization, which can…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Tingxuan Huang , Haowei Zhu , Jun-hai Yong , Hao Pan , Bin Wang

Recent progress in video generation has led to substantial improvements in visual fidelity, yet ensuring physically consistent motion remains a fundamental challenge. Intuitively, this limitation can be attributed to the fact that…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Cong Wang , Hanxin Zhu , Xiao Tang , Jiayi Luo , Xin Jin , Long Chen , Zhibo Chen

Text-driven 3D indoor scene generation holds broad applications, ranging from gaming and smart homes to AR/VR applications. Fast and high-fidelity scene generation is paramount for ensuring user-friendly experiences. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Yikun Ma , Dandan Zhan , Zhi Jin

Generative latent-variable models are emerging as promising tools in robotics and reinforcement learning. Yet, even though tasks in these domains typically involve distinct objects, most state-of-the-art generative models do not explicitly…

Machine Learning · Computer Science 2020-11-24 Martin Engelcke , Adam R. Kosiorek , Oiwi Parker Jones , Ingmar Posner

Novel view synthesis (NVS) boosts immersive experiences in computer vision and graphics. Existing techniques, though progressed, rely on dense multi-view observations, restricting their application. This work takes on the challenge of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Songchun Zhang , Huiyao Xu , Sitong Guo , Zhongwei Xie , Hujun Bao , Weiwei Xu , Changqing Zou

Controllable scene generation could reduce the cost of diverse data collection substantially for autonomous driving. Prior works formulate the traffic layout generation as predictive progress, either by denoising entire sequences at once or…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Yunsong Zhou , Naisheng Ye , William Ljungbergh , Tianyu Li , Jiazhi Yang , Zetong Yang , Hongzi Zhu , Christoffer Petersson , Hongyang Li

Cinematic video production requires control over scene-subject composition and camera movement, but live-action shooting remains costly due to the need for constructing physical sets. To address this, we introduce the task of cinematic…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Kaiyi Huang , Yukun Huang , Yu Li , Jianhong Bai , Xintao Wang , Zinan Lin , Xuefei Ning , Jiwen Yu , Pengfei Wan , Yu Wang , Xihui Liu

Feedforward Gaussian Splatting has recently emerged as an efficient paradigm for 4D reconstruction in autonomous driving. However, in unstructured off-road scenes, its performance degrades due to high-frequency geometry, ego-motion jitter,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Shuo Wang , Jilin Mei , Fuyang Liu , Wenfei Guan , Fanjie Kong , Zhihua Zhao , Shuai Wang , Chen Min , Yu Hu

Novel View Synthesis (NVS) aims to generate unseen views of a 3D object given a limited number of known views. Existing methods often struggle to synthesize plausible views for unobserved regions, particularly under single-view input, and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Jinglin Liang , Zijian Zhou , Rui Huang , Shuangping Huang , Yichen Gong