English
Related papers

Related papers: Diff4Splat: Controllable 4D Scene Generation with …

200 papers

Realistic reconstruction of dynamic 4D scenes from monocular videos is essential for understanding the physical world. Despite recent progress in neural rendering, existing methods often struggle to recover accurate 3D geometry and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Haoran Zhou , Gim Hee Lee

Remarkable advances in recent 2D image and 3D shape generation have induced a significant focus on dynamic 4D content generation. However, previous 4D generation methods commonly struggle to maintain spatial-temporal consistency and adapt…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Mengmeng Liu , Jiuming Liu , Yunpeng Zhang , Jiangtao Li , Michael Ying Yang , Francesco Nex , Hao Cheng

Reconstructing intricate, ever-changing environments remains a central ambition in computer vision, yet existing solutions often crumble before the complexity of real-world dynamics. We present DynaSplat, an approach that extends Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Junli Deng , Ping Shi , Qipei Li , Jinyang Guo

Multi-view video reconstruction plays a vital role in computer vision, enabling applications in film production, virtual reality, and motion analysis. While recent advances such as 4D Gaussian Splatting (4DGS) have demonstrated impressive…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Zhixin Xu , Hengyu Zhou , Yuan Liu , Wenhan Xue , Hao Pan , Wenping Wang , Bin Wang

Recent advances in diffusion models have revolutionized 2D and 3D content creation, yet generating photorealistic dynamic 4D scenes remains a significant challenge. Existing dynamic 4D generation methods typically rely on distilling…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Vinayak Gupta , Yunze Man , Yu-Xiong Wang

Feed-forward 3D Gaussian Splatting methods have achieved impressive reconstruction quality for autonomous driving scenes, yet they entangle scene geometry with transient appearance properties such as lighting, weather, and time of day. This…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Quentin Herau , Tianshuo Xu , Depu Meng , Jiezhi Yang , Chensheng Peng , Spencer Sherk , Yihan Hu , Wei Zhan

3D Gaussian Splatting (3DGS) has emerged as an efficient and high-fidelity paradigm for novel view synthesis. To adapt 3DGS for dynamic content, deformable 3DGS incorporates temporally deformable primitives with learnable latent embeddings…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Mufan Liu , Qi Yang , He Huang , Wenjie Huang , Zhenlong Yuan , Zhu Li , Yiling Xu

We introduce MVSplat360, a feed-forward approach for 360{\deg} novel view synthesis (NVS) of diverse real-world scenes, using only sparse observations. This setting is inherently ill-posed due to minimal overlap among input views and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Yuedong Chen , Chuanxia Zheng , Haofei Xu , Bohan Zhuang , Andrea Vedaldi , Tat-Jen Cham , Jianfei Cai

Feedforward Gaussian Splatting has recently emerged as an efficient paradigm for 4D reconstruction in autonomous driving. However, in unstructured off-road scenes, its performance degrades due to high-frequency geometry, ego-motion jitter,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Shuo Wang , Jilin Mei , Fuyang Liu , Wenfei Guan , Fanjie Kong , Zhihua Zhao , Shuai Wang , Chen Min , Yu Hu

Synthesizing photo-realistic visual observations from an ego vehicle's driving trajectory is a critical step towards scalable training of self-driving models. Reconstruction-based methods create 3D scenes from driving logs and synthesize…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Jiageng Mao , Boyi Li , Boris Ivanovic , Yuxiao Chen , Yan Wang , Yurong You , Chaowei Xiao , Danfei Xu , Marco Pavone , Yue Wang

Recent advancements in 3D generation are predominantly propelled by improvements in 3D-aware image diffusion models. These models are pretrained on Internet-scale image data and fine-tuned on massive 3D data, offering the capability of…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Zeyu Yang , Zijie Pan , Chun Gu , Li Zhang

Previous text-to-4D methods have leveraged multiple Score Distillation Sampling (SDS) techniques, combining motion priors from video-based diffusion models (DMs) with geometric priors from multiview DMs to implicitly guide 4D renderings.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Qiaowei Miao , JinSheng Quan , Kehan Li , Yawei Luo

Fast and flexible 3D scene reconstruction from unstructured image collections remains a significant challenge. We present YoNoSplat, a feedforward model that reconstructs high-quality 3D Gaussian Splatting representations from an arbitrary…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Botao Ye , Boqi Chen , Haofei Xu , Daniel Barath , Marc Pollefeys

High-fidelity three-dimensional (3D) reconstruction is essential for robotics and simulation. While Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) achieve impressive rendering quality, their reliance on time-consuming…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Xiong Jinlin , Li Can , Shen Jiawei , Qi Zhigang , Sun Lei , Zhao Dongyang

This paper addresses the problem of dynamic scene surface reconstruction using Gaussian Splatting (GS), aiming to recover temporally consistent geometry. While existing GS-based dynamic surface reconstruction methods can yield superior…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Renjie Wu , Hongdong Li , Jose M. Alvarez , Miaomiao Liu

We introduce Drag4D, an interactive framework that integrates object motion control within text-driven 3D scene generation. This framework enables users to define 3D trajectories for the 3D objects generated from a single image, seamlessly…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Minjun Kang , Inkyu Shin , Taeyeop Lee , In So Kweon , Kuk-Jin Yoon

We present a latent diffusion model over 3D scenes, that can be trained using only 2D image data. To achieve this, we first design an autoencoder that maps multi-view images to 3D Gaussian splats, and simultaneously builds a compressed…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Paul Henderson , Melonie de Almeida , Daniela Ivanova , Titas Anciukevičius

In this paper, we propose Scene Splatter, a momentum-based paradigm for video diffusion to generate generic scenes from single image. Existing methods, which employ video generation models to synthesize novel views, suffer from limited…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Shengjun Zhang , Jinzhao Li , Xin Fei , Hao Liu , Yueqi Duan

Dynamic 3D scene representation and novel view synthesis are crucial for enabling immersive experiences required by AR/VR and metaverse applications. It is a challenging task due to the complexity of unconstrained real-world scenes and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Zeyu Yang , Zijie Pan , Xiatian Zhu , Li Zhang , Jianfeng Feng , Yu-Gang Jiang , Philip H. S. Torr

4D Gaussian Splatting (4DGS) has recently gained considerable attention as a method for reconstructing dynamic scenes. Despite achieving superior quality, 4DGS typically requires substantial storage and suffers from slow rendering speed. In…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Yuheng Yuan , Qiuhong Shen , Xingyi Yang , Xinchao Wang