English
Related papers

Related papers: SyncTrack4D: Cross-Video Motion Alignment and Vide…

200 papers

Novel view synthesis (NVS) of static and dynamic urban scenes is essential for autonomous driving simulation, yet existing methods often struggle to balance reconstruction time with quality. While state-of-the-art neural radiance fields and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Sheng Miao , Sijin Li , Pan Wang , Dongfeng Bai , Bingbing Liu , Yue Wang , Andreas Geiger , Yiyi Liao

Dynamic scene reconstruction has garnered significant attention in recent years due to its capabilities in high-quality and real-time rendering. Among various methodologies, constructing a 4D spatial-temporal representation, such as 4D-GS,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Weiwei Cai , Weicai Ye , Peng Ye , Tong He , Tao Chen

Dynamic 3D scene representation and novel view synthesis are crucial for enabling immersive experiences required by AR/VR and metaverse applications. It is a challenging task due to the complexity of unconstrained real-world scenes and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Zeyu Yang , Zijie Pan , Xiatian Zhu , Li Zhang , Jianfeng Feng , Yu-Gang Jiang , Philip H. S. Torr

We present Inst4DGS, an instance-decomposed 4D Gaussian Splatting (4DGS) approach with long-horizon per-Gaussian trajectories. While dynamic 4DGS has advanced rapidly, instance-decomposed 4DGS remains underexplored, largely due to the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Yonghan Lee , Dinesh Manocha

Remarkable advances in recent 2D image and 3D shape generation have induced a significant focus on dynamic 4D content generation. However, previous 4D generation methods commonly struggle to maintain spatial-temporal consistency and adapt…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Mengmeng Liu , Jiuming Liu , Yunpeng Zhang , Jiangtao Li , Michael Ying Yang , Francesco Nex , Hao Cheng

Recent advancements in 2D and 3D generative models have expanded the capabilities of computer vision. However, generating high-quality 4D dynamic content from a single static image remains a significant challenge. Traditional methods have…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Jing Yang , Yufeng Yang

Existing 4D Gaussian Splatting (4DGS) methods struggle to accurately reconstruct dynamic scenes, often failing to resolve ambiguous pixel correspondences and inadequate densification in dynamic regions. We address these issues by…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Taeho Kang , Jaeyeon Park , Kyungjin Lee , Youngki Lee

Persistent dynamic scene modeling for tracking and novel-view synthesis remains challenging due to the difficulty of capturing accurate deformations while maintaining computational efficiency. We propose SCas4D, a cascaded optimization…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Jipeng Lyu , Jiahua Dong , Yu-Xiong Wang

Novel view synthesis of dynamic scenes is becoming important in various applications, including augmented and virtual reality. We propose a novel 4D Gaussian Splatting (4DGS) algorithm for dynamic scenes from casually recorded monocular…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Mijeong Kim , Jongwoo Lim , Bohyung Han

Simultaneous localization and mapping (SLAM) technology has recently achieved photorealistic mapping capabilities thanks to the real-time, high-fidelity rendering enabled by 3D Gaussian Splatting (3DGS). However, due to the static…

Robotics · Computer Science 2025-12-01 Zhicong Sun , Jacqueline Lo , Jinxing Hu

4D content generation has achieved remarkable progress recently. However, existing methods suffer from long optimization times, a lack of motion controllability, and a low quality of details. In this paper, we introduce DreamGaussian4D…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Jiawei Ren , Liang Pan , Jiaxiang Tang , Chi Zhang , Ang Cao , Gang Zeng , Ziwei Liu

Recently, Gaussian Splatting methods have emerged as a desirable substitute for prior Radiance Field methods for novel-view synthesis of scenes captured with multi-view images or videos. In this work, we propose a novel extension to 4D…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Karly Hou , Wanhua Li , Hanspeter Pfister

Creating 4D fields of Gaussian Splatting from images or videos is a challenging task due to its under-constrained nature. While the optimization can draw photometric reference from the input videos or be regulated by generative models,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Quankai Gao , Qiangeng Xu , Zhe Cao , Ben Mildenhall , Wenchao Ma , Le Chen , Danhang Tang , Ulrich Neumann

Recent advancements in 3D Gaussian Splatting (3DGS) have demonstrated its potential for efficient and photorealistic 3D reconstructions, which is crucial for diverse applications such as robotics and immersive media. However, current…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Daheng Yin , Isaac Ding , Yili Jin , Jianxin Shi , Jiangchuan Liu

Dynamic urban scene modeling is a rapidly evolving area with broad applications. While current approaches leveraging neural radiance fields or Gaussian Splatting have achieved fine-grained reconstruction and high-fidelity novel view…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Yuru Xiao , Zihan Lin , Chao Lu , Deming Zhai , Kui Jiang , Wenbo Zhao , Wei Zhang , Junjun Jiang , Huanran Wang , Xianming Liu

Recent advancements in foundation models for 2D vision have substantially improved the analysis of dynamic scenes from monocular videos. However, despite their strong generalization capabilities, these models often lack 3D consistency, a…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Haoran Zhou , Gim Hee Lee

We propose 4DGT, a 4D Gaussian-based Transformer model for dynamic scene reconstruction, trained entirely on real-world monocular posed videos. Using 4D Gaussian as an inductive bias, 4DGT unifies static and dynamic components, enabling the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Zhen Xu , Zhengqin Li , Zhao Dong , Xiaowei Zhou , Richard Newcombe , Zhaoyang Lv

Gaussian Splatting (GS) has significantly elevated scene reconstruction efficiency and novel view synthesis (NVS) accuracy compared to Neural Radiance Fields (NeRF), particularly for dynamic scenes. However, current 4D NVS methods, whether…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Fang Li , Hao Zhang , Narendra Ahuja

Reconstructing dynamic 3D scenes with photorealistic detail and strong temporal coherence remains a significant challenge. Existing Gaussian splatting approaches for dynamic scene modeling often rely on per-frame optimization, which can…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Tingxuan Huang , Haowei Zhu , Jun-hai Yong , Hao Pan , Bin Wang

3D Gaussian Splatting (3DGS) has shown remarkable success in synthesizing novel views given multiple views of a static scene. Yet, 3DGS faces challenges when applied to dynamic scenes because 3D Gaussian parameters need to be updated per…

Graphics · Computer Science 2024-07-08 Kai Katsumata , Duc Minh Vo , Hideki Nakayama