English
Related papers

Related papers: 4DGT: Learning a 4D Gaussian Transformer Using Rea…

200 papers

3D Gaussian Splatting (GS) enables highly photorealistic scene reconstruction from posed image sequences but struggles with viewpoint extrapolation due to its anisotropic nature, leading to overfitting and poor generalization, particularly…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Shuohan Tao , Boyao Zhou , Hanzhang Tu , Yuwang Wang , Yebin Liu

We present a method that simultaneously addresses the tasks of dynamic scene novel-view synthesis and six degree-of-freedom (6-DOF) tracking of all dense scene elements. We follow an analysis-by-synthesis framework, inspired by recent work…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Jonathon Luiten , Georgios Kopanas , Bastian Leibe , Deva Ramanan

Modeling dynamic scenes through 4D Gaussians offers high visual fidelity and fast rendering speeds, but comes with significant storage overhead. Recent approaches mitigate this cost by aggressively reducing the number of Gaussians. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Woong Oh Cho , In Cho , Seoha Kim , Jeongmin Bae , Youngjung Uh , Seon Joo Kim

Recent progress in pre-trained diffusion models and 3D generation have spurred interest in 4D content creation. However, achieving high-fidelity 4D generation with spatial-temporal consistency remains a challenge. In this work, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Yifei Zeng , Yanqin Jiang , Siyu Zhu , Yuanxun Lu , Youtian Lin , Hao Zhu , Weiming Hu , Xun Cao , Yao Yao

Reconstructing high-quality 3D models from sparse 2D images has garnered significant attention in computer vision. Recently, 3D Gaussian Splatting (3DGS) has gained prominence due to its explicit representation with efficient training speed…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Keng-Wei Chang , Zi-Ming Wang , Shang-Hong Lai

Achieving truly practical dynamic 3D reconstruction requires online operation, global pose and map consistency, detailed appearance modeling, and the flexibility to handle both RGB and RGB-D inputs. However, existing SLAM methods typically…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Shi Chen , Erik Sandström , Sandro Lombardi , Siyuan Li , Martin R. Oswald

We propose a method that achieves state-of-the-art rendering quality and efficiency on monocular dynamic scene reconstruction using deformable 3D Gaussians. Implicit deformable representations commonly model motion with a canonical space…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Yiqing Liang , Numair Khan , Zhengqin Li , Thu Nguyen-Phuoc , Douglas Lanman , James Tompkin , Lei Xiao

We introduce FLAG-4D, a novel framework for generating novel views of dynamic scenes by reconstructing how 3D Gaussian primitives evolve through space and time. Existing methods typically rely on a single Multilayer Perceptron (MLP) to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Guan Yuan Tan , Ngoc Tuan Vu , Arghya Pal , Sailaja Rajanala , Raphael Phan C. -W. , Mettu Srinivas , Chee-Ming Ting

4D reconstruction from casually captured monocular videos is challenging due to inherent ambiguity in reconstructing dynamic 3D geometry. To address this challenge, we introduce Robust Dynamic Gaussian Splatting (RoDyGS), a method that…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Junmyeong Lee , Hoseung Choi , Yoonwoo Jeong , Minsu Cho

High-fidelity 3D video reconstruction is essential for enabling real-time rendering of dynamic scenes with realistic motion in virtual and augmented reality (VR/AR). The deformation field paradigm of 3D Gaussian splatting has achieved…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Zhenyang Li , Xiaoyang Bai , Tongchen Zhang , Pengfei Shen , Weiwei Xu , Yifan Peng

3D Gaussian Splatting (3DGS) has gained significant attention for its real-time, photo-realistic rendering in novel-view synthesis and 3D modeling. However, existing methods struggle with accurately modeling in-the-wild scenes affected by…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Chuanyu Fu , Guanying Chen , Yuqi Zhang , Kunbin Yao , Yuan Xiong , Chuan Huang , Shuguang Cui , Yasuyuki Matsushita , Xiaochun Cao

Egocentric video provides a unique view into human perception and interaction, with growing relevance for augmented reality, robotics, and assistive technologies. However, rapid camera motion and complex scene dynamics pose major challenges…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Jan Warchocki , Xi Wang , Jonas Kulhanek , Jan van Gemert

This paper addresses the challenge of novel-view synthesis and motion reconstruction of dynamic scenes from monocular video, which is critical for many robotic applications. Although Neural Radiance Fields (NeRF) and 3D Gaussian Splatting…

Robotics · Computer Science 2025-08-12 Xuesong Li , Lars Petersson , Vivien Rolland

Recent methods have made significant progress in synthesizing novel views with long video sequences. This paper proposes a highly scalable method for dynamic novel view synthesis with continual learning. We leverage the 3D Gaussians to…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Zhenhuan Liu , Shuai Liu , Yidong Lu , Yirui Chen , Jie Yang , Wei Liu

In the domain of 3D scene representation, 3D Gaussian Splatting (3DGS) has emerged as a pivotal technology. However, its application to large-scale, high-resolution scenes (exceeding 4k$\times$4k pixels) is hindered by the excessive…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Wenkai Liu , Tao Guan , Bin Zhu , Lili Ju , Zikai Song , Dan Li , Yuesong Wang , Wei Yang

Dynamic Gaussian Splatting approaches have achieved remarkable performance for 4D scene reconstruction. However, these approaches rely on dense-frame video sequences for photorealistic reconstruction. In real-world scenarios, due to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Changyue Shi , Chuxiao Yang , Xinyuan Hu , Minghao Chen , Wenwen Pan , Yan Yang , Jiajun Ding , Zhou Yu , Jun Yu

The advancement of real-time 3D scene reconstruction and novel view synthesis has been significantly propelled by 3D Gaussian Splatting (3DGS). However, effectively training large-scale 3DGS and rendering it in real-time across various…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Yang Liu , He Guan , Chuanchen Luo , Lue Fan , Naiyan Wang , Junran Peng , Zhaoxiang Zhang

Dynamic scene reconstruction is a long-term challenge in the field of 3D vision. Recently, the emergence of 3D Gaussian Splatting has provided new insights into this problem. Although subsequent efforts rapidly extend static 3D Gaussian to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Ruijie Zhu , Yanzhe Liang , Hanzhi Chang , Jiacheng Deng , Jiahao Lu , Wenfei Yang , Tianzhu Zhang , Yongdong Zhang

Novel view synthesis has shown rapid progress recently, with methods capable of producing increasingly photorealistic results. 3D Gaussian Splatting has emerged as a promising method, producing high-quality renderings of scenes and enabling…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Richard Shaw , Michal Nazarczuk , Jifei Song , Arthur Moreau , Sibi Catley-Chandar , Helisa Dhamo , Eduardo Perez-Pellitero

We tackle the task of learning dynamic 3D semantic radiance fields given a single monocular video as input. Our learned semantic radiance field captures per-point semantics as well as color and geometric properties for a dynamic 3D scene,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Isaac Labe , Noam Issachar , Itai Lang , Sagie Benaim