English
Related papers

Related papers: L4GM: Large 4D Gaussian Reconstruction Model

200 papers

Reconstructing dynamic scenes with large-scale and complex motions remains a significant challenge. Recent techniques like Neural Radiance Fields and 3D Gaussian Splatting (3DGS) have shown promise but still struggle with scenes involving…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Qiankun Gao , Yanmin Wu , Chengxiang Wen , Jiarui Meng , Luyang Tang , Jie Chen , Ronggang Wang , Jian Zhang

Free-viewpoint video (FVV) enables immersive viewing experiences by allowing users to view scenes from arbitrary perspectives. As a prominent reconstruction technique for FVV generation, 4D Gaussian Splatting (4DGS) models dynamic scenes…

Graphics · Computer Science 2025-12-25 Zhe Wang , Jinghang Li , Yifei Zhu

Existing feed-forward 3D Gaussian Splatting methods predict pixel-aligned primitives, leading to a quadratic growth in primitive count as resolution increases. This fundamentally limits their scalability, making high-resolution synthesis…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Yixing Lao , Xuyang Bai , Xiaoyang Wu , Nuoyuan Yan , Zixin Luo , Tian Fang , Jean-Daniel Nahmias , Yanghai Tsin , Shiwei Li , Hengshuang Zhao

3D Gaussian Splatting (3DGS) has garnered significant attention due to its superior scene representation fidelity and real-time rendering performance, especially for dynamic 3D scene reconstruction (\textit{i.e.}, 4D reconstruction).…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Henan Wang , Hanxin Zhu , Xinliang Gong , Tianyu He , Xin Li , Zhibo Chen

Humans naturally retain memories of permanent elements, while ephemeral moments often slip through the cracks of memory. This selective retention is crucial for robotic perception, localization, and mapping. To endow robots with this…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Yiming Li , Zehong Wang , Yue Wang , Zhiding Yu , Zan Gojcic , Marco Pavone , Chen Feng , Jose M. Alvarez

We present Inst4DGS, an instance-decomposed 4D Gaussian Splatting (4DGS) approach with long-horizon per-Gaussian trajectories. While dynamic 4DGS has advanced rapidly, instance-decomposed 4DGS remains underexplored, largely due to the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Yonghan Lee , Dinesh Manocha

4D Gaussian Splatting has emerged as a new paradigm for dynamic scene representation, enabling real-time rendering of scenes with complex motions. However, it faces a major challenge of storage overhead, as millions of Gaussians are…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Minseo Lee , Byeonghyeon Lee , Lucas Yunkyu Lee , Eunsoo Lee , Sangmin Kim , Seunghyeon Song , Joo Chan Lee , Jong Hwan Ko , Jaesik Park , Eunbyung Park

Immersive video offers a 6-Dof-free viewing experience, potentially playing a key role in future video technology. Recently, 4D Gaussian Splatting has gained attention as an effective approach for immersive video due to its high rendering…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Hao Li , Sicheng Li , Xiang Gao , Abudouaihati Batuer , Lu Yu , Yiyi Liao

Reconstructing the human body from single-view videos plays a pivotal role in the virtual reality domain. One prevalent application scenario necessitates the rapid reconstruction of high-fidelity 3D digital humans while simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Mingwei Li , Jiachen Tao , Zongxin Yang , Yi Yang

We present GP-4DGS, a novel framework that integrates Gaussian Processes (GPs) into 4D Gaussian Splatting (4DGS) for principled probabilistic modeling of dynamic scenes. While existing 4DGS methods focus on deterministic reconstruction,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Mijeong Kim , Jungtaek Kim , Bohyung Han

3D Gaussian Splatting has shown fast and high-quality rendering results in static scenes by leveraging dense 3D prior and explicit representations. Unfortunately, the benefits of the prior and representation do not involve novel view…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Junoh Lee , Chang-Yeon Won , Hyunjun Jung , Inhwan Bae , Hae-Gon Jeon

4D Gaussian Splatting (4DGS) has recently emerged as a promising technique for capturing complex dynamic 3D scenes with high fidelity. It utilizes a 4D Gaussian representation and a GPU-friendly rasterizer, enabling rapid rendering speeds.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Xinjie Zhang , Zhening Liu , Yifan Zhang , Xingtong Ge , Dailan He , Tongda Xu , Yan Wang , Zehong Lin , Shuicheng Yan , Jun Zhang

We present V2M4, a novel 4D reconstruction method that directly generates a usable 4D mesh animation asset from a single monocular video. Unlike existing approaches that rely on priors from multi-view image and video generation models, our…

Graphics · Computer Science 2025-07-30 Jianqi Chen , Biao Zhang , Xiangjun Tang , Peter Wonka

Reconstructing dynamic 3D scenes from monocular videos is a fundamental yet highly challenging task, as real-world motions often involve both long-term smooth transformations and short-term complex deformations. Existing methods either…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Chenyu Wu , Wanhua Li , Zhu-Tian Chen , Hanspeter Pfister

We present LAM, an innovative Large Avatar Model for animatable Gaussian head reconstruction from a single image. Unlike previous methods that require extensive training on captured video sequences or rely on auxiliary neural networks for…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Yisheng He , Xiaodong Gu , Xiaodan Ye , Chao Xu , Zhengyi Zhao , Yuan Dong , Weihao Yuan , Zilong Dong , Liefeng Bo

We propose RelitLRM, a Large Reconstruction Model (LRM) for generating high-quality Gaussian splatting representations of 3D objects under novel illuminations from sparse (4-8) posed images captured under unknown static lighting. Unlike…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Tianyuan Zhang , Zhengfei Kuang , Haian Jin , Zexiang Xu , Sai Bi , Hao Tan , He Zhang , Yiwei Hu , Milos Hasan , William T. Freeman , Kai Zhang , Fujun Luan

Single-image 3D reconstruction remains a fundamental challenge in computer vision due to inherent geometric ambiguities and limited viewpoint information. Recent advances in Latent Video Diffusion Models (LVDMs) offer promising 3D priors…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Yabo Chen , Chen Yang , Jiemin Fang , Xiaopeng Zhang , Lingxi Xie , Wei Shen , Wenrui Dai , Hongkai Xiong , Qi Tian

We propose Mesh4D, a feed-forward model for monocular 4D mesh reconstruction. Given a monocular video of a dynamic object, our model reconstructs the object's complete 3D shape and motion, represented as a deformation field. Our key…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Zeren Jiang , Chuanxia Zheng , Iro Laina , Diane Larlus , Andrea Vedaldi

Multi-view video reconstruction plays a vital role in computer vision, enabling applications in film production, virtual reality, and motion analysis. While recent advances such as 4D Gaussian Splatting (4DGS) have demonstrated impressive…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Zhixin Xu , Hengyu Zhou , Yuan Liu , Wenhan Xue , Hao Pan , Wenping Wang , Bin Wang

Recent advancements in 2D/3D generative techniques have facilitated the generation of dynamic 3D objects from monocular videos. Previous methods mainly rely on the implicit neural radiance fields (NeRF) or explicit Gaussian Splatting as the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Zhiqi Li , Yiming Chen , Peidong Liu