English
Related papers

Related papers: 4DVGGT-D: 4D Visual Geometry Transformer with Impr…

200 papers

We introduce FLAG-4D, a novel framework for generating novel views of dynamic scenes by reconstructing how 3D Gaussian primitives evolve through space and time. Existing methods typically rely on a single Multilayer Perceptron (MLP) to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Guan Yuan Tan , Ngoc Tuan Vu , Arghya Pal , Sailaja Rajanala , Raphael Phan C. -W. , Mettu Srinivas , Chee-Ming Ting

Humans naturally perceive the geometric structure and semantic content of a 3D world as intertwined dimensions, enabling coherent and accurate understanding of complex scenes. However, most prior approaches prioritize training large…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Hao Li , Zhengyu Zou , Fangfu Liu , Xuanyang Zhang , Fangzhou Hong , Yukang Cao , Yushi Lan , Manyuan Zhang , Gang Yu , Dingwen Zhang , Ziwei Liu

We present Inst4DGS, an instance-decomposed 4D Gaussian Splatting (4DGS) approach with long-horizon per-Gaussian trajectories. While dynamic 4DGS has advanced rapidly, instance-decomposed 4DGS remains underexplored, largely due to the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Yonghan Lee , Dinesh Manocha

Dynamic scene reconstruction is a long-term challenge in 3D vision. Existing plane-based methods in dynamic Gaussian splatting suffer from an unsuitable low-rank assumption, causing feature overlap and poor rendering quality. Although 4D…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Jie Chen , Zhangchi Hu , Peixi Wu , Huyue Zhu , Hebei Li , Xiaoyan Sun

Aided by text-to-image and text-to-video diffusion models, existing 4D content creation pipelines utilize score distillation sampling to optimize the entire dynamic 3D scene. However, as these pipelines generate 4D content from text or…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Yuyang Yin , Dejia Xu , Zhangyang Wang , Yao Zhao , Yunchao Wei

Depth estimation is a crucial technology in robotics. Recently, self-supervised depth estimation methods have demonstrated great potential as they can efficiently leverage large amounts of unlabelled real-world data. However, most existing…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Siyu Chen , Hong Liu , Wenhao Li , Ying Zhu , Guoquan Wang , Jianbing Wu

4D Gaussian Splatting (4DGS) has recently emerged as a promising technique for capturing complex dynamic 3D scenes with high fidelity. It utilizes a 4D Gaussian representation and a GPU-friendly rasterizer, enabling rapid rendering speeds.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Xinjie Zhang , Zhening Liu , Yifan Zhang , Xingtong Ge , Dailan He , Tongda Xu , Yan Wang , Zehong Lin , Shuicheng Yan , Jun Zhang

Dynamic urban scene modeling is a rapidly evolving area with broad applications. While current approaches leveraging neural radiance fields or Gaussian Splatting have achieved fine-grained reconstruction and high-fidelity novel view…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Yuru Xiao , Zihan Lin , Chao Lu , Deming Zhai , Kui Jiang , Wenbo Zhao , Wei Zhang , Junjun Jiang , Huanran Wang , Xianming Liu

Achieving truly practical dynamic 3D reconstruction requires online operation, global pose and map consistency, detailed appearance modeling, and the flexibility to handle both RGB and RGB-D inputs. However, existing SLAM methods typically…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Shi Chen , Erik Sandström , Sandro Lombardi , Siyuan Li , Martin R. Oswald

4D scans of dynamic deformable human body parts help researchers have a better understanding of spatiotemporal features. However, reconstructing 4D scans based on multiple asynchronous cameras encounters two main challenges: 1) finding the…

Image and Video Processing · Electrical Eng. & Systems 2023-07-25 Farzam Tajdari , Toon Huysmans , Xinhe Yao , Jun Xu , Yu Song

3D Gaussian Splatting (3DGS) has substantial potential for enabling photorealistic Free-Viewpoint Video (FVV) experiences. However, the vast number of Gaussians and their associated attributes poses significant challenges for storage and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Qiang Hu , Zihan Zheng , Houqiang Zhong , Sihua Fu , Li Song , XiaoyunZhang , Guangtao Zhai , Yanfeng Wang

Powerful 3D representations such as DUSt3R invariant point maps, which encode 3D shape and camera parameters, have significantly advanced feed forward 3D reconstruction. While point maps assume static scenes, Dynamic Point Maps (DPMs)…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Edgar Sucar , Eldar Insafutdinov , Zihang Lai , Andrea Vedaldi

This paper presents VGGT-360, a novel training-free framework for zero-shot, geometry-consistent panoramic depth estimation. Unlike prior view-independent training-free approaches, VGGT-360 reformulates the task as panoramic reprojection…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Jiayi Yuan , Haobo Jiang , De Wen Soh , Na Zhao

Video stabilization aims to mitigate camera shake but faces a fundamental trade-off between geometric robustness and full-frame consistency. While 2D methods suffer from aggressive cropping, 3D techniques are often undermined by fragile…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Muhua Zhu , Xinhao Jin , Yu Zhang , Yifei Xue , Tie Ji , Yizhen Lao

High-fidelity reconstruction of dynamic scenes is an important yet challenging problem. While recent 4D Gaussian Splatting (4DGS) has demonstrated the ability to model temporal dynamics, it couples Gaussian motion and geometric attributes…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Yi Zhang , Yulei Kang , Jiangxin Sun , Beihao Xia , Jisheng Dang , Jian-Fang Hu

Reconstructing and tracking dynamic 3D scenes remains a fundamental challenge in computer vision. Existing approaches often decouple geometry from motion: multi-view reconstruction methods assume static scenes, while dynamic tracking…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Shenhan Qian , Ganlin Zhang , Shangzhe Wu , Daniel Cremers

4D reconstruction from casually captured monocular videos is challenging due to inherent ambiguity in reconstructing dynamic 3D geometry. To address this challenge, we introduce Robust Dynamic Gaussian Splatting (RoDyGS), a method that…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Junmyeong Lee , Hoseung Choi , Yoonwoo Jeong , Minsu Cho

We propose an approach for 3D reconstruction and segmentation of a single object placed on a flat surface from an input video. Our approach is to perform dense depth map estimation for multiple views using a proposed objective function that…

Computer Vision and Pattern Recognition · Computer Science 2016-07-29 Tanmay Gupta , Daeyun Shin , Naren Sivagnanadasan , Derek Hoiem

Estimating precise metric depth and scene reconstruction from monocular endoscopy is a fundamental task for surgical navigation in robotic surgery. However, traditional stereo matching adopts binocular images to perceive the depth…

Robotics · Computer Science 2022-11-29 Ruofeng Wei , Bin Li , Hangjie Mo , Fangxun Zhong , Yonghao Long , Qi Dou , Yun-Hui Liu , Dong Sun

We present Free4D, a novel tuning-free framework for 4D scene generation from a single image. Existing methods either focus on object-level generation, making scene-level generation infeasible, or rely on large-scale multi-view video…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Tianqi Liu , Zihao Huang , Zhaoxi Chen , Guangcong Wang , Shoukang Hu , Liao Shen , Huiqiang Sun , Zhiguo Cao , Wei Li , Ziwei Liu