English
Related papers

Related papers: GFlow: Recovering 4D World from Monocular Video

200 papers

Estimating the 3D trajectory of every pixel from a monocular video is crucial and promising for a comprehensive understanding of the 3D dynamics of videos. Recent monocular 3D tracking works demonstrate impressive performance, but are…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Jiahao Lu , Jiayi Xu , Wenbo Hu , Ruijie Zhu , Chengfeng Zhao , Sai-Kit Yeung , Ying Shan , Yuan Liu

Reconstructing dynamic humans together with static scenes from monocular videos remains difficult, especially under fast motion, where RGB frames suffer from motion blur. Event cameras exhibit distinct advantages, e.g., microsecond temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Xiaoting Yin , Hao Shi , Kailun Yang , Jiajun Zhai , Shangwei Guo , Lin Wang , Kaiwei Wang

Generating 4D scenes from a single-view video is inherently ill-posed: a single viewpoint lacks the information needed to recover a complete, dynamic scene with full coverage. Existing methods are typically limited to monocular videos,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Tingxi Chen , Ke Hao , Yabo Chen , Zhengxue Cheng , Rong Xie , Li Song , Haibin Huang , Chi Zhang , Xuelong Li

We aim to address sparse-view reconstruction of a 3D scene by leveraging priors from large-scale vision models. While recent advancements such as 3D Gaussian Splatting (3DGS) have demonstrated remarkable successes in 3D reconstruction,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Hanyang Yu , Xiaoxiao Long , Ping Tan

Reconstructing clean, distractor-free 3D scenes from real-world captures remains a significant challenge, particularly in highly dynamic and cluttered settings such as egocentric videos. To tackle this problem, we introduce DeGauss, a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Rui Wang , Quentin Lohmeyer , Mirko Meboldt , Siyu Tang

We present MOSAIC-GS, a novel, fully explicit, and computationally efficient approach for high-fidelity dynamic scene reconstruction from monocular videos using Gaussian Splatting. Monocular reconstruction is inherently ill-posed due to the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Svitlana Morkva , Maximum Wilder-Smith , Michael Oechsle , Alessio Tonioni , Marco Hutter , Vaishakh Patil

Multi-view video reconstruction plays a vital role in computer vision, enabling applications in film production, virtual reality, and motion analysis. While recent advances such as 4D Gaussian Splatting (4DGS) have demonstrated impressive…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Zhixin Xu , Hengyu Zhou , Yuan Liu , Wenhan Xue , Hao Pan , Wenping Wang , Bin Wang

Reconstructing dynamic 3D scenes from monocular video remains fundamentally challenging due to the need to jointly infer motion, structure, and appearance from limited observations. Existing dynamic scene reconstruction methods based on…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Jiahui Li , Shengeng Tang , Jingxuan He , Gang Huang , Zhangye Wang , Yantao Pan , Lechao Cheng

In this paper, we present a new inpainting framework for recovering missing regions of video frames. Compared with image inpainting, performing this task on video presents new challenges such as how to preserving temporal consistency and…

Computer Vision and Pattern Recognition · Computer Science 2019-05-09 Yifan Ding , Chuan Wang , Haibin Huang , Jiaming Liu , Jue Wang , Liqiang Wang

Gaussian splatting has recently gained traction as a compelling map representation for SLAM systems, enabling dense and photo-realistic scene modeling. However, its application to monocular SLAM remains challenging due to the lack of…

Robotics · Computer Science 2026-04-20 Dong-Uk Seo , Jinwoo Jeon , Eungchang Mason Lee , Hyun Myung

Constructing photo-realistic Free-Viewpoint Videos (FVVs) of dynamic scenes from multi-view videos remains a challenging endeavor. Despite the remarkable advancements achieved by current neural rendering techniques, these methods generally…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Jiakai Sun , Han Jiao , Guangyuan Li , Zhanjie Zhang , Lei Zhao , Wei Xing

Modeling the time-varying 3D appearance of plants during growth poses unique challenges: unlike most dynamic scenes, plants continuously generate new geometry as they expand, branch, and differentiate. Existing dynamic scene representations…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Weihan Luo , Lily Goli , Sherwin Bahmani , Felix Taubner , Andrea Tagliasacchi , David B. Lindell

While dynamic novel view synthesis from 2D videos has seen progress, achieving efficient reconstruction and rendering of dynamic scenes remains a challenging task. In this paper, we introduce Disentangled 4D Gaussian Splatting…

Graphics · Computer Science 2025-10-31 Hao Feng , Hao Sun , Wei Xie , Zhi Zuo , Zhengzhe Liu

Omnidirectional 3D Gaussian Splatting with panoramas is a key technique for 3D scene representation, and existing methods typically rely on slow SfM to provide camera poses and sparse points priors. In this work, we propose a pose-free…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Chuanqing Zhuang , Xin Lu , Zehui Deng , Zhengda Lu , Yiqun Wang , Junqi Diao , Jun Xiao

Although significant progress has been made in reconstructing sharp 3D scenes from motion-blurred images, a transition to real-world applications remains challenging. The primary obstacle stems from the severe blur which leads to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Jeongtaek Oh , Jaeyoung Chung , Dongwoo Lee , Kyoung Mu Lee

Reconstructing dynamic 3D scenes from 2D images and generating diverse views over time is challenging due to scene complexity and temporal dynamics. Despite advancements in neural implicit models, limitations persist: (i) Inadequate Scene…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Zeyu Yang , Hongye Yang , Zijie Pan , Li Zhang

With the popularity of monocular videos generated by video sharing and live broadcasting applications, reconstructing and editing dynamic scenes in stationary monocular cameras has become a special but anticipated technology. In contrast to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Weixing Xie , Xiao Dong , Yong Yang , Qiqin Lin , Jingze Chen , Junfeng Yao , Xiaohu Guo

Gaussian Splatting (GS) has significantly elevated scene reconstruction efficiency and novel view synthesis (NVS) accuracy compared to Neural Radiance Fields (NeRF), particularly for dynamic scenes. However, current 4D NVS methods, whether…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Fang Li , Hao Zhang , Narendra Ahuja

Egocentric video provides a unique view into human perception and interaction, with growing relevance for augmented reality, robotics, and assistive technologies. However, rapid camera motion and complex scene dynamics pose major challenges…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Jan Warchocki , Xi Wang , Jonas Kulhanek , Jan van Gemert

We propose a method to reconstruct dynamic fire in 3D from a limited set of camera views with a Gaussian-based spatiotemporal representation. Capturing and reconstructing fire and its dynamics is highly challenging due to its volatile…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Jakob Nazarenus , Dominik Michels , Wojtek Palubicki , Simin Kou , Fang-Lue Zhang , Soren Pirk , Reinhard Koch