English
Related papers

Related papers: Neural Parametric Gaussians for Monocular Non-Rigi…

200 papers

We present a method for learning 3D geometry and physics parameters of a dynamic scene from only a monocular RGB video input. To decouple the learning of underlying scene geometry from dynamic motion, we represent the scene as a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Yi-Ling Qiao , Alexander Gao , Ming C. Lin

Accurate meshing from monocular images remains a key challenge in 3D vision. While state-of-the-art 3D Gaussian Splatting (3DGS) methods excel at synthesizing photorealistic novel views through rasterization-based rendering, their reliance…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Kunyi Li , Michael Niemeyer , Zeyu Chen , Nassir Navab , Federico Tombari

Digitizing 3D static scenes and 4D dynamic events from multi-view images has long been a challenge in computer vision and graphics. Recently, 3D Gaussian Splatting (3DGS) has emerged as a practical and scalable reconstruction method,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Marko Mihajlovic , Sergey Prokudin , Siyu Tang , Robert Maier , Federica Bogo , Tony Tung , Edmond Boyer

Reconstructing dynamic humans together with static scenes from monocular videos remains difficult, especially under fast motion, where RGB frames suffer from motion blur. Event cameras exhibit distinct advantages, e.g., microsecond temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Xiaoting Yin , Hao Shi , Kailun Yang , Jiajun Zhai , Shangwei Guo , Lin Wang , Kaiwei Wang

While neural rendering has demonstrated impressive capabilities in 3D scene reconstruction and novel view synthesis, it heavily relies on high-quality sharp images and accurate camera poses. Numerous approaches have been proposed to train…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Lingzhe Zhao , Peng Wang , Peidong Liu

We present MOSAIC-GS, a novel, fully explicit, and computationally efficient approach for high-fidelity dynamic scene reconstruction from monocular videos using Gaussian Splatting. Monocular reconstruction is inherently ill-posed due to the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Svitlana Morkva , Maximum Wilder-Smith , Michael Oechsle , Alessio Tonioni , Marco Hutter , Vaishakh Patil

Visual reconstruction of fast non-rigid object deformations over time is a challenge for conventional frame-based cameras. In this paper, we propose a novel approach for reconstructing such deformations using measurements from event-based…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Yuxuan Xue , Haolong Li , Stefan Leutenegger , Jörg Stückler

The accurate 3D reconstruction of deformable soft body tissues from endoscopic videos is a pivotal challenge in medical applications such as VR surgery and medical image analysis. Existing methods often struggle with accuracy and the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Yangsen Chen , Hao Wang

We propose HoliGS, a novel deformable Gaussian splatting framework that addresses embodied view synthesis from long monocular RGB videos. Unlike prior 4D Gaussian splatting and dynamic NeRF pipelines, which struggle with training overhead…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Xiaoyuan Wang , Yizhou Zhao , Botao Ye , Xiaojun Shan , Weijie Lyu , Lu Qi , Kelvin C. K. Chan , Yinxiao Li , Ming-Hsuan Yang

We present the first application of 3D Gaussian Splatting in monocular SLAM, the most fundamental but the hardest setup for Visual SLAM. Our method, which runs live at 3fps, utilises Gaussians as the only 3D representation, unifying the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Hidenobu Matsuki , Riku Murai , Paul H. J. Kelly , Andrew J. Davison

We propose 4DGT, a 4D Gaussian-based Transformer model for dynamic scene reconstruction, trained entirely on real-world monocular posed videos. Using 4D Gaussian as an inductive bias, 4DGT unifies static and dynamic components, enabling the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Zhen Xu , Zhengqin Li , Zhao Dong , Xiaowei Zhou , Richard Newcombe , Zhaoyang Lv

Reconstructing dynamic scenes with large-scale and complex motions remains a significant challenge. Recent techniques like Neural Radiance Fields and 3D Gaussian Splatting (3DGS) have shown promise but still struggle with scenes involving…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Qiankun Gao , Yanmin Wu , Chengxiang Wen , Jiarui Meng , Luyang Tang , Jie Chen , Ronggang Wang , Jian Zhang

We present PAD3R, a method for reconstructing deformable 3D objects from casually captured, unposed monocular videos. Unlike existing approaches, PAD3R handles long video sequences featuring substantial object deformation, large-scale…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Ting-Hsuan Liao , Haowen Liu , Yiran Xu , Songwei Ge , Gengshan Yang , Jia-Bin Huang

We present MoBGS, a novel motion deblurring 3D Gaussian Splatting (3DGS) framework capable of reconstructing sharp and high-quality novel spatio-temporal views from blurry monocular videos in an end-to-end manner. Existing dynamic novel…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Minh-Quan Viet Bui , Jongmin Park , Juan Luis Gonzalez Bello , Jaeho Moon , Jihyong Oh , Munchurl Kim

Current non-rigid structure from motion (NRSfM) algorithms are mainly limited with respect to: (i) the number of images, and (ii) the type of shape variability they can handle. This has hampered the practical utility of NRSfM for many…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Chen Kong , Simon Lucey

Fast, reliable shape reconstruction is an essential ingredient in many computer vision applications. Neural Radiance Fields demonstrated that photorealistic novel view synthesis is within reach, but was gated by performance requirements for…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Leonid Keselman , Martial Hebert

Dynamic scene reconstruction is a long-term challenge in the field of 3D vision. Recently, the emergence of 3D Gaussian Splatting has provided new insights into this problem. Although subsequent efforts rapidly extend static 3D Gaussian to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Ruijie Zhu , Yanzhe Liang , Hanzhi Chang , Jiacheng Deng , Jiahao Lu , Wenfei Yang , Tianzhu Zhang , Yongdong Zhang

Dynamic scene reconstruction from monocular video is essential for real-world applications. We introduce DGNS, a hybrid framework integrating \underline{D}eformable \underline{G}aussian Splatting and Dynamic \underline{N}eural…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Xuesong Li , Jinguang Tong , Jie Hong , Vivien Rolland , Lars Petersson

We present GP-4DGS, a novel framework that integrates Gaussian Processes (GPs) into 4D Gaussian Splatting (4DGS) for principled probabilistic modeling of dynamic scenes. While existing 4DGS methods focus on deterministic reconstruction,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Mijeong Kim , Jungtaek Kim , Bohyung Han

The increasing demand for augmented reality and robotics is driving the need for articulated object reconstruction with high scalability. However, existing settings for reconstructing from discrete articulation states or casual monocular…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Hang Dai , Hongwei Fan , Han Zhang , Duojin Wu , Jiyao Zhang , Hao Dong