English
Related papers

Related papers: Forge4D: Feed-Forward 4D Human Reconstruction and …

200 papers

We propose UpFusion, a system that can perform novel view synthesis and infer 3D representations for an object given a sparse set of reference images without corresponding pose information. Current sparse-view 3D inference methods typically…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Bharath Raj Nagoor Kani , Hsin-Ying Lee , Sergey Tulyakov , Shubham Tulsiani

Generating dynamic 4D objects from sparse inputs is difficult because it demands joint preservation of appearance and motion coherence across views and time while suppressing artifacts and temporal drift. We hypothesize that the view…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Su Sun , Cheng Zhao , Himangi Mittal , Gaurav Mittal , Rohith Kukkala , Yingjie Victor Chen , Mei Chen

3D Gaussian Splatting (3DGS) has recently enabled real-time rendering of unbounded 3D scenes for novel view synthesis. However, this technique requires dense training views to accurately reconstruct 3D geometry. A limited number of input…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Haolin Xiong , Sairisheek Muttukuru , Rishi Upadhyay , Pradyumna Chari , Achuta Kadambi

Creating a photorealistic scene and human reconstruction from a single monocular in-the-wild video figures prominently in the perception of a human-centric 3D world. Recent neural rendering advances have enabled holistic human-scene…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Zetong Zhang , Manuel Kaufmann , Lixin Xue , Jie Song , Martin R. Oswald

Temporal 3D human pose estimation from monocular videos is a challenging task in human-centered computer vision due to the depth ambiguity of 2D-to-3D lifting. To improve accuracy and address occlusion issues, inertial sensor has been…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Yiming Bao , Xu Zhao , Dahong Qian

Feed-forward 3D reconstruction for autonomous driving has advanced rapidly, yet existing methods struggle with the joint challenges of sparse, non-overlapping camera views and complex scene dynamics. We present UniSplat, a general…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Chen Shi , Shaoshuai Shi , Xiaoyang Lyu , Chunyang Liu , Kehua Sheng , Bo Zhang , Li Jiang

With the success of 2D and 3D visual generative models, there is growing interest in generating 4D content. Existing methods primarily rely on text prompts to produce 4D content, but they often fall short of accurately defining complex or…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Hao Zhang , Di Chang , Fang Li , Mohammad Soleymani , Narendra Ahuja

We present iFusion, a novel 3D object reconstruction framework that requires only two views with unknown camera poses. While single-view reconstruction yields visually appealing results, it can deviate significantly from the actual object,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Chin-Hsuan Wu , Yen-Chun Chen , Bolivar Solarte , Lu Yuan , Min Sun

We present GaussFusion, a novel approach for improving 3D Gaussian splatting (3DGS) reconstructions in the wild through geometry-informed video generation. GaussFusion mitigates common 3DGS artifacts, including floaters, flickering, and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Liyuan Zhu , Manjunath Narayana , Michal Stary , Will Hutchcroft , Gordon Wetzstein , Iro Armeni

We present GP-4DGS, a novel framework that integrates Gaussian Processes (GPs) into 4D Gaussian Splatting (4DGS) for principled probabilistic modeling of dynamic scenes. While existing 4DGS methods focus on deterministic reconstruction,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Mijeong Kim , Jungtaek Kim , Bohyung Han

This paper addresses the long-standing challenge of reconstructing 3D structures from videos with dynamic content. Current approaches to this problem were not designed to operate on casual videos recorded by standard cameras or require a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Yoni Kasten , Wuyue Lu , Haggai Maron

We propose a novel sparse constrained formulation and from it derive a real-time optimization method for 3D human pose and shape estimation. Our optimization method, SCOPE (Sparse Constrained Optimization for 3D human Pose and shapE…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Taosha Fan , Kalyan Vasudev Alwala , Donglai Xiang , Weipeng Xu , Todd Murphey , Mustafa Mukadam

Articulated object reconstruction from sparse-view images is an ill-posed problem that requires simultaneous inference of geometry and underlying articulation structure. Existing methods for articulated object reconstruction based on NeRF…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Inseo Lee , Yoonji Kim , Eugene Sohn , Jiwoong Lee , Jungmin You , Joonseok Lee , Jin-Hwa Kim

Despite advances in physics-based 3D motion synthesis, current methods face key limitations: reliance on pre-reconstructed 3D Gaussian Splatting (3DGS) built from dense multi-view images with time-consuming per-scene optimization; physics…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Chunji Lv , Zequn Chen , Donglin Di , Weinan Zhang , Hao Li , Wei Chen , Yinjie Lei , Changsheng Li

World models have made significant progress in modeling dynamic environments; however, most embodied world models are still restricted to 2D representations, lacking the comprehensive multi-view information essential for embodied spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Peiyan Tu , Hanxin Zhu , Jingwen Sun , Shaojie Ren , Cong Wang , Jiayi Luo , Xiaoqian Cheng , Zhibo Chen

We target the problem of sparse 3D reconstruction of dynamic objects observed by multiple unsynchronized video cameras with unknown temporal overlap. To this end, we develop a framework to recover the unknown structure without sequencing…

Computer Vision and Pattern Recognition · Computer Science 2016-05-24 Enliang Zheng , Dinghuang Ji , Enrique Dunn , Jan-Michael Frahm

Realtime 4D reconstruction for dynamic scenes remains a crucial challenge for autonomous driving perception. Most existing methods rely on depth estimation through self-supervision or multi-modality sensor fusion. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Xin Fei , Wenzhao Zheng , Yueqi Duan , Wei Zhan , Masayoshi Tomizuka , Kurt Keutzer , Jiwen Lu

We present Motion 3-to-4, a feed-forward framework for synthesising high-quality 4D dynamic objects from a single monocular video and an optional 3D reference mesh. While recent advances have significantly improved 2D, video, and 3D content…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Hongyuan Chen , Xingyu Chen , Youjia Zhang , Zexiang Xu , Anpei Chen

Point Cloud Interpolation confronts challenges from point sparsity, complex spatiotemporal dynamics, and the difficulty of deriving complete 3D point clouds from sparse temporal information. This paper presents NeuroGauss4D-PCI, which…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Chaokang Jiang , Dalong Du , Jiuming Liu , Siting Zhu , Zhenqiang Liu , Zhuang Ma , Zhujin Liang , Jie Zhou

Remarkable advances in recent 2D image and 3D shape generation have induced a significant focus on dynamic 4D content generation. However, previous 4D generation methods commonly struggle to maintain spatial-temporal consistency and adapt…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Mengmeng Liu , Jiuming Liu , Yunpeng Zhang , Jiangtao Li , Michael Ying Yang , Francesco Nex , Hao Cheng