English
Related papers

Related papers: GeoRect4D: Geometry-Compatible Generative Rectific…

200 papers

Reconstructing dynamic 4D scenes from monocular videos is a fundamental yet challenging task. While recent 3D foundation models provide strong geometric priors, their performance significantly degrades in dynamic environments. This…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Ying Zang , Xuanyi Liu , Yidong Han , Deyi Ji , Chaotao Ding , Yuanqi Hu , Qi Zhu , Xuanfu Li , Jin Ma , Lingyun Sun , Tianrun Chen , Lanyun Zhu

Recent progress in pre-trained diffusion models and 3D generation have spurred interest in 4D content creation. However, achieving high-fidelity 4D generation with spatial-temporal consistency remains a challenge. In this work, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Yifei Zeng , Yanqin Jiang , Siyu Zhu , Yuanxun Lu , Youtian Lin , Hao Zhu , Weiming Hu , Xun Cao , Yao Yao

4D content generation has achieved remarkable progress recently. However, existing methods suffer from long optimization times, a lack of motion controllability, and a low quality of details. In this paper, we introduce DreamGaussian4D…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Jiawei Ren , Liang Pan , Jiaxiang Tang , Chi Zhang , Ang Cao , Gang Zeng , Ziwei Liu

Sparse-view novel view synthesis is fundamentally ill-posed due to severe geometric ambiguity. Current methods are caught in a trade-off: regressive models are geometrically faithful but incomplete, whereas generative models can complete…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Atakan Topaloglu , Kunyi Li , Michael Niemeyer , Nassir Navab , A. Murat Tekalp , Federico Tombari

Reconstructing dynamic 4D scenes is an important yet challenging task. While 3D foundation models like VGGT excel in static settings, they often struggle with dynamic sequences where motion causes significant geometric ambiguity. To address…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Ying Zang , Yidong Han , Chaotao Ding , Yuanqi Hu , Deyi Ji , Qi Zhu , Xuanfu Li , Jin Ma , Lingyun Sun , Tianrun Chen , Lanyun Zhu

3D Gaussian Splatting (3DGS) has emerged as a prominent paradigm for 3D reconstruction and novel view synthesis. However, it remains vulnerable to severe artifacts when trained under sparse-view constraints. While recent methods attempt to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Xiao Cao , Yuze Li , Youmin Zhang , Jiayu Song , Cheng Yan , Wen Li , Lixin Duan

3D reconstruction and novel view synthesis are critical for validating autonomous driving systems and training advanced perception models. Recent self-supervised methods have gained significant attention due to their cost-effectiveness and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Xiao Tang , Guirong Zhuo , Cong Wang , Boyuan Zheng , Minqing Huang , Lianqing Zheng , Long Chen , Shouyi Lu

The reconstruction of dynamic 3D scenes using 3D Gaussian Splatting has shown significant promise. A key challenge, however, remains in modeling realistic motion, as most methods fail to align the motion of Gaussians with real-world…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Junoh Lee , Junmyeong Lee , Yeon-Ji Song , Inhwan Bae , Jisu Shin , Hae-Gon Jeon , Jin-Hwa Kim

Despite recent advances in leveraging generative prior from pre-trained diffusion models for 3D scene reconstruction, existing methods still face two critical limitations. First, due to the lack of reliable geometric supervision, they…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Junfeng Ni , Yixin Chen , Zhifei Yang , Yu Liu , Ruijie Lu , Song-Chun Zhu , Siyuan Huang

3D scene reconstruction is fundamental for spatial intelligence applications such as AR, robotics, and digital twins. Traditional multi-view stereo struggles with sparse viewpoints or low-texture regions, while neural rendering approaches,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Jiaqi Yao , Zhongmiao Yan , Jingyi Xu , Songpengcheng Xia , Yan Xiang , Ling Pei

Recent advancements in dynamic 3D scene reconstruction have shown promising results, enabling high-fidelity 3D novel view synthesis with improved temporal consistency. Among these, 4D Gaussian Splatting (4DGS) has emerged as an appealing…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Seungjun Oh , Younggeun Lee , Hyejin Jeon , Eunbyung Park

In recent years, the increasing demand for dynamic 3D assets in design and gaming applications has given rise to powerful generative pipelines capable of synthesizing high-quality 4D objects. Previous methods generally rely on score…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Qi Sun , Zhiyang Guo , Ziyu Wan , Jing Nathan Yan , Shengming Yin , Wengang Zhou , Jing Liao , Houqiang Li

Creating deformable 3D content has gained increasing attention with the rise of text-to-image and image-to-video generative models. While these models provide rich semantic priors for appearance, they struggle to capture the physical…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Jixuan He , Chieh Hubert Lin , Lu Qi , Ming-Hsuan Yang

Feedforward Gaussian Splatting has recently emerged as an efficient paradigm for 4D reconstruction in autonomous driving. However, in unstructured off-road scenes, its performance degrades due to high-frequency geometry, ego-motion jitter,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Shuo Wang , Jilin Mei , Fuyang Liu , Wenfei Guan , Fanjie Kong , Zhihua Zhao , Shuai Wang , Chen Min , Yu Hu

Recent advances in video generation have enabled the synthesis of high-quality and visually realistic clips using diffusion transformer models. However, most existing approaches operate purely in the 2D pixel space and lack explicit…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Yunpeng Bai , Shaoheng Fang , Chaohui Yu , Fan Wang , Qixing Huang

The field of 3D reconstruction from images has rapidly evolved in the past few years, first with the introduction of Neural Radiance Field (NeRF) and more recently with 3D Gaussian Splatting (3DGS). The latter provides a significant edge…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Avinash Paliwal , Wei Ye , Jinhui Xiong , Dmytro Kotovenko , Rakesh Ranjan , Vikas Chandra , Nima Khademi Kalantari

Modeling dynamic 3D scenes is challenging due to their high-dimensional nature, which requires aggregating information from multiple views to reconstruct time-evolving 3D geometry and motion. We present a novel multi-video 4D Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Yonghan Lee , Tsung-Wei Huang , Shiv Gehlot , Jaehoon Choi , Guan-Ming Su , Dinesh Manocha

Synthesizing photo-realistic visual observations from an ego vehicle's driving trajectory is a critical step towards scalable training of self-driving models. Reconstruction-based methods create 3D scenes from driving logs and synthesize…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Jiageng Mao , Boyi Li , Boris Ivanovic , Yuxiao Chen , Yan Wang , Yurong You , Chaowei Xiao , Danfei Xu , Marco Pavone , Yue Wang

Inferring the 3D structure underlying a set of multi-view images typically requires solving two co-dependent tasks -- accurate 3D reconstruction requires precise camera poses, and predicting camera poses relies on (implicitly or explicitly)…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Qitao Zhao , Shubham Tulsiani

Gaussian Splatting (GS) has gained attention as a fast and effective method for novel view synthesis. It has also been applied to 3D reconstruction using multi-view images and can achieve fast and accurate 3D reconstruction. However, GS…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Natsuki Takama , Shintaro Ito , Koichi Ito , Hwann-Tzong Chen , Takafumi Aoki