English
Related papers

Related papers: ArtiFixer: Enhancing and Extending 3D Reconstructi…

200 papers

Generating high-quality 3D content requires models capable of learning robust distributions of complex scenes and the real-world objects within them. Recent Gaussian-based 3D reconstruction techniques have achieved impressive results in…

Image and Video Processing · Electrical Eng. & Systems 2024-12-16 Kevin Miao , Harsh Agrawal , Qihang Zhang , Federico Semeraro , Marco Cavallo , Jiatao Gu , Alexander Toshev

Neural reconstruction approaches are rapidly emerging as the preferred representation for 3D scenes, but their limited editability is still posing a challenge. In this work, we propose an approach for 3D scene inpainting -- the task of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Ashkan Mirzaei , Riccardo De Lutio , Seung Wook Kim , David Acuna , Jonathan Kelly , Sanja Fidler , Igor Gilitschenski , Zan Gojcic

Recently, Gaussian Splatting, a method that represents a 3D scene as a collection of Gaussian distributions, has gained significant attention in addressing the task of novel view synthesis. In this paper, we highlight a fundamental…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Haoxuan Qu , Zhuoling Li , Hossein Rahmani , Yujun Cai , Jun Liu

3D Gaussian splatting has achieved very impressive performance in real-time novel view synthesis. However, it often suffers from over-reconstruction during Gaussian densification where high-variance image regions are covered by a few large…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Jiahui Zhang , Fangneng Zhan , Muyu Xu , Shijian Lu , Eric Xing

We present a simple, modular, and generic method that upsamples coarse 3D models by adding geometric and appearance details. While generative 3D models now exist, they do not yet match the quality of their counterparts in image and video…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Yuan Shen , Duygu Ceylan , Paul Guerrero , Zexiang Xu , Niloy J. Mitra , Shenlong Wang , Anna Frühstück

We propose a novel 3D deepfake generation framework based on 3D Gaussian Splatting that enables realistic, identity-preserving face swapping and reenactment in a fully controllable 3D space. Compared to conventional 2D deepfake approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Wending Liu , Siyun Liang , Huy H. Nguyen , Isao Echizen

Mirror-containing environments pose unique challenges for 3D reconstruction and novel view synthesis (NVS), as reflective surfaces introduce view-dependent distortions and inconsistencies. While cutting-edge methods such as Neural Radiance…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Zijing Guo , Yunyang Zhao , Lin Wang

Neural rendering methods have significantly advanced photo-realistic 3D scene rendering in various academic and industrial applications. The recent 3D Gaussian Splatting method has achieved the state-of-the-art rendering quality and speed…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Tao Lu , Mulin Yu , Linning Xu , Yuanbo Xiangli , Limin Wang , Dahua Lin , Bo Dai

Generalizable 3D Gaussian Splatting has recently emerged as an efficient approach for novel-view synthesis, enabling feed-forward synthesis from only a few input views. However, existing pixel-wise feed-forward methods suffer from…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Hoang Chuong Nguyen , Renjie Wu , Jose M. Alvarez , Miaomiao Liu

3D Gaussian Splatting (GS) enables highly photorealistic scene reconstruction from posed image sequences but struggles with viewpoint extrapolation due to its anisotropic nature, leading to overfitting and poor generalization, particularly…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Shuohan Tao , Boyao Zhou , Hanzhang Tu , Yuwang Wang , Yebin Liu

The accurate reconstruction of dynamic street scenes is critical for applications in autonomous driving, augmented reality, and virtual reality. Traditional methods relying on dense point clouds and triangular meshes struggle with moving…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Peizhen Zheng , Dongjing Jiang , Qingchong Jiao , Redouane EL Bouchtaoui , Flynnwell Jianfei Zhang

We present a novel framework for training 3D image-conditioned diffusion models using only 2D supervision. Recovering 3D structure from 2D images is inherently ill-posed due to the ambiguity of possible reconstructions, making generative…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Chensheng Peng , Ido Sobol , Masayoshi Tomizuka , Kurt Keutzer , Chenfeng Xu , Or Litany

The remarkable achievements of both generative models of 2D images and neural field representations for 3D scenes present a compelling opportunity to integrate the strengths of both approaches. In this work, we propose a methodology that…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Azmi Haider , Dan Rosenbaum

We propose 3D Super Resolution (3DSR), a novel 3D Gaussian-splatting-based super-resolution framework that leverages off-the-shelf diffusion-based 2D super-resolution models. 3DSR encourages 3D consistency across views via the use of an…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Yi-Ting Chen , Ting-Hsuan Liao , Pengsheng Guo , Alexander Schwing , Jia-Bin Huang

3D Gaussian Splatting (3DGS) has become a state-of-the-art framework for real-time, high-fidelity novel view synthesis. However, its substantial storage requirements and inherently unstructured representation pose challenges for deployment…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Yuqin Lu , Yang Zhou , Yihua Dai , Guiqing Li , Shengfeng He

Recent developments in 3D Gaussian Splatting have made significant advances in surface reconstruction. However, scaling these methods to large-scale scenes remains challenging due to high computational demands and the complex dynamic…

Graphics · Computer Science 2025-06-24 Shihan Chen , Zhaojin Li , Zeyu Chen , Qingsong Yan , Gaoyang Shen , Ran Duan

Sparse-view 3D reconstruction is a major challenge in computer vision, aiming to create complete three-dimensional models from limited viewing angles. Key obstacles include: 1) a small number of input images with inconsistent information;…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Bi'an Du , Lingbei Meng , Wei Hu

We propose VideoRFSplat, a direct text-to-3D model leveraging a video generation model to generate realistic 3D Gaussian Splatting (3DGS) for unbounded real-world scenes. To generate diverse camera poses and unbounded spatial extent of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Hyojun Go , Byeongjun Park , Hyelin Nam , Byung-Hoon Kim , Hyungjin Chung , Changick Kim

Novel view synthesis under sparse views has been a long-term important challenge in 3D reconstruction. Existing works mainly rely on introducing external semantic or depth priors to supervise the optimization of 3D representations. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Qisen Wang , Yifan Zhao , Jiawei Ma , Jia Li

In this work, we introduce a generative approach for pose-free (without camera parameters) reconstruction of 360 scenes from a sparse set of 2D images. Pose-free scene reconstruction from incomplete, pose-free observations is usually…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Soumava Paul , Prakhar Kaushik , Alan Yuille