English
Related papers

Related papers: Splatent: Splatting Diffusion Latents for Novel Vi…

200 papers

3D Gaussian Splatting (3DGS) has recently revolutionized radiance field reconstruction, achieving high quality novel view synthesis and fast rendering speed without baking. However, 3DGS fails to accurately represent surfaces due to the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Binbin Huang , Zehao Yu , Anpei Chen , Andreas Geiger , Shenghua Gao

Recovering 3D information from scenes via multi-view stereo reconstruction (MVS) and novel view synthesis (NVS) is inherently challenging, particularly in scenarios involving sparse-view setups. The advent of 3D Gaussian Splatting (3DGS)…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Shubhendu Jena , Shishir Reddy Vutukur , Adnane Boukhayma

Gaussian splatting typically requires dense observations of the scene and can fail to reconstruct occluded and unobserved areas. We propose a latent diffusion model to reconstruct a complete 3D scene with Gaussian splats, including the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Ziwei Liao , Mohamed Sayed , Steven L. Waslander , Sara Vicente , Daniyar Turmukhambetov , Michael Firman

Novel view synthesis has been greatly enhanced by the development of radiance field methods. The introduction of 3D Gaussian Splatting (3DGS) has effectively addressed key challenges, such as long training times and slow rendering speeds,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Gopi Raju Matta , Reddypalli Trisha , Kaushik Mitra

3D Gaussian Splatting has emerged as a very promising scene representation, achieving state-of-the-art quality in novel view synthesis significantly faster than competing alternatives. However, its use of spherical harmonics to represent…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 T. Berriel Martins , Javier Civera

We propose a novel cross-spectral rendering framework based on 3D Gaussian Splatting (3DGS) that generates realistic and semantically meaningful splats from registered multi-view spectrum and segmentation maps. This extension enhances the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Saptarshi Neil Sinha , Holger Graf , Michael Weinmann

Existing feedforward image-to-3D methods mainly rely on 2D multi-view diffusion models that cannot guarantee 3D consistency. These methods easily collapse when changing the prompt view direction and mainly handle object-centric cases. In…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Yuanhao Cai , He Zhang , Kai Zhang , Yixun Liang , Mengwei Ren , Fujun Luan , Qing Liu , Soo Ye Kim , Jianming Zhang , Zhifei Zhang , Yuqian Zhou , Yulun Zhang , Xiaokang Yang , Zhe Lin , Alan Yuille

Recent advances in novel view synthesis have demonstrated impressive results in fast photorealistic scene rendering through differentiable point rendering, either via Gaussian Splatting (3DGS) [Kerbl and Kopanas et al. 2023] or neural point…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Linus Franke , Laura Fink , Marc Stamminger

The recent success of 3D Gaussian Splatting (3DGS) has reshaped novel view synthesis by enabling fast optimization and real-time rendering of high-quality radiance fields. However, it relies on simplified, order-dependent alpha blending and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Jan U. Müller , Robin Tim Landsgesell , Leif Van Holland , Patrick Stotko , Reinhard Klein

Primitive-based splatting methods like 3D Gaussian Splatting have revolutionized novel view synthesis with real-time rendering. However, their point-based representations remain incompatible with mesh-based pipelines that power AR/VR and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Jan Held , Sanghyun Son , Renaud Vandeghen , Daniel Rebain , Matheus Gadelha , Yi Zhou , Anthony Cioppa , Ming C. Lin , Marc Van Droogenbroeck , Andrea Tagliasacchi

Latent diffusion models for medical image super-resolution universally inherit variational autoencoders designed for natural photographs. We show that this default choice, not the diffusion architecture, is the dominant constraint on…

Text-based generation and editing of 3D scenes hold significant potential for streamlining content creation through intuitive user interactions. While recent advances leverage 3D Gaussian Splatting (3DGS) for high-fidelity and real-time…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Hyojun Go , Byeongjun Park , Jiho Jang , Jin-Young Kim , Soonwoo Kwon , Changick Kim

3D Gaussian Splatting has shown impressive novel view synthesis results; nonetheless, it is vulnerable to dynamic objects polluting the input data of an otherwise static scene, so called distractors. Distractors have severe impact on the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Paul Ungermann , Armin Ettenhofer , Matthias Nießner , Barbara Roessle

This paper proposes a novel framework for large-scale scene reconstruction based on 3D Gaussian splatting (3DGS) and aims to address the scalability and accuracy challenges faced by existing methods. For tackling the scalability issue, we…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Hanyue Zhang , Zhiliu Yang , Xinhe Zuo , Yuxin Tong , Ying Long , Chen Liu

3D Gaussian Splatting (3DGS) has revolutionized 3D scene reconstruction, which effectively balances rendering quality, efficiency, and speed. However, existing 3DGS approaches usually generate plausible outputs and face significant…

Graphics · Computer Science 2025-07-22 Beizhen Zhao , Yifan Zhou , Sicheng Yu , Zijian Wang , Hao Wang

Medical image segmentation is crucial for clinical diagnosis and treatment planning. Traditional methods typically produce a single segmentation mask, failing to capture inherent uncertainty. Recent generative models enable the creation of…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Huynh Trinh Ngoc , Toan Nguyen Hai , Ba Luong Son , Long Tran Quoc

We propose SparseFusion, a sparse view 3D reconstruction approach that unifies recent advances in neural rendering and probabilistic image generation. Existing approaches typically build on neural rendering with re-projected features but…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Zhizhuo Zhou , Shubham Tulsiani

Recent breakthroughs in radiance fields have significantly advanced 3D scene reconstruction and novel view synthesis (NVS) in autonomous driving. Nevertheless, critical limitations persist: reconstruction-based methods exhibit substantial…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Yingshuang Zou , Yikang Ding , Chuanrui Zhang , Jiazhe Guo , Bohan Li , Xiaoyang Lyu , Feiyang Tan , Xiaojuan Qi , Haoqian Wang

Gaussian Splatting (GS) has proven to be highly effective in novel view synthesis, achieving high-quality and real-time rendering. However, its potential for reconstructing detailed 3D shapes has not been fully explored. Existing methods…

Graphics · Computer Science 2024-06-25 Baowen Zhang , Chuan Fang , Rakesh Shrestha , Yixun Liang , Xiaoxiao Long , Ping Tan

3D scene reconstruction is essential for applications in virtual reality, robotics, and autonomous driving, enabling machines to understand and interact with complex environments. Traditional 3D Gaussian Splatting techniques rely on images…

Graphics · Computer Science 2025-03-04 Changlin Song , Jiaqi Wang , Liyun Zhu , He Weng