English
Related papers

Related papers: Splatent: Splatting Diffusion Latents for Novel Vi…

200 papers

Novel View Synthesis (NVS) for street scenes play a critical role in the autonomous driving simulation. The current mainstream technique to achieve it is neural rendering, such as Neural Radiance Fields (NeRF) and 3D Gaussian Splatting…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Zhongrui Yu , Haoran Wang , Jinze Yang , Hanzhang Wang , Zeke Xie , Yunfeng Cai , Jiale Cao , Zhong Ji , Mingming Sun

Empowering 3D Gaussian Splatting with generalization ability is appealing. However, existing generalizable 3D Gaussian Splatting methods are largely confined to narrow-range interpolation between stereo images due to their heavy backbones,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Yunsong Wang , Tianxin Huang , Hanlin Chen , Gim Hee Lee

We present ViewSplat, a view-adaptive 3D Gaussian splatting network for novel view synthesis from unposed images. While recent feed-forward 3D Gaussian splatting has significantly accelerated 3D scene reconstruction by bypassing per-scene…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Moonyeon Jeong , Seunggi Min , Suhyeon Lee , Hongje Seong

Recent studies in Radiance Fields have paved the robust way for novel view synthesis with their photorealistic rendering quality. Nevertheless, they usually employ neural networks and volumetric rendering, which are costly to train and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Byeonghyeon Lee , Howoong Lee , Xiangyu Sun , Usman Ali , Eunbyung Park

3D Gaussian Splatting (3DGS) has recently enabled real-time rendering of unbounded 3D scenes for novel view synthesis. However, this technique requires dense training views to accurately reconstruct 3D geometry. A limited number of input…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Haolin Xiong , Sairisheek Muttukuru , Rishi Upadhyay , Pradyumna Chari , Achuta Kadambi

Latent diffusion models for image generation have crossed a quality threshold which enabled them to achieve mass adoption. Recently, a series of works have made advancements towards replicating this success in the 3D domain, introducing…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Anchit Gupta , Wenhan Xiong , Yixin Nie , Ian Jones , Barlas Oğuz

Radiance fields have emerged as a predominant representation for modeling 3D scene appearance. Neural formulations such as Neural Radiance Fields provide high expressivity but require costly ray marching for rendering, whereas…

Novel view synthesis via Neural Radiance Fields (NeRFs) or 3D Gaussian Splatting (3DGS) typically necessitates dense observations with hundreds of input images to circumvent artifacts. We introduce Deceptive-NeRF/3DGS to enhance sparse-view…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Xinhang Liu , Jiaben Chen , Shiu-hong Kao , Yu-Wing Tai , Chi-Keung Tang

We propose 3D Super Resolution (3DSR), a novel 3D Gaussian-splatting-based super-resolution framework that leverages off-the-shelf diffusion-based 2D super-resolution models. 3DSR encourages 3D consistency across views via the use of an…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Yi-Ting Chen , Ting-Hsuan Liao , Pengsheng Guo , Alexander Schwing , Jia-Bin Huang

Recently, the 3D Gaussian Splatting (3D-GS) method has achieved great success in novel view synthesis, providing real-time rendering while ensuring high-quality rendering results. However, this method faces challenges in modeling specular…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Zhiru Wang , Shiyun Xie , Chengwei Pan , Guoping Wang

Recent advancements in 3D reconstruction from single images have been driven by the evolution of generative models. Prominent among these are methods based on Score Distillation Sampling (SDS) and the adaptation of diffusion models in the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Zi-Xin Zou , Zhipeng Yu , Yuan-Chen Guo , Yangguang Li , Ding Liang , Yan-Pei Cao , Song-Hai Zhang

We propose Camera Splatting, a novel view optimization framework for novel view synthesis. Each camera is modeled as a 3D Gaussian, referred to as a camera splat, and virtual cameras, termed point cameras, are placed at 3D points sampled…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Gahye Lee , Hyomin Kim , Gwangjin Ju , Jooeun Son , Hyejeong Yoon , Seungyong Lee

We aim to address sparse-view reconstruction of a 3D scene by leveraging priors from large-scale vision models. While recent advancements such as 3D Gaussian Splatting (3DGS) have demonstrated remarkable successes in 3D reconstruction,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Hanyang Yu , Xiaoxiao Long , Ping Tan

Generating ground-level views and coherent 3D site models from aerial-only imagery is challenging due to extreme viewpoint changes, missing intermediate observations, and large scale variations. Existing methods either refine renderings…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Sirshapan Mitra , Yogesh S. Rawat

3D Gaussian Splatting (3DGS) has recently transformed photorealistic reconstruction, achieving high visual fidelity and real-time performance. However, rendering quality significantly deteriorates when test views deviate from the camera…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Yutong Chen , Marko Mihajlovic , Xiyi Chen , Yiming Wang , Sergey Prokudin , Siyu Tang

Feed-forward 3D Gaussian Splatting (3DGS) has shown great promise for real-time novel view synthesis, but its application to panoramic imagery remains challenging. Existing methods often rely on multi-view cost volumes for geometric…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Qiwei Wang , Xianghui Ze , Jingyi Yu , Yujiao Shi

3D Gaussian Splatting is emerging as a state-of-the-art technique in novel view synthesis, recognized for its impressive balance between visual quality, speed, and rendering efficiency. However, reliance on third-degree spherical harmonics…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Yiwen Wang , Siyuan Chen , Ran Yi

Recently, 3D Gaussian Splatting has emerged as a promising approach for modeling 3D scenes using mixtures of Gaussians. The predominant optimization method for these models relies on backpropagating gradients through a differentiable…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Toon Van de Maele , Ozan Catal , Alexander Tschantz , Christopher L. Buckley , Tim Verbelen

Feed-forward 3D Gaussian Splatting (3DGS) has recently demonstrated promising results for novel view synthesis (NVS) from sparse input views, particularly under narrow-baseline conditions. However, its performance significantly degrades in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Xiaohan Lu , Jiaye Fu , Jiaqi Zhang , Zetian Song , Chuanmin Jia , Siwei Ma

Recent progress in diffusion-based visual generation has largely relied on latent diffusion models with variational autoencoders (VAEs). While effective for high-fidelity synthesis, this VAE+diffusion paradigm suffers from limited training…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Minglei Shi , Haolin Wang , Wenzhao Zheng , Ziyang Yuan , Xiaoshi Wu , Xintao Wang , Pengfei Wan , Jie Zhou , Jiwen Lu