English
Related papers

Related papers: Look Gauss, No Pose: Novel View Synthesis using Ga…

200 papers

Novel View Synthesis (NVS) from unconstrained photo collections is challenging in computer graphics. Recently, 3D Gaussian Splatting (3DGS) has shown promise for photorealistic and real-time NVS of static scenes. Building on 3DGS, we…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Yuze Wang , Junyi Wang , Yue Qi

Novel view synthesis in 360$^\circ$ scenes from extremely sparse input views is essential for applications like virtual reality and augmented reality. This paper presents a novel framework for novel view synthesis in extremely sparse-view…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Guangan Chen , Anh Minh Truong , Hanhe Lin , Michiel Vlaminck , Wilfried Philips , Hiep Luong

Novel view synthesis (NVS) in low-light scenes remains a significant challenge due to degraded inputs characterized by severe noise, low dynamic range (LDR) and unreliable initialization. While recent NeRF-based approaches have shown…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Hao Sun , Fenggen Yu , Huiyao Xu , Tao Zhang , Changqing Zou

Novel view synthesis from sparse inputs is a vital yet challenging task in 3D computer vision. Previous methods explore 3D Gaussian Splatting with neural priors (e.g. depth priors) as an additional supervision, demonstrating promising…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Liang Han , Junsheng Zhou , Yu-Shen Liu , Zhizhong Han

Feed-forward based 3D Gaussian Splatting methods have demonstrated exceptional capability in real-time novel view synthesis for human models. However, current approaches are confined to either dense viewpoint configurations or restricted…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Yingdong Hu , Zhening Liu , Jiawei Shao , Zehong Lin , Jun Zhang

We introduce SPFSplat, an efficient framework for 3D Gaussian splatting from sparse multi-view images, requiring no ground-truth poses during training or inference. It employs a shared feature extraction backbone, enabling simultaneous…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Ranran Huang , Krystian Mikolajczyk

The semantic synthesis of unseen scenes from multiple viewpoints is crucial for research in 3D scene understanding. Current methods are capable of rendering novel-view images and semantic maps by reconstructing generalizable Neural Radiance…

Graphics · Computer Science 2025-05-09 Feng Xiao , Hongbin Xu , Wanlin Liang , Wenxiong Kang

Despite the substantial progress of novel view synthesis, existing methods, either based on the Neural Radiance Fields (NeRF) or more recently 3D Gaussian Splatting (3DGS), suffer significant degradation when the input becomes sparse.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Rui Peng , Wangze Xu , Luyang Tang , Liwei Liao , Jianbo Jiao , Ronggang Wang

We propose PoseGaussian, a pose-guided Gaussian Splatting framework for high-fidelity human novel view synthesis. Human body pose serves a dual purpose in our design: as a structural prior, it is fused with a color encoder to refine depth…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Ju Shen , Chen Chen , Tam V. Nguyen , Vijayan K. Asari

Empowering 3D Gaussian Splatting with generalization ability is appealing. However, existing generalizable 3D Gaussian Splatting methods are largely confined to narrow-range interpolation between stereo images due to their heavy backbones,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Yunsong Wang , Tianxin Huang , Hanlin Chen , Gim Hee Lee

Novel View Synthesis (NVS) without Structure-from-Motion (SfM) pre-processed camera poses--referred to as SfM-free methods--is crucial for promoting rapid response capabilities and enhancing robustness against variable operating conditions.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Wei Sun , Xiaosong Zhang , Fang Wan , Yanzhao Zhou , Yuan Li , Qixiang Ye , Jianbin Jiao

We introduce a novel method for dynamic free-view synthesis of an ambient scenes from a monocular capture bringing a immersive quality to the viewing experience. Our method builds upon the recent advancements in 3D Gaussian Splatting (3DGS)…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Meng-Li Shih , Jia-Bin Huang , Changil Kim , Rajvi Shah , Johannes Kopf , Chen Gao

LongSplat addresses critical challenges in novel view synthesis (NVS) from casually captured long videos characterized by irregular camera motion, unknown camera poses, and expansive scenes. Current methods often suffer from pose drift,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Chin-Yang Lin , Cheng Sun , Fu-En Yang , Min-Hung Chen , Yen-Yu Lin , Yu-Lun Liu

3D Gaussian Splatting (3DGS) has revolutionized neural rendering with its efficiency and quality, but like many novel view synthesis methods, it heavily depends on accurate camera poses from Structure-from-Motion (SfM) systems. Although…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Zhisheng Huang , Peng Wang , Jingdong Zhang , Yuan Liu , Xin Li , Wenping Wang

Image-based 3D reconstruction is a challenging task that involves inferring the 3D shape of an object or scene from a set of input images. Learning-based methods have gained attention for their ability to directly estimate 3D shapes. This…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Anurag Dalal , Daniel Hagen , Kjell G. Robbersmyr , Kristian Muri Knausgård

Sparse-view reconstruction models typically require precise camera poses, yet obtaining these parameters from sparse-view images remains challenging. We introduce FreeSplatter, a scalable feed-forward framework that generates high-quality…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Jiale Xu , Shenghua Gao , Ying Shan

In this paper, we introduce Splatt3R, a pose-free, feed-forward method for in-the-wild 3D reconstruction and novel view synthesis from stereo pairs. Given uncalibrated natural images, Splatt3R can predict 3D Gaussian Splats without…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Brandon Smart , Chuanxia Zheng , Iro Laina , Victor Adrian Prisacariu

Generating synthetic images is a useful method for cheaply obtaining labeled data for training computer vision models. However, obtaining accurate 3D models of relevant objects is necessary, and the resulting images often have a gap in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Bram Vanherle , Brent Zoomers , Jeroen Put , Frank Van Reeth , Nick Michiels

Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) have advanced 3D reconstruction and novel view synthesis, but remain heavily dependent on accurate camera poses and dense viewpoint coverage. These requirements limit their…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Jiahui Lu , Haihong Xiao , Xueyan Zhao , Wenxiong Kang

Novel-view synthesis aims to generate novel views of a scene from multiple input images or videos, and recent advancements like 3D Gaussian splatting (3DGS) have achieved notable success in producing photorealistic renderings with efficient…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Xi Liu , Chaoyi Zhou , Siyu Huang