English
Related papers

Related papers: SinMPI: Novel View Synthesis from a Single Image w…

200 papers

Reconstructing 3D objects from extremely sparse views is a long-standing and challenging problem. While recent techniques employ image diffusion models for generating plausible images at novel viewpoints or for distilling pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Zi-Xin Zou , Weihao Cheng , Yan-Pei Cao , Shi-Sheng Huang , Ying Shan , Song-Hai Zhang

High Dynamic Range Novel View Synthesis (HDR-NVS) aims to establish a 3D scene HDR model from Low Dynamic Range (LDR) imagery. Typically, multiple-exposure LDR images are employed to capture a wider range of brightness levels in a scene, as…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Kaixuan Zhang , Hu Wang , Minxian Li , Mingwu Ren , Mao Ye , Xiatian Zhu

Volumetric scene reconstruction from a single image is crucial for a broad range of applications like autonomous driving and robotics. Recent volumetric reconstruction methods achieve impressive results, but generally require expensive 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Philipp Wulff , Felix Wimbauer , Dominik Muhle , Daniel Cremers

Synthesizing novel views from monocular videos of dynamic scenes remains a challenging problem. Scene-specific methods that optimize 4D representations with explicit motion priors often break down in highly dynamic regions where multi-view…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Thomas Tanay , Mohammed Brahimi , Michal Nazarczuk , Qingwen Zhang , Sibi Catley-Chandar , Arthur Moreau , Zhensong Zhang , Eduardo Pérez-Pellitero

Novel view synthesis (NVS) has shown significant promise for applications in cinematographic production, particularly through the exploitation of Neural Radiance Fields (NeRF) and Gaussian Splatting (GS). These methods model real 3D scenes,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Adrian Azzarelli , Nantheera Anantrasirichai , David R Bull

In this paper, we present an efficient and robust deep learning solution for novel view synthesis of complex scenes. In our approach, a 3D scene is represented as a light field, i.e., a set of rays, each of which has a corresponding color…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 Zhong Li , Liangchen Song , Celong Liu , Junsong Yuan , Yi Xu

Multi-view diffusion models have shown promise in 3D novel view synthesis, but most existing methods adopt a non-autoregressive formulation. This limits their applicability in world modeling, as they only support a fixed number of views and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Xin Kong , Daniel Watson , Yannick Strümpler , Michael Niemeyer , Federico Tombari

3D Gaussian Splatting has recently emerged as a powerful tool for fast and accurate novel-view synthesis from a set of posed input images. However, like most novel-view synthesis approaches, it relies on accurate camera pose information,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Christian Schmidt , Jens Piekenbrinck , Bastian Leibe

2D-to-3D reconstruction is an ill-posed problem, yet humans are good at solving this problem due to their prior knowledge of the 3D world developed over years. Driven by this observation, we propose NeRDi, a single-view NeRF synthesis…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Congyue Deng , Chiyu "Max'' Jiang , Charles R. Qi , Xinchen Yan , Yin Zhou , Leonidas Guibas , Dragomir Anguelov

In dynamic Neural Radiance Fields (NeRF) systems, state-of-the-art novel view synthesis methods often fail under significant viewpoint deviations, producing unstable and unrealistic renderings. To address this, we introduce Expanded Dynamic…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Le Jiang , Shaotong Zhu , Yedi Luo , Shayda Moezzi , Sarah Ostadabbas

This paper considers the problem of generative novel view synthesis (GNVS), generating novel, plausible views of a scene given a limited number of known views. Here, we propose a set-based generative model that can simultaneously generate…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Jason J. Yu , Tristan Aumentado-Armstrong , Fereshteh Forghani , Konstantinos G. Derpanis , Marcus A. Brubaker

We introduce a novel geometry-guided online video view synthesis method with enhanced view and temporal consistency. Traditional approaches achieve high-quality synthesis from dense multi-view camera setups but require significant…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Hyunho Ha , Lei Xiao , Christian Richardt , Thu Nguyen-Phuoc , Changil Kim , Min H. Kim , Douglas Lanman , Numair Khan

Reconstructing 3D scenes from a single image is a fundamentally ill-posed task due to the severely under-constrained nature of the problem. Consequently, when the scene is rendered from novel camera views, existing single image to 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Sarosij Bose , Arindam Dutta , Sayak Nag , Junge Zhang , Jiachen Li , Konstantinos Karydis , Amit K. Roy Chowdhury

Neural Radiance Fields and 3D Gaussian Splatting have revolutionized 3D reconstruction and novel-view synthesis task. However, achieving photorealistic rendering from extreme novel viewpoints remains challenging, as artifacts persist across…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Jay Zhangjie Wu , Yuxuan Zhang , Haithem Turki , Xuanchi Ren , Jun Gao , Mike Zheng Shou , Sanja Fidler , Zan Gojcic , Huan Ling

Deep convolutional neural network (DCNN) has been successfully applied to depth map super-resolution and outperforms existing methods by a wide margin. However, there still exist two major issues with these DCNN based depth map…

Computer Vision and Pattern Recognition · Computer Science 2018-08-28 Xibin Song , Yuchao Dai , Xueying Qin

A fundamental bottleneck in Novel View Synthesis (NVS) for autonomous driving is the inherent supervision gap on novel trajectories: models are tasked with synthesizing unseen views during inference, yet lack ground truth images for these…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Hongbo Lu , Liang Yao , Chenghao He , Fan Liu , Wenlong Liao , Tao He , Pai Peng

Zero-shot novel view synthesis (NVS) from a single image is an essential problem in 3D object understanding. While recent approaches that leverage pre-trained generative models can synthesize high-quality novel views from in-the-wild…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Jianglong Ye , Peng Wang , Kejie Li , Yichun Shi , Heng Wang

Novel view synthesis (NVS) is a challenging task requiring systems to generate photorealistic images of scenes from new viewpoints, where both quality and speed are important for applications. Previous image-based rendering (IBR) methods…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Ang Cao , Chris Rockwell , Justin Johnson

In this paper the argument is made that for true novel view synthesis of objects, where the object can be synthesized from any viewpoint, an explicit 3D shape representation isdesired. Our method estimates point clouds to capture the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-21 Hoang-An Le , Thomas Mensink , Partha Das , Theo Gevers

View synthesis aims to produce unseen views from a set of views captured by two or more cameras at different positions. This task is non-trivial since it is hard to conduct pixel-level matching among different views. To address this issue,…

Computer Vision and Pattern Recognition · Computer Science 2021-01-27 Zhuoman Liu , Wei Jia , Ming Yang , Peiyao Luo , Yong Guo , Mingkui Tan