中文
相关论文

相关论文: Novel View Synthesis for Large-scale Scene using A…

200 篇论文

Scene-level novel view synthesis (NVS) is fundamental to many vision and graphics applications. Recently, pose-conditioned diffusion models have led to significant progress by extracting 3D information from 2D foundation models, but these…

计算机视觉与模式识别 · 计算机科学 2024-08-23 Joseph Tung , Gene Chou , Ruojin Cai , Guandao Yang , Kai Zhang , Gordon Wetzstein , Bharath Hariharan , Noah Snavely

We present a method for generating consistent novel views from a single source image. Our approach focuses on maximizing the reuse of visible pixels from the source image. To achieve this, we use a monocular depth estimator that transfers…

计算机视觉与模式识别 · 计算机科学 2023-10-26 Yash Kant , Aliaksandr Siarohin , Michael Vasilkovsky , Riza Alp Guler , Jian Ren , Sergey Tulyakov , Igor Gilitschenski

The task of synthesizing novel views from a single image is highly ill-posed due to multiple explanations for unobserved areas. Most current methods tend to generate unseen regions from ambiguity priors and interpolation near input views,…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Haowang Cui , Rui Chen , Jiaze Wang , Tao Guo , Zheng Qin

In this paper, we present an efficient and robust deep learning solution for novel view synthesis of complex scenes. In our approach, a 3D scene is represented as a light field, i.e., a set of rays, each of which has a corresponding color…

计算机视觉与模式识别 · 计算机科学 2022-07-08 Zhong Li , Liangchen Song , Celong Liu , Junsong Yuan , Yi Xu

Generating novel views of a natural scene, e.g., every-day scenes both indoors and outdoors, from a single view is an under-explored problem, even though it is an organic extension to the object-centric novel view synthesis. Existing…

计算机视觉与模式识别 · 计算机科学 2025-11-13 Wonbong Jang , Jonathan Tremblay , Lourdes Agapito

With the introduction of consumer light field cameras, light field imaging has recently become widespread. However, there is an inherent trade-off between the angular and spatial resolution, and thus, these cameras often sparsely sample in…

计算机视觉与模式识别 · 计算机科学 2016-09-13 Nima Khademi Kalantari , Ting-Chun Wang , Ravi Ramamoorthi

We introduce a principled approach for synthesizing new views of a scene given a single source image. Previous methods for novel view synthesis can be divided into image-based rendering methods (e.g. flow prediction) or pixel generation…

计算机视觉与模式识别 · 计算机科学 2021-01-06 Yuxin Hou , Arno Solin , Juho Kannala

Novel view synthesis from a single input image is a challenging task, where the goal is to generate a new view of a scene from a desired camera pose that may be separated by a large motion. The highly uncertain nature of this synthesis task…

计算机视觉与模式识别 · 计算机科学 2023-08-23 Jason J. Yu , Fereshteh Forghani , Konstantinos G. Derpanis , Marcus A. Brubaker

Novel view synthesis refers to the problem of synthesizing novel viewpoints of a scene given the images from a few viewpoints. This is a fundamental problem in computer vision and graphics, and enables a vast variety of applications such as…

计算机视觉与模式识别 · 计算机科学 2024-11-25 Nagabhushan Somraj

Dynamic novel view synthesis aims to capture the temporal evolution of visual content within videos. Existing methods struggle to distinguishing between motion and structure, particularly in scenarios where camera poses are either unknown…

计算机视觉与模式识别 · 计算机科学 2024-01-12 Chaoyang Wang , Peiye Zhuang , Aliaksandr Siarohin , Junli Cao , Guocheng Qian , Hsin-Ying Lee , Sergey Tulyakov

Recent approaches in generative adversarial networks (GANs) can automatically synthesize realistic images from descriptive text. Despite the overall fair quality, the generated images often expose visible flaws that lack structural…

计算机视觉与模式识别 · 计算机科学 2017-08-31 Miriam Cha , Youngjune Gwon , H. T. Kung

We present a new approach for synthesizing novel views of people in new poses. Our novel differentiable renderer enables the synthesis of highly realistic images from any viewpoint. Rather than operating over mesh-based structures, our…

计算机视觉与模式识别 · 计算机科学 2022-02-22 Guillaume Rochette , Chris Russell , Richard Bowden

In this paper, we propose the first generalizable view synthesis approach that specifically targets multi-view stereo-camera images. Since recent stereo matching has demonstrated accurate geometry prediction, we introduce stereo matching…

计算机视觉与模式识别 · 计算机科学 2024-04-23 Haechan Lee , Wonjoon Jin , Seung-Hwan Baek , Sunghyun Cho

Novel view synthesis from a single image has been a cornerstone problem for many Virtual Reality applications that provide immersive experiences. However, most existing techniques can only synthesize novel views within a limited range of…

计算机视觉与模式识别 · 计算机科学 2023-03-31 Hung-Yu Tseng , Qinbo Li , Changil Kim , Suhib Alsisan , Jia-Bin Huang , Johannes Kopf

We introduce a 3D-aware diffusion model, ZeroNVS, for single-image novel view synthesis for in-the-wild scenes. While existing methods are designed for single objects with masked backgrounds, we propose new techniques to address challenges…

计算机视觉与模式识别 · 计算机科学 2024-04-25 Kyle Sargent , Zizhang Li , Tanmay Shah , Charles Herrmann , Hong-Xing Yu , Yunzhi Zhang , Eric Ryan Chan , Dmitry Lagun , Li Fei-Fei , Deqing Sun , Jiajun Wu

In this paper, we tackle the problem of generating a novel image from an arbitrary viewpoint given a single frame as input. While existing methods operating in this setup aim at predicting the target view depth map to guide the synthesis,…

计算机视觉与模式识别 · 计算机科学 2023-08-29 Giovanni Minelli , Matteo Poggi , Samuele Salti

Recent neural rendering and reconstruction techniques, such as NeRFs or Gaussian Splatting, have shown remarkable novel view synthesis capabilities but require hundreds of images of the scene from diverse viewpoints to render high-quality…

计算机视觉与模式识别 · 计算机科学 2024-08-29 Felix Tristram , Stefano Gasperini , Nassir Navab , Federico Tombari

We introduce MultiDiff, a novel approach for consistent novel view synthesis of scenes from a single RGB image. The task of synthesizing novel views from a single reference image is highly ill-posed by nature, as there exist multiple,…

计算机视觉与模式识别 · 计算机科学 2024-06-27 Norman Müller , Katja Schwarz , Barbara Roessle , Lorenzo Porzi , Samuel Rota Bulò , Matthias Nießner , Peter Kontschieder

Deep learning is providing a wealth of new approaches to the problem of novel view synthesis, from Neural Radiance Field (NeRF) based approaches to end-to-end style architectures. Each approach offers specific strengths but also comes with…

计算机视觉与模式识别 · 计算机科学 2025-06-06 Bernard Spiegl , Andrea Perin , Stéphane Deny , Alexander Ilin

Despite recent advancements in neural 3D reconstruction, the dependence on dense multi-view captures restricts their broader applicability. In this work, we propose \textbf{ViewCrafter}, a novel method for synthesizing high-fidelity novel…

计算机视觉与模式识别 · 计算机科学 2024-09-04 Wangbo Yu , Jinbo Xing , Li Yuan , Wenbo Hu , Xiaoyu Li , Zhipeng Huang , Xiangjun Gao , Tien-Tsin Wong , Ying Shan , Yonghong Tian