English
Related papers

Related papers: Unsupervised Novel View Synthesis from a Single Im…

200 papers

Novel view synthesis aims to synthesize new images from different viewpoints of given images. Most of previous works focus on generating novel views of certain objects with a fixed background. However, for some applications, such as virtual…

Computer Vision and Pattern Recognition · Computer Science 2018-02-21 Xiaochuan Yin , Henglai Wei , Penghong lin , Xiangwei Wang , Qijun Chen

Novel view synthesis from a single image has been a cornerstone problem for many Virtual Reality applications that provide immersive experiences. However, most existing techniques can only synthesize novel views within a limited range of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Hung-Yu Tseng , Qinbo Li , Changil Kim , Suhib Alsisan , Jia-Bin Huang , Johannes Kopf

We present a method for learning to generate unbounded flythrough videos of natural scenes starting from a single view, where this capability is learned from a collection of single photographs, without requiring camera poses or even…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Zhengqi Li , Qianqian Wang , Noah Snavely , Angjoo Kanazawa

A fundamental bottleneck in Novel View Synthesis (NVS) for autonomous driving is the inherent supervision gap on novel trajectories: models are tasked with synthesizing unseen views during inference, yet lack ground truth images for these…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Hongbo Lu , Liang Yao , Chenghao He , Fan Liu , Wenlong Liao , Tao He , Pai Peng

Pose guided synthesis aims to generate a new image in an arbitrary target pose while preserving the appearance details from the source image. Existing approaches rely on either hard-coded spatial transformations or 3D body modeling. They…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Haitian Zheng , Lele Chen , Chenliang Xu , Jiebo Luo

We present a diffusion-based model for 3D-aware generative novel view synthesis from as few as a single input image. Our model samples from the distribution of possible renderings consistent with the input and, even in the presence of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Eric R. Chan , Koki Nagano , Matthew A. Chan , Alexander W. Bergman , Jeong Joon Park , Axel Levy , Miika Aittala , Shalini De Mello , Tero Karras , Gordon Wetzstein

We present a unified framework tackling two problems: class-specific 3D reconstruction from a single image, and generation of new 3D shape samples. These tasks have received considerable attention recently; however, existing approaches rely…

Computer Vision and Pattern Recognition · Computer Science 2018-11-16 Paul Henderson , Vittorio Ferrari

In this paper, we propose an approach for synthesizing novel view images from a single RGBD (Red Green Blue-Depth) input. Novel view synthesis (NVS) is an interesting computer vision task with extensive applications. Methods using multiple…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Congrui Hetang , Yuping Wang

In this paper the argument is made that for true novel view synthesis of objects, where the object can be synthesized from any viewpoint, an explicit 3D shape representation isdesired. Our method estimates point clouds to capture the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-21 Hoang-An Le , Thomas Mensink , Partha Das , Theo Gevers

Generating high-quality novel views of a scene from a single image requires maintaining structural coherence across different views, referred to as view consistency. While diffusion models have driven advancements in novel view synthesis,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Jiwoo Park , Tae Eun Choi , Youngjun Jun , Seong Jae Hwang

A recent strand of work in view synthesis uses deep learning to generate multiplane images (a camera-centric, layered 3D representation) given two or more input images at known viewpoints. We apply this representation to single-view view…

Computer Vision and Pattern Recognition · Computer Science 2020-04-24 Richard Tucker , Noah Snavely

Novel View Synthesis (NVS) is concerned with synthesizing views under camera viewpoint transformations from one or multiple input images. NVS requires explicit reasoning about 3D object structure and unseen parts of the scene to synthesize…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Nicolai Häni , Selim Engin , Jun-Jee Chao , Volkan Isler

Conditional image synthesis from layout has recently attracted much interest. Previous approaches condition the generator on object locations as well as class labels but lack fine-grained control over the diverse appearance aspects of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Stanislav Frolov , Avneesh Sharma , Jörn Hees , Tushar Karayil , Federico Raue , Andreas Dengel

In this work we introduce a new self-supervised, semi-parametric approach for synthesizing novel views of a vehicle starting from a single monocular image. Differently from parametric (i.e. entirely learning-based) methods, we show how…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Andrea Palazzi , Luca Bergamini , Simone Calderara , Rita Cucchiara

Intrinsic image decomposition, which is an essential task in computer vision, aims to infer the reflectance and shading of the scene. It is challenging since it needs to separate one image into two components. To tackle this, conventional…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Yunfei Liu , Yu Li , Shaodi You , Feng Lu

Novel view synthesis is a long-standing problem. In this work, we consider a variant of the problem where we are given only a few context views sparsely covering a scene or an object. The goal is to predict novel viewpoints in the scene,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Jonáš Kulhánek , Erik Derner , Torsten Sattler , Robert Babuška

We introduce EscherNet, a multi-view conditioned diffusion model for view synthesis. EscherNet learns implicit and generative 3D representations coupled with a specialised camera positional encoding, allowing precise and continuous relative…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Xin Kong , Shikun Liu , Xiaoyang Lyu , Marwan Taher , Xiaojuan Qi , Andrew J. Davison

Novel-view synthesis (NVS) can be tackled through different approaches, depending on the general setting: a single source image to a short video sequence, exact or noisy camera pose information, 3D-based information such as point clouds…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Gaétan Landreau , Mohamed Tamaazousti

We introduce GarmentCrafter, a new approach that enables non-professional users to create and modify 3D garments from a single-view image. While recent advances in image generation have facilitated 2D garment design, creating and editing 3D…

Generative models have emerged as an essential building block for many image synthesis and editing tasks. Recent advances in this field have also enabled high-quality 3D or video content to be generated that exhibits either multi-view or…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Sherwin Bahmani , Jeong Joon Park , Despoina Paschalidou , Hao Tang , Gordon Wetzstein , Leonidas Guibas , Luc Van Gool , Radu Timofte