English
Related papers

Related papers: Depth Assisted Full Resolution Network for Single …

200 papers

We present a method for novel view synthesis from input images that are freely distributed around a scene. Our method does not rely on a regular arrangement of input views, can synthesize images for free camera movement through the scene,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Gernot Riegler , Vladlen Koltun

Novel view synthesis is an important problem in computer vision and graphics. Over the years a large number of solutions have been put forward to solve the problem. However, the large-baseline novel view synthesis problem is far from being…

Computer Vision and Pattern Recognition · Computer Science 2018-05-08 Tewodros Habtegebrial , Kiran Varanasi , Christian Bailer , Didier Stricker

We introduce a principled approach for synthesizing new views of a scene given a single source image. Previous methods for novel view synthesis can be divided into image-based rendering methods (e.g. flow prediction) or pixel generation…

Computer Vision and Pattern Recognition · Computer Science 2021-01-06 Yuxin Hou , Arno Solin , Juho Kannala

Novel-view synthesis through diffusion models has demonstrated remarkable potential for generating diverse and high-quality images. Yet, the independent process of image generation in these prevailing methods leads to challenges in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Xianghui Yang , Yan Zuo , Sameera Ramasinghe , Loris Bazzani , Gil Avraham , Anton van den Hengel

View synthesis is a process for generating novel views from a scene which has been recorded with a 3-D camera setup. It has important applications in 3-D post-production and 2-D to 3-D conversion. However, a central problem in the…

Computer Vision and Pattern Recognition · Computer Science 2014-06-25 Julian Habigt , Klaus Diepold

Rendering photo-realistic novel-view images of complex scenes has been a long-standing challenge in computer graphics. In recent years, great research progress has been made on enhancing rendering quality and accelerating rendering speed in…

Graphics · Computer Science 2024-02-21 Tiansong Zhou , Yebin Liu , Xuangeng Chu , Chengkun Cao , Changyin Zhou , Fei Yu , Yu Li

In this paper, we firstly consider view-dependent effects into single image-based novel view synthesis (NVS) problems. For this, we propose to exploit the camera motion priors in NVS to model view-dependent appearance or effects (VDE) as…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Juan Luis Gonzalez Bello , Munchurl Kim

We tackle a new problem of semantic view synthesis -- generating free-viewpoint rendering of a synthesized scene using a semantic label map as input. We build upon recent advances in semantic image synthesis and view synthesis for handling…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Hsin-Ping Huang , Hung-Yu Tseng , Hsin-Ying Lee , Jia-Bin Huang

Novel view synthesis from a single image requires inferring occluded regions of objects and scenes whilst simultaneously maintaining semantic and physical consistency with the input. Existing approaches condition neural radiance fields…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Jiatao Gu , Alex Trevithick , Kai-En Lin , Josh Susskind , Christian Theobalt , Lingjie Liu , Ravi Ramamoorthi

Depth-image-based rendering (DIBR) oriented view synthesis has been widely employed in the current depth-based 3D video systems by synthesizing a virtual view from an arbitrary viewpoint. However, holes may appear in the synthesized view…

Computer Vision and Pattern Recognition · Computer Science 2018-02-12 Shuai Li , Ce Zhu , Ming-Ting Sun

Single-image novel view synthesis is a challenging and ongoing problem that aims to generate an infinite number of consistent views from a single input image. Although significant efforts have been made to advance the quality of generated…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Guo Pu , Peng-Shuai Wang , Zhouhui Lian

This paper targets on learning-based novel view synthesis from a single or limited 2D images without the pose supervision. In the viewer-centered coordinates, we construct an end-to-end trainable conditional variational framework to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Xiaofeng Liu , Tong Che , Yiqun Lu , Chao Yang , Site Li , Jane You

Deep generative models have shown success in automatically synthesizing missing image regions using surrounding context. However, users cannot directly decide what content to synthesize with such approaches. We propose an end-to-end network…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Yinan Zhao , Brian Price , Scott Cohen , Danna Gurari

In this paper, we present an efficient and robust deep learning solution for novel view synthesis of complex scenes. In our approach, a 3D scene is represented as a light field, i.e., a set of rays, each of which has a corresponding color…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 Zhong Li , Liangchen Song , Celong Liu , Junsong Yuan , Yi Xu

We propose a method for converting a single RGB-D input image into a 3D photo - a multi-layer representation for novel view synthesis that contains hallucinated color and depth structures in regions occluded in the original view. We use a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Meng-Li Shih , Shih-Yang Su , Johannes Kopf , Jia-Bin Huang

We introduce a novel geometry-guided online video view synthesis method with enhanced view and temporal consistency. Traditional approaches achieve high-quality synthesis from dense multi-view camera setups but require significant…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Hyunho Ha , Lei Xiao , Christian Richardt , Thu Nguyen-Phuoc , Changil Kim , Min H. Kim , Douglas Lanman , Numair Khan

We present a novel neural algorithm for performing high-quality, high-resolution, real-time novel view synthesis. From a sparse set of input RGB images or videos streams, our network both reconstructs the 3D scene and renders novel views at…

Recent advancements in differentiable rendering and 3D reasoning have driven exciting results in novel view synthesis from a single image. Despite realistic results, methods are limited to relatively small view change. In order to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Chris Rockwell , David F. Fouhey , Justin Johnson

Multiview depth imagery will play a critical role in free-viewpoint television. This technology requires high quality virtual view synthesis to enable viewers to move freely in a dynamic real world scene. Depth imagery at different…

Computer Vision and Pattern Recognition · Computer Science 2023-01-30 Pravin Kumar Rana , Markus Flierl

We study the problem of synthesizing immersive 3D indoor scenes from one or more images. Our aim is to generate high-resolution images and videos from novel viewpoints, including viewpoints that extrapolate far beyond the input images while…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Jing Yu Koh , Harsh Agrawal , Dhruv Batra , Richard Tucker , Austin Waters , Honglak Lee , Yinfei Yang , Jason Baldridge , Peter Anderson