English
Related papers

Related papers: Learning light field synthesis with Multi-Plane Im…

200 papers

We present a practical and robust deep learning solution for capturing and rendering novel views of complex real world scenes for virtual exploration. Previous approaches either require intractably dense view sampling or provide little to…

Computer Vision and Pattern Recognition · Computer Science 2019-05-03 Ben Mildenhall , Pratul P. Srinivasan , Rodrigo Ortiz-Cayon , Nima Khademi Kalantari , Ravi Ramamoorthi , Ren Ng , Abhishek Kar

We present a new method for lightweight novel-view synthesis that generalizes to an arbitrary forward-facing scene. Recent approaches are computationally expensive, require per-scene optimization, or produce a memory-expensive…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Pavel Solovev , Taras Khakhulin , Denis Korzhenkov

A concept of light-fields computed from multiple view images on regular grids has proven its benefit for scene representations, and supported realistic renderings of novel views and photographic effects such as refocusing and shallow depth…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Hyunjun Jung , Hae-Gon Jeon

This paper presents a learning-based approach to synthesize the view from an arbitrary camera position given a sparse set of images. A key challenge for this novel view synthesis arises from the reconstruction process, when the views from…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Nan Meng , Kai Li , Jianzhuang Liu , Edmund Y. Lam

The task of synthesizing novel views from a single image has useful applications in virtual reality and mobile computing, and a number of approaches to the problem have been proposed in recent years. A Multiplane Image (MPI) estimates the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Numair Khan , Douglas Lanman , Lei Xiao

With the rise of Extended Reality (XR) technology, there is a growing need for real-time light field reconstruction from sparse view inputs. Existing methods can be classified into offline techniques, which can generate high-quality novel…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Yijie Deng , Lei Han , Tianpeng Lin , Lin Li , Jinzhi Zhang , Lu Fang

Light field imaging is limited in its computational processing demands of high sampling for both spatial and angular dimensions. Single-shot light field cameras sacrifice spatial resolution to sample angular viewpoints, typically by…

Computer Vision and Pattern Recognition · Computer Science 2018-02-07 Mayank Gupta , Arjun Jauhari , Kuldeep Kulkarni , Suren Jayasuriya , Alyosha Molnar , Pavan Turaga

Inspired by the recent advances in implicitly representing signals with trained neural networks, we aim to learn a continuous representation for narrow-baseline 4D light fields. We propose an implicit representation model for 4D light…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Paramanand Chandramouli , Hendrik Sommerhoff , Andreas Kolb

Recent novel view synthesis methods obtain promising results for relatively small scenes, e.g., indoor environments and scenes with a few objects, but tend to fail for unbounded outdoor scenes with a single image as input. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Xiaoyu Zhou , Zhiwei Lin , Xiaojun Shan , Yongtao Wang , Deqing Sun , Ming-Hsuan Yang

A light field records numerous light rays from a real-world scene. However, capturing a dense light field by existing devices is a time-consuming process. Besides, reconstructing a large amount of light rays equivalent to multiple light…

Computer Vision and Pattern Recognition · Computer Science 2018-08-14 Mantang Guo , Hao Zhu , Guoqing Zhou , Qing Wang

We present a method that tackles the challenge of predicting color and depth behind the visible content of an image. Our approach aims at building up a Layered Depth Image (LDI) from a single RGB input, which is an efficient representation…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Helisa Dhamo , Nassir Navab , Federico Tombari

Existing deraining methods focus mainly on a single input image. However, with just a single input image, it is extremely difficult to accurately detect and remove rain streaks, in order to restore a rain-free image. In contrast, a light…

Computer Vision and Pattern Recognition · Computer Science 2023-02-01 Tao Yan , Mingyue Li , Bin Li , Yang Yang , Rynson W. H. Lau

Commercially available light field cameras have difficulty in capturing 5D (4D + time) light field videos. They can only capture still light filed images or are excessively expensive for normal users to capture the light field video. To…

Computer Vision and Pattern Recognition · Computer Science 2019-12-24 Kyuho Bae , Andre Ivan , Hajime Nagahara , In Kyu Park

Novel view synthesis of static scenes has achieved remarkable advancements in producing photo-realistic results. However, key challenges remain for immersive rendering of dynamic scenes. One of the seminal image-based rendering method, the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Wenpeng Xing , Jie Chen

Novel view synthesis of remote sensing scenes is of great significance for scene visualization, human-computer interaction, and various downstream applications. Despite the recent advances in computer graphics and photogrammetry technology,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Yongchang Wu , Zhengxia Zou , Zhenwei Shi

We explore a new strategy for few-shot novel view synthesis based on a neural light field representation. Given a target camera pose, an implicit neural network maps each ray to its target pixel's color directly. The network is conditioned…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Qian Li , Franck Multon , Adnane Boukhayma

Recently, several approaches have emerged for generating neural representations with multiple levels of detail (LODs). LODs can improve the rendering by using lower resolutions and smaller model sizes when appropriate. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 David Li , Brandon Y. Feng , Amitabh Varshney

We introduce a method for novel view synthesis given only a single wide-baseline stereo image pair. In this challenging regime, 3D scene points are regularly observed only once, requiring prior-based reconstruction of scene geometry and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Yilun Du , Cameron Smith , Ayush Tewari , Vincent Sitzmann

Light field photography has been studied thoroughly in recent years. One of its drawbacks is the need for multi-lens in the imaging. To compensate that, compressed light field photography has been proposed to tackle the trade-offs between…

Computer Vision and Pattern Recognition · Computer Science 2019-02-22 Ofir Nabati , David Mendlovic , Raja Giryes

The light field faithfully records the spatial and angular configurations of the scene, which facilitates a wide range of imaging possibilities. In this work, we propose an LF synthesis algorithm which renders high quality novel LF views…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Jie Chen , Lap-Pui Chau , Junhui Hou