English
Related papers

Related papers: Learning-Based View Synthesis for Light Field Came…

200 papers

Light field photography enables to record 4D images, containing angular information alongside spatial information of the scene. One of the important applications of light field imaging is post-capture refocusing. Current methods require for…

Computer Vision and Pattern Recognition · Computer Science 2020-09-08 Shachar Ben Dayan , David Mendlovic , Raja Giryes

In this paper we address the problem of view synthesis from large baseline light fields, by turning a sparse set of input views into a Multi-plane Image (MPI). Because available datasets are scarce, we propose a lightweight network that…

Computer Vision and Pattern Recognition · Computer Science 2020-05-20 Tomás Völker , Guillaume Boisson , Bertrand Chupeau

We explore a new strategy for few-shot novel view synthesis based on a neural light field representation. Given a target camera pose, an implicit neural network maps each ray to its target pixel's color directly. The network is conditioned…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Qian Li , Franck Multon , Adnane Boukhayma

Light field cameras have been proved to be powerful tools for 3D reconstruction and virtual reality applications. However, the limited resolution of light field images brings a lot of difficulties for further information display and…

Image and Video Processing · Electrical Eng. & Systems 2020-08-27 Qingyan Sun , Shuo Zhang , Song Chang , Lixi Zhu , Youfang Lin

A Light Field (LF) camera consists of an additional two-dimensional array of micro-lenses placed between the main lens and sensor, compared to a conventional camera. The sensor pixels under each micro-lens receive light from a sub-aperture…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Suresh Nehra , Aupendu Kar , Jayanta Mukhopadhyay , Prabir Kumar Biswas

This paper proposes Sparse View Synthesis. This is a view synthesis problem where the number of reference views is limited, and the baseline between target and reference view is significant. Under these conditions, current radiance field…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Violeta Menéndez González , Andrew Gilbert , Graeme Phillipson , Stephen Jolly , Simon Hadfield

We explore the use of inexpensive consumer light- field camera technology for the purpose of light-field mi- croscopy. Our experiments are based on the Lytro (first gen- eration) camera. Unfortunately, the optical systems of the Lytro and…

Graphics · Computer Science 2015-12-08 Lois Mignard-Debise , Ivo Ihrke

Inspired by the recent advances in implicitly representing signals with trained neural networks, we aim to learn a continuous representation for narrow-baseline 4D light fields. We propose an implicit representation model for 4D light…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Paramanand Chandramouli , Hendrik Sommerhoff , Andreas Kolb

Novel view synthesis aims to synthesize new images from different viewpoints of given images. Most of previous works focus on generating novel views of certain objects with a fixed background. However, for some applications, such as virtual…

Computer Vision and Pattern Recognition · Computer Science 2018-02-21 Xiaochuan Yin , Henglai Wei , Penghong lin , Xiangwei Wang , Qijun Chen

Light field imaging presents an attractive alternative to RGB imaging because of the recording of the direction of the incoming light. The detection of salient regions in a light field image benefits from the additional modeling of angular…

Computer Vision and Pattern Recognition · Computer Science 2019-10-30 Jun Zhang , Yamei Liu , Shengping Zhang , Ronald Poppe , Meng Wang

Commercially available light field cameras have difficulty in capturing 5D (4D + time) light field videos. They can only capture still light filed images or are excessively expensive for normal users to capture the light field video. To…

Computer Vision and Pattern Recognition · Computer Science 2019-12-24 Kyuho Bae , Andre Ivan , Hajime Nagahara , In Kyu Park

Although neural radiance fields (NeRF) have shown impressive advances for novel view synthesis, most methods typically require multiple input images of the same scene with accurate camera poses. In this work, we seek to substantially reduce…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Kai-En Lin , Lin Yen-Chen , Wei-Sheng Lai , Tsung-Yi Lin , Yi-Chang Shih , Ravi Ramamoorthi

Light fields are a type of image data that capture both spatial and angular scene information by recording light rays emitted by a scene from different orientations. In this context, spatial information is defined as features that remain…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Jinglei Shi , Yihong Xu , Christine Guillemot

This paper explores the problem of reconstructing high-resolution light field (LF) images from hybrid lenses, including a high-resolution camera surrounded by multiple low-resolution cameras. To tackle this challenge, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Jing Jin , Junhui Hou , Jie Chen , Sam Kwong , Jingyi Yu

We introduce a method for novel view synthesis given only a single wide-baseline stereo image pair. In this challenging regime, 3D scene points are regularly observed only once, requiring prior-based reconstruction of scene geometry and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Yilun Du , Cameron Smith , Ayush Tewari , Vincent Sitzmann

Light field (LF) cameras record both intensity and directions of light rays, and capture scenes from a number of viewpoints. Both information within each perspective (i.e., spatial information) and among different perspectives (i.e.,…

Image and Video Processing · Electrical Eng. & Systems 2020-06-05 Yingqian Wang , Longguang Wang , Jungang Yang , Wei An , Jingyi Yu , Yulan Guo

We study the problem of novel view synthesis from sparse source observations of a scene comprised of 3D objects. We propose a simple yet effective approach that is neither continuous nor implicit, challenging recent trends on view…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Pengsheng Guo , Miguel Angel Bautista , Alex Colburn , Liang Yang , Daniel Ulbricht , Joshua M. Susskind , Qi Shan

Through capturing spatial and angular radiance distribution, light field cameras introduce new capabilities that are not possible with conventional cameras. So far in the light field imaging literature, the focus has been on the theory and…

Computer Vision and Pattern Recognition · Computer Science 2016-11-16 M. Umair Mukati , Bahadir K. Gunturk

We present a new method for lightweight novel-view synthesis that generalizes to an arbitrary forward-facing scene. Recent approaches are computationally expensive, require per-scene optimization, or produce a memory-expensive…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Pavel Solovev , Taras Khakhulin , Denis Korzhenkov

Existing methods for relightable view synthesis -- using a set of images of an object under unknown lighting to recover a 3D representation that can be rendered from novel viewpoints under a target illumination -- are based on inverse…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Xiaoming Zhao , Pratul P. Srinivasan , Dor Verbin , Keunhong Park , Ricardo Martin Brualla , Philipp Henzler