English
Related papers

Related papers: Learning Light Field Reconstruction from a Single …

200 papers

Light fields are 4D scene representation typically structured as arrays of views, or several directional samples per pixel in a single view. This highly correlated structure is not very efficient to transmit and manipulate (especially for…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Menghan Xia , Jose Echevarria , Minshan Xie , Tien-Tsin Wong

Restoring a sharp light field image from its blurry input has become essential due to the increasing popularity of parallax-based image processing. State-of-the-art blind light field deblurring methods suffer from several issues such as…

Computer Vision and Pattern Recognition · Computer Science 2019-12-06 Jonathan Samuel Lumentut , Tae Hyun Kim , Ravi Ramamoorthi , In Kyu Park

This paper presents a Progressively-connected Light Field network (ProLiF), for the novel view synthesis of complex forward-facing scenes. ProLiF encodes a 4D light field, which allows rendering a large batch of rays in one training step…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Peng Wang , Yuan Liu , Guying Lin , Jiatao Gu , Lingjie Liu , Taku Komura , Wenping Wang

Existing methods for relightable view synthesis -- using a set of images of an object under unknown lighting to recover a 3D representation that can be rendered from novel viewpoints under a target illumination -- are based on inverse…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Xiaoming Zhao , Pratul P. Srinivasan , Dor Verbin , Keunhong Park , Ricardo Martin Brualla , Philipp Henzler

This study proposes a neural disparity field (NDF) that establishes an implicit, continuous representation of scene disparity based on a neural field and an iterative approach to address the inverse problem of NDF reconstruction from…

Image and Video Processing · Electrical Eng. & Systems 2025-07-01 Ligen Shi , Chang Liu , Xing Zhao , Jun Qiu

Inferring representations of 3D scenes from 2D observations is a fundamental problem of computer graphics, computer vision, and artificial intelligence. Emerging 3D-structured neural scene representations are a promising approach to 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Vincent Sitzmann , Semon Rezchikov , William T. Freeman , Joshua B. Tenenbaum , Fredo Durand

In this paper, we address the "dual problem" of multi-view scene reconstruction in which we utilize single-view images captured under different point lights to learn a neural scene representation. Different from existing single-view methods…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Wenqi Yang , Guanying Chen , Chaofeng Chen , Zhenfang Chen , Kwan-Yee K. Wong

Light field (LF) imaging has gained significant attention due to its recent success in 3-dimensional (3D) displaying and rendering as well as augmented and virtual reality usage. Nonetheless, because of the two extra dimensions, LFs are…

Image and Video Processing · Electrical Eng. & Systems 2022-04-20 Eisa Hedayati , Timothy C. Havens , Jeremy P. Bos

The hardware challenges associated with light-field(LF) imaging has made it difficult for consumers to access its benefits like applications in post-capture focus and aperture control. Learning-based techniques which solve the ill-posed…

Image and Video Processing · Electrical Eng. & Systems 2022-07-22 Shrisudhan Govindarajan , Prasan Shedligeri , Sarah , Kaushik Mitra

A concept of light-fields computed from multiple view images on regular grids has proven its benefit for scene representations, and supported realistic renderings of novel views and photographic effects such as refocusing and shallow depth…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Hyunjun Jung , Hae-Gon Jeon

The abundant spatial and angular information from light fields has allowed the development of multiple disparity estimation approaches. However, the acquisition of light fields requires high storage and processing cost, limiting the use of…

Computer Vision and Pattern Recognition · Computer Science 2022-09-26 Emmanuel Martinez , Edwin Vargas , Henry Arguello

Mask-based lensless cameras offer a novel design for imaging systems by replacing the lens in a conventional camera with a layer of coded mask. Each pixel of the lensless camera encodes the information of the entire 3D scene. Existing…

Image and Video Processing · Electrical Eng. & Systems 2022-12-23 Yucheng Zheng , M. Salman Asif

We present a method to estimate lighting from a single image of an indoor scene. Previous work has used an environment map representation that does not account for the localized nature of indoor lighting. Instead, we represent lighting as a…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Marc-André Gardner , Yannick Hold-Geoffroy , Kalyan Sunkavalli , Christian Gagné , Jean-François Lalonde

Light field imaging, which captures spatio-angular information of incident light on image sensor, enables many interesting applications like image refocusing and augmented reality. However, due to the limited sensor resolution, a trade-off…

Image and Video Processing · Electrical Eng. & Systems 2020-07-15 Chang-Le Liu , Kuang-Tsu Shih , Jiun-Woei Huang , Homer H. Chen

Light detection and ranging (Lidar) data can be used to capture the depth and intensity profile of a 3D scene. This modality relies on constructing, for each pixel, a histogram of time delays between emitted light pulses and detected photon…

Image and Video Processing · Electrical Eng. & Systems 2019-09-13 Julián Tachella , Yoann Altmann , Ximing Ren , Aongus McCarthy , Gerald S. Buller , Jean-Yves Tourneret , Steve McLaughlin

Hand-held light field (LF) cameras have unique advantages in computer vision such as 3D scene reconstruction and depth estimation. However, the related applications are limited by the ultra-small baseline, e.g., leading to the extremely low…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Xiao Huo , Dongyang Jin , Saiping Zhang , Fuzheng Yang

We introduce a novel learning-based method to reconstruct the high-quality geometry and complex, spatially-varying BRDF of an arbitrary object from a sparse set of only six images captured by wide-baseline cameras under collocated point…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Sai Bi , Zexiang Xu , Kalyan Sunkavalli , David Kriegman , Ravi Ramamoorthi

3D reconstruction from single view images is an ill-posed problem. Inferring the hidden regions from self-occluded images is both challenging and ambiguous. We propose a two-pronged approach to address these issues. To better incorporate…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Priyanka Mandikal , K L Navaneet , Mayank Agarwal , R. Venkatesh Babu

Defocus deblurring is a challenging task due to the spatially varying nature of defocus blur. While deep learning approach shows great promise in solving image restoration problems, defocus deblurring demands accurate training data that…

Image and Video Processing · Electrical Eng. & Systems 2022-04-04 Lingyan Ruan , Bin Chen , Jizhou Li , Miuling Lam

Conventional stereoscopic displays suffer from vergence-accommodation conflict and cause visual fatigue. Integral-imaging-based displays resolve the problem by directly projecting the sub-aperture views of a light field into the eyes using…

Image and Video Processing · Electrical Eng. & Systems 2022-08-24 Chun-Hao Chao , Chang-Le Liu , Homer Chen