English
Related papers

Related papers: Learning Light Field Reconstruction from a Single …

200 papers

Learning to reconstruct 3D shapes using 2D images is an active research topic, with benefits of not requiring expensive 3D data. However, most work in this direction requires multi-view images for each object instance as training…

Computer Vision and Pattern Recognition · Computer Science 2021-07-14 Bo Peng , Wei Wang , Jing Dong , Tieniu Tan

We present a learning-based method for estimating 4D reflectance field of a person given video footage illuminated under a flat-lit environment of the same subject. For training data, we use one light at a time to illuminate the subject and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Loc Huynh , Bipin Kishore , Paul Debevec

Reconstructing outdoor 3D scenes from temporal observations is a challenge that recent work on neural fields has offered a new avenue for. However, existing methods that recover scene properties, such as geometry, appearance, or radiance,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Andrea Ramazzina , Stefanie Walz , Pragyan Dahal , Mario Bijelic , Felix Heide

Light field cameras enable new capabilities, such as post-capture refocusing and aperture control, through capturing directional and spatial distribution of light rays in space. Micro-lens array based light field camera design is often…

Computer Vision and Pattern Recognition · Computer Science 2018-06-12 M. Umair Mukati , Bahadir K. Gunturk

Light field photography enables to record 4D images, containing angular information alongside spatial information of the scene. One of the important applications of light field imaging is post-capture refocusing. Current methods require for…

Computer Vision and Pattern Recognition · Computer Science 2020-09-08 Shachar Ben Dayan , David Mendlovic , Raja Giryes

3D reconstruction is a useful tool for surgical planning and guidance. However, the lack of available medical data stunts research and development in this field, as supervised deep learning methods for accurate disparity estimation rely…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Alistair Weld , Joao Cartucho , Chi Xu , Joseph Davids , Stamatia Giannarou

Coded aperture is a promising approach for capturing the 4-D light field (LF), in which the 4-D data are compressively modulated into 2-D coded measurements that are further decoded by reconstruction algorithms. The bottleneck lies in the…

Image and Video Processing · Electrical Eng. & Systems 2020-07-24 Mantang Guo , Junhui Hou , Jing Jin , Jie Chen , Lap-Pui Chau

Classical light field rendering for novel view synthesis can accurately reproduce view-dependent effects such as reflection, refraction, and translucency, but requires a dense view sampling of the scene. Methods based on geometric…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Mohammed Suhail , Carlos Esteves , Leonid Sigal , Ameesh Makadia

Light-field cameras allow the acquisition of both the spatial and angular components of the light. This has a wide range of applications from image refocusing to 3D reconstruction of a scene. The conventional way to perform such…

Light-field microscopy represents a promising solution for microscopic volumetric imaging, thanks to its capability to encode information on multiple planes in a single acquisition. This is achieved through its peculiar simultaneous capture…

Light field (LF) cameras can record scenes from multiple perspectives, and thus introduce beneficial angular information for image super-resolution (SR). However, it is challenging to incorporate angular information due to disparities among…

Image and Video Processing · Electrical Eng. & Systems 2020-12-30 Yingqian Wang , Jungang Yang , Longguang Wang , Xinyi Ying , Tianhao Wu , Wei An , Yulan Guo

We present a method to automatically decompose a light field into its intrinsic shading and albedo components. Contrary to previous work targeted to 2D single images and videos, a light field is a 4D structure that captures non-integrated…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 Elena Garces , Jose I. Echevarria , Wen Zhang , Hongzhi Wu , Kun Zhou , Diego Gutierrez

Inferring a meaningful geometric scene representation from a single image is a fundamental problem in computer vision. Approaches based on traditional depth map prediction can only reason about areas that are visible in the image.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Felix Wimbauer , Nan Yang , Christian Rupprecht , Daniel Cremers

Recovering the 3D shape of transparent objects using a small number of unconstrained natural images is an ill-posed problem. Complex light paths induced by refraction and reflection have prevented both traditional and deep multiview stereo…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Zhengqin Li , Yu-Ying Yeh , Manmohan Chandraker

We propose a new technique for estimating spatially varying parametric materials from a single image of an object with unknown shape in unknown illumination. Our method uses a low-order parametric reflectance model, and incorporates strong…

Graphics · Computer Science 2019-12-30 Kevin Karsch , David Forsyth

All existing image enhancement methods, such as HDR tone mapping, cannot recover A/D quantization losses due to insufficient or excessive lighting, (underflow and overflow problems). The loss of image details due to A/D quantization is…

Computer Vision and Pattern Recognition · Computer Science 2018-03-22 Chang Liu , Xiaolin Wu , Xiao Shu

As vision based perception methods are usually built on the normal light assumption, there will be a serious safety issue when deploying them into low light environments. Recently, deep learning based methods have been proposed to enhance…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Junjie Hu , Xiyue Guo , Junfeng Chen , Guanqi Liang , Fuqin Deng , Tin lun Lam

We consider the challenging problem of outdoor lighting estimation for the goal of photorealistic virtual object insertion into photographs. Existing works on outdoor lighting estimation typically simplify the scene lighting into an…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Zian Wang , Wenzheng Chen , David Acuna , Jan Kautz , Sanja Fidler

Despite significant progress in monocular depth estimation in the wild, recent state-of-the-art methods cannot be used to recover accurate 3D scene shape due to an unknown depth shift induced by shift-invariant reconstruction losses used in…

Computer Vision and Pattern Recognition · Computer Science 2020-12-18 Wei Yin , Jianming Zhang , Oliver Wang , Simon Niklaus , Long Mai , Simon Chen , Chunhua Shen

A densely-sampled light field (LF) is highly desirable in various applications, such as 3-D reconstruction, post-capture refocusing and virtual reality. However, it is costly to acquire such data. Although many computational methods have…

Image and Video Processing · Electrical Eng. & Systems 2020-09-29 Jing Jin , Junhui Hou , Jie Chen , Huanqiang Zeng , Sam Kwong , Jingyi Yu