English
Related papers

Related papers: Light Field Video Capture Using a Learning-Based H…

200 papers

The convergence of recent advances in optical fabrication and digital processing yields a new generation of imaging technology: light-field cameras, which bridge the realms of applied mathematics, optics, and high-performance computing.…

Image and Video Processing · Electrical Eng. & Systems 2018-01-25 Shuaishuai Zhu , Peng Jin , Rongguang Liang , Liang Gao

Light field, as a new data representation format in multimedia, has the ability to capture both intensity and direction of light rays. However, the additional angular information also brings a large volume of data. Classical coding methods…

Image and Video Processing · Electrical Eng. & Systems 2024-07-16 Henan Wang , Hanxin Zhu , Zhibo Chen

The acquisition of light field images with high angular resolution is costly. Although many methods have been proposed to improve the angular resolution of a sparsely-sampled light field, they always focus on the light field with a small…

Computer Vision and Pattern Recognition · Computer Science 2020-02-27 Jing Jin , Junhui Hou , Hui Yuan , Sam Kwong

Video frame interpolation, which aims to synthesize non-exist intermediate frames in a video sequence, is an important research topic in computer vision. Existing video frame interpolation methods have achieved remarkable results under…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Youjian Zhang , Chaoyue Wang , Dacheng Tao

Cameras capable of capturing videos at a trillion frames per second allow to freeze light in motion, a very counterintuitive capability when related to our everyday experience in which light appears to travel instantaneously. By combining…

Optics · Physics 2018-08-29 Daniele Faccio , Andreas Velten

Video frame interpolation, the synthesis of novel views in time, is an increasingly popular research direction with many new papers further advancing the state of the art. But as each new method comes with a host of variables that affect…

Computer Vision and Pattern Recognition · Computer Science 2020-11-04 Simon Niklaus , Long Mai , Oliver Wang

Light Field (LF) offers unique advantages such as post-capture refocusing and depth estimation, but low-light conditions limit these capabilities. To restore low-light LFs we should harness the geometric cues present in different LF views,…

Image and Video Processing · Electrical Eng. & Systems 2020-12-29 Mohit Lamba , Kranthi Kumar , Kaushik Mitra

Accurately capturing dynamic scenes with wide-ranging motion and light intensity is crucial for many vision applications. However, acquiring high-speed high dynamic range (HDR) video is challenging because the camera's frame rate restricts…

Image and Video Processing · Electrical Eng. & Systems 2024-04-26 Caixin Wang , Jie Zhang , Matthew A. Wilson , Ralph Etienne-Cummings

Light field imaging is a rich way of representing the 3D world around us. However, due to limited sensor resolution capturing light field data inherently poses spatio-angular resolution trade-off. In this paper, we propose a deep learning…

Computer Vision and Pattern Recognition · Computer Science 2018-04-30 Anil Kumar Vadathya , Saikiran Cholleti , Gautham Ramajayam , Vijayalakshmi Kanchana , Kaushik Mitra

The light field camera is useful for computer graphics and vision applications. Calibration is an essential step for these applications. After calibration, we can rectify the captured image by using the calibrated camera parameters.…

Computer Vision and Pattern Recognition · Computer Science 2014-07-17 Yichao Xu , Kazuki Maeno , Hajime Nagahara , Rin-ichiro Taniguchi

Light field (LF) cameras provide rich spatio-angular visual representations by sensing the visual scene from multiple perspectives and have recently emerged as a promising technology to boost the performance of human-machine systems such as…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Alireza Sepas-Moghaddam , Ali Etemad , Fernando Pereira , Paulo Lobato Correia

Recently, video frame interpolation using a combination of frame- and event-based cameras has surpassed traditional image-based methods both in terms of performance and memory efficiency. However, current methods still suffer from (i)…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Stepan Tulyakov , Alfredo Bochicchio , Daniel Gehrig , Stamatios Georgoulis , Yuanyou Li , Davide Scaramuzza

We suggest to represent an X-Field -a set of 2D images taken across different view, time or illumination conditions, i.e., video, light field, reflectance fields or combinations thereof-by learning a neural network (NN) to map their view,…

Computer Vision and Pattern Recognition · Computer Science 2020-10-02 Mojtaba Bemana , Karol Myszkowski , Hans-Peter Seidel , Tobias Ritschel

Classical light field rendering for novel view synthesis can accurately reproduce view-dependent effects such as reflection, refraction, and translucency, but requires a dense view sampling of the scene. Methods based on geometric…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Mohammed Suhail , Carlos Esteves , Leonid Sigal , Ameesh Makadia

This paper explores the problem of reconstructing high-resolution light field (LF) images from hybrid lenses, including a high-resolution camera surrounded by multiple low-resolution cameras. To tackle this challenge, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Jing Jin , Junhui Hou , Jie Chen , Sam Kwong , Jingyi Yu

The design of deep learning methods for low light video enhancement remains a challenging problem owing to the difficulty in capturing low light and ground truth video pairs. This is particularly hard in the context of dynamic scenes or…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Shivam Chhirolya , Sameer Malik , Rajiv Soundararajan

As light field images continue to increase in use and application, it becomes necessary to adapt existing image processing methods to this unique form of photography. In this paper we explore methods for applying neural style transfer to…

Computer Vision and Pattern Recognition · Computer Science 2020-02-27 David Hart , Jessica Greenland , Bryan Morse

Video frame interpolation aims at synthesizing intermediate frames from nearby source frames while maintaining spatial and temporal consistencies. The existing deep-learning-based video frame interpolation methods can be roughly divided…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Zhihao Shi , Xiaohong Liu , Kangdi Shi , Linhui Dai , Jun Chen

Camera placement is crutial in multi-camera systems such as virtual reality, autonomous driving, and high-quality reconstruction. The camera placement challenge lies in the nonlinear nature of high-dimensional parameters and the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Yihan Cao , Jiazhao Zhang , Zhinan Yu , Kai Xu

We present an imaging and neural rendering technique that seeks to synthesize videos of light propagating through a scene from novel, moving camera viewpoints. Our approach relies on a new ultrafast imaging setup to capture a first-of-its…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Anagh Malik , Noah Juravsky , Ryan Po , Gordon Wetzstein , Kiriakos N. Kutulakos , David B. Lindell