Light field (LF) cameras record both intensity and directions of light rays, and capture scenes from a number of viewpoints. Both information within each perspective (i.e., spatial information) and among different perspectives (i.e., angular information) is beneficial to image super-resolution (SR). In this paper, we propose a spatial-angular interactive network (namely, LF-InterNet) for LF image SR. Specifically, spatial and angular features are first separately extracted from input LFs, and then repetitively interacted to progressively incorporate spatial and angular information. Finally, the interacted features are fused to superresolve each sub-aperture image. Experimental results demonstrate the superiority of LF-InterNet over the state-of-the-art methods, i.e., our method can achieve high PSNR and SSIM scores with low computational cost, and recover faithful details in the reconstructed images.
@article{arxiv.1912.07849,
title = {Spatial-Angular Interaction for Light Field Image Super-Resolution},
author = {Yingqian Wang and Longguang Wang and Jungang Yang and Wei An and Jingyi Yu and Yulan Guo},
journal= {arXiv preprint arXiv:1912.07849},
year = {2020}
}
Comments
In this version, we have revised the paper and compared our LF-InterNet to the most recent LF-ATO method (CVPR2020). Codes and pre-trained models are available at https://github.com/YingqianWang/LF-InterNet