English

Deep convolutional demosaicking network for multispectral polarization filter array

Image and Video Processing 2024-10-17 v2

Abstract

To address the demosaicking problem in multispectral polarization filter array (MSPFA) imaging, we propose a multispectral polarization demosaicking network (MSPDNet) that improves image reconstruction accuracy. Imaging with a multispectral polarization filter array acquires multispectral polarization information in a snapshot. The full-resolution multispectral polarization image must be reconstructed from a mosaic image. In the proposed method, a sparse image in which pixel values of the same channel are extracted from a mosaic image is used as input to MSPDNet. Missing pixels are interpolated by learning spatial and wavelength correlations from the observed pixels in the mosaic image. Moreover, by using 3D convolution, features are extracted at each convolution layer, and by deepening the network, even detailed features of the multispectral polarization image can be learned. Experimental results show that MSPDNet can reconstruct multi-wavelength and multi-polarization angle information with high accuracy in terms of peak signal-to-noise ratio (PSNR) evaluation and visual quality, indicating the effectiveness of the proposed method compared to other methods.

Keywords

Cite

@article{arxiv.2406.05312,
  title  = {Deep convolutional demosaicking network for multispectral polarization filter array},
  author = {Tomoharu Ishiuchi and Kazuma Shinoda},
  journal= {arXiv preprint arXiv:2406.05312},
  year   = {2024}
}

Comments

This submission has been withdrawn by the authors due to errors in the experimental data.

R2 v1 2026-06-28T16:57:58.027Z