English

Real-time division-of-focal-plane polarization imaging system with progressive networks

Image and Video Processing 2021-10-27 v1 Computer Vision and Pattern Recognition

Abstract

Division-of-focal-plane (DoFP) polarization imaging technical recently has been applied in many fields. However, the images captured by such sensors cannot be used directly because they suffer from instantaneous field-of-view errors and low resolution problem. This paper builds a fast DoFP demosaicing system with proposed progressive polarization demosaicing convolutional neural network (PPDN), which is specifically designed for edge-side GPU devices like Navidia Jetson TX2. The proposed network consists of two parts: reconstruction stage and refining stage. The former recovers four polarization channels from a single DoFP image. The latter fine-tune the four channels to obtain more accurate polarization information. PPDN can be implemented in another version: PPDN-L (large), for the platforms of high computing resources. Experiments show that PPDN can compete with the best existing methods with fewer parameters and faster inference speed and meet the real-time demands of imaging system.

Keywords

Cite

@article{arxiv.2110.13823,
  title  = {Real-time division-of-focal-plane polarization imaging system with progressive networks},
  author = {Rongyuan Wu and Yongqiang Zhao and Ning Li and Seong G. Kong},
  journal= {arXiv preprint arXiv:2110.13823},
  year   = {2021}
}

Comments

Submit to IEEE Sensors Journal