English

A Modular and Robust Physics-Based Approach for Lensless Image Reconstruction

Image and Video Processing 2024-09-26 v2

Abstract

In this paper, we present a modular approach for reconstructing lensless measurements. It consists of three components: a newly-proposed pre-processor, a physics-based camera inverter to undo the multiplexing of lensless imaging, and a post-processor. The pre- and post-processors address noise and artifacts unique to lensless imaging before and after camera inversion respectively. By training the three components end-to-end, we obtain a 1.9 dB increase in PSNR and a 14% relative improvement in a perceptual image metric (LPIPS) with respect to previously proposed physics-based methods. We also demonstrate how the proposed pre-processor provides more robustness to input noise, and how an auxiliary loss can improve interpretability.

Keywords

Cite

@article{arxiv.2403.00537,
  title  = {A Modular and Robust Physics-Based Approach for Lensless Image Reconstruction},
  author = {Yohann Perron and Eric Bezzam and Martin Vetterli},
  journal= {arXiv preprint arXiv:2403.00537},
  year   = {2024}
}

Comments

6 pages, 2024 IEEE International Conference on Image Processing (ICIP), demo notebook: https://go.epfl.ch/lensless-modular

R2 v1 2026-06-28T15:05:55.321Z