English

Single-image reflection removal via self-supervised diffusion models

Computer Vision and Pattern Recognition 2024-12-31 v1 Image and Video Processing

Abstract

Reflections often degrade the visual quality of images captured through transparent surfaces, and reflection removal methods suffers from the shortage of paired real-world samples.This paper proposes a hybrid approach that combines cycle-consistency with denoising diffusion probabilistic models (DDPM) to effectively remove reflections from single images without requiring paired training data. The method introduces a Reflective Removal Network (RRN) that leverages DDPMs to model the decomposition process and recover the transmission image, and a Reflective Synthesis Network (RSN) that re-synthesizes the input image using the separated components through a nonlinear attention-based mechanism. Experimental results demonstrate the effectiveness of the proposed method on the SIR2^2, Flash-Based Reflection Removal (FRR) Dataset, and a newly introduced Museum Reflection Removal (MRR) dataset, showing superior performance compared to state-of-the-art methods.

Keywords

Cite

@article{arxiv.2412.20466,
  title  = {Single-image reflection removal via self-supervised diffusion models},
  author = {Zhengyang Lu and Weifan Wang and Tianhao Guo and Feng Wang},
  journal= {arXiv preprint arXiv:2412.20466},
  year   = {2024}
}