English

HarmonPaint: Harmonized Training-Free Diffusion Inpainting

Computer Vision and Pattern Recognition 2025-07-23 v1

Abstract

Existing inpainting methods often require extensive retraining or fine-tuning to integrate new content seamlessly, yet they struggle to maintain coherence in both structure and style between inpainted regions and the surrounding background. Motivated by these limitations, we introduce HarmonPaint, a training-free inpainting framework that seamlessly integrates with the attention mechanisms of diffusion models to achieve high-quality, harmonized image inpainting without any form of training. By leveraging masking strategies within self-attention, HarmonPaint ensures structural fidelity without model retraining or fine-tuning. Additionally, we exploit intrinsic diffusion model properties to transfer style information from unmasked to masked regions, achieving a harmonious integration of styles. Extensive experiments demonstrate the effectiveness of HarmonPaint across diverse scenes and styles, validating its versatility and performance.

Keywords

Cite

@article{arxiv.2507.16732,
  title  = {HarmonPaint: Harmonized Training-Free Diffusion Inpainting},
  author = {Ying Li and Xinzhe Li and Yong Du and Yangyang Xu and Junyu Dong and Shengfeng He},
  journal= {arXiv preprint arXiv:2507.16732},
  year   = {2025}
}
R2 v1 2026-07-01T04:13:42.661Z