English

Off-the-shelf Vision Models Benefit Image Manipulation Localization

Computer Vision and Pattern Recognition 2026-04-13 v1 Multimedia Image and Video Processing

Abstract

Image manipulation localization (IML) and general vision tasks are typically treated as two separate research directions due to the fundamental differences between manipulation-specific and semantic features. In this paper, however, we bridge this gap by introducing a fresh perspective: these two directions are intrinsically connected, and general semantic priors can benefit IML. Building on this insight, we propose a novel trainable adapter (named ReVi) that repurposes existing off-the-shelf general-purpose vision models (e.g., image generation and segmentation networks) for IML. Inspired by robust principal component analysis, the adapter disentangles semantic redundancy from manipulation-specific information embedded in these models and selectively enhances the latter. Unlike existing IML methods that require extensive model redesign and full retraining, our method relies on the off-the-shelf vision models with frozen parameters and only fine-tunes the proposed adapter. The experimental results demonstrate the superiority of our method, showing the potential for scalable IML frameworks.

Keywords

Cite

@article{arxiv.2604.09096,
  title  = {Off-the-shelf Vision Models Benefit Image Manipulation Localization},
  author = {Zhengxuan Zhang and Keji Song and Junmin Hu and Ao Luo and Yuezun Li},
  journal= {arXiv preprint arXiv:2604.09096},
  year   = {2026}
}
R2 v1 2026-07-01T12:02:35.744Z