English

When the Prompt Becomes Visual: Vision-Centric Jailbreak Attacks for Large Image Editing Models

Computer Vision and Pattern Recognition 2026-02-12 v1 Artificial Intelligence

Abstract

Recent advances in large image editing models have shifted the paradigm from text-driven instructions to vision-prompt editing, where user intent is inferred directly from visual inputs such as marks, arrows, and visual-text prompts. While this paradigm greatly expands usability, it also introduces a critical and underexplored safety risk: the attack surface itself becomes visual. In this work, we propose Vision-Centric Jailbreak Attack (VJA), the first visual-to-visual jailbreak attack that conveys malicious instructions purely through visual inputs. To systematically study this emerging threat, we introduce IESBench, a safety-oriented benchmark for image editing models. Extensive experiments on IESBench demonstrate that VJA effectively compromises state-of-the-art commercial models, achieving attack success rates of up to 80.9% on Nano Banana Pro and 70.1% on GPT-Image-1.5. To mitigate this vulnerability, we propose a training-free defense based on introspective multimodal reasoning, which substantially improves the safety of poorly aligned models to a level comparable with commercial systems, without auxiliary guard models and with negligible computational overhead. Our findings expose new vulnerabilities, provide both a benchmark and practical defense to advance safe and trustworthy modern image editing systems. Warning: This paper contains offensive images created by large image editing models.

Cite

@article{arxiv.2602.10179,
  title  = {When the Prompt Becomes Visual: Vision-Centric Jailbreak Attacks for Large Image Editing Models},
  author = {Jiacheng Hou and Yining Sun and Ruochong Jin and Haochen Han and Fangming Liu and Wai Kin Victor Chan and Alex Jinpeng Wang},
  journal= {arXiv preprint arXiv:2602.10179},
  year   = {2026}
}

Comments

Project homepage: https://csu-jpg.github.io/vja.github.io/

R2 v1 2026-07-01T10:30:23.782Z