English

MDE-Edit: Masked Dual-Editing for Multi-Object Image Editing via Diffusion Models

Computer Vision and Pattern Recognition 2025-05-13 v2

Abstract

Multi-object editing aims to modify multiple objects or regions in complex scenes while preserving structural coherence. This task faces significant challenges in scenarios involving overlapping or interacting objects: (1) Inaccurate localization of target objects due to attention misalignment, leading to incomplete or misplaced edits; (2) Attribute-object mismatch, where color or texture changes fail to align with intended regions due to cross-attention leakage, creating semantic conflicts (\textit{e.g.}, color bleeding into non-target areas). Existing methods struggle with these challenges: approaches relying on global cross-attention mechanisms suffer from attention dilution and spatial interference between objects, while mask-based methods fail to bind attributes to geometrically accurate regions due to feature entanglement in multi-object scenarios. To address these limitations, we propose a training-free, inference-stage optimization approach that enables precise localized image manipulation in complex multi-object scenes, named MDE-Edit. MDE-Edit optimizes the noise latent feature in diffusion models via two key losses: Object Alignment Loss (OAL) aligns multi-layer cross-attention with segmentation masks for precise object positioning, and Color Consistency Loss (CCL) amplifies target attribute attention within masks while suppressing leakage to adjacent regions. This dual-loss design ensures localized and coherent multi-object edits. Extensive experiments demonstrate that MDE-Edit outperforms state-of-the-art methods in editing accuracy and visual quality, offering a robust solution for complex multi-object image manipulation tasks.

Keywords

Cite

@article{arxiv.2505.05101,
  title  = {MDE-Edit: Masked Dual-Editing for Multi-Object Image Editing via Diffusion Models},
  author = {Hongyang Zhu and Haipeng Liu and Bo Fu and Yang Wang},
  journal= {arXiv preprint arXiv:2505.05101},
  year   = {2025}
}

Comments

9 pages, 7 figures

R2 v1 2026-06-28T23:25:34.240Z