English

Dual-Channel Attention Guidance for Training-Free Image Editing Control in Diffusion Transformers

Computer Vision and Pattern Recognition 2026-02-26 v2 Artificial Intelligence

Abstract

Training-free control over editing intensity is a critical requirement for diffusion-based image editing models built on the Diffusion Transformer (DiT) architecture. Existing attention manipulation methods focus exclusively on the Key space to modulate attention routing, leaving the Value space -- which governs feature aggregation -- entirely unexploited. In this paper, we first reveal that both Key and Value projections in DiT's multi-modal attention layers exhibit a pronounced bias-delta structure, where token embeddings cluster tightly around a layer-specific bias vector. Building on this observation, we propose Dual-Channel Attention Guidance (DCAG), a training-free framework that simultaneously manipulates both the Key channel (controlling where to attend) and the Value channel (controlling what to aggregate). We provide a theoretical analysis showing that the Key channel operates through the nonlinear softmax function, acting as a coarse control knob, while the Value channel operates through linear weighted summation, serving as a fine-grained complement. Together, the two-dimensional parameter space (δk,δv)(\delta_k, \delta_v) enables more precise editing-fidelity trade-offs than any single-channel method. Extensive experiments on the PIE-Bench benchmark (700 images, 10 editing categories) demonstrate that DCAG consistently outperforms Key-only guidance across all fidelity metrics, with the most significant improvements observed in localized editing tasks such as object deletion (4.9% LPIPS reduction) and object addition (3.2% LPIPS reduction).

Keywords

Cite

@article{arxiv.2602.18022,
  title  = {Dual-Channel Attention Guidance for Training-Free Image Editing Control in Diffusion Transformers},
  author = {Guandong Li},
  journal= {arXiv preprint arXiv:2602.18022},
  year   = {2026}
}
R2 v1 2026-07-01T10:43:53.713Z