English

Guiding Diffusion Models with Semantically Degraded Conditions

Computer Vision and Pattern Recognition 2026-03-12 v1

Abstract

Classifier-Free Guidance (CFG) is a cornerstone of modern text-to-image models, yet its reliance on a semantically vacuous null prompt (\varnothing) generates a guidance signal prone to geometric entanglement. This is a key factor limiting its precision, leading to well-documented failures in complex compositional tasks. We propose Condition-Degradation Guidance (CDG), a novel paradigm that replaces the null prompt with a strategically degraded condition, cdeg\boldsymbol{c}_{\text{deg}}. This reframes guidance from a coarse "good vs. null" contrast to a more refined "good vs. almost good" discrimination, thereby compelling the model to capture fine-grained semantic distinctions. We find that tokens in transformer text encoders split into two functional roles: content tokens encoding object semantics, and context-aggregating tokens capturing global context. By selectively degrading only the former, CDG constructs cdeg\boldsymbol{c}_{\text{deg}} without external models or training. Validated across diverse architectures including Stable Diffusion 3, FLUX, and Qwen-Image, CDG markedly improves compositional accuracy and text-image alignment. As a lightweight, plug-and-play module, it achieves this with negligible computational overhead. Our work challenges the reliance on static, information-sparse negative samples and establishes a new principle for diffusion guidance: the construction of adaptive, semantically-aware negative samples is critical to achieving precise semantic control. Code is available at https://github.com/Ming-321/Classifier-Degradation-Guidance.

Cite

@article{arxiv.2603.10780,
  title  = {Guiding Diffusion Models with Semantically Degraded Conditions},
  author = {Shilong Han and Yuming Zhang and Hongxia Wang},
  journal= {arXiv preprint arXiv:2603.10780},
  year   = {2026}
}

Comments

Accepted to CVPR 2026

R2 v1 2026-07-01T11:14:41.397Z