English

TAG: Tangential Amplifying Guidance for Hallucination-Resistant Sampling

Computer Vision and Pattern Recognition 2026-05-27 v2

Abstract

Diffusion models achieve state-of-the-art image generation but often produce semantic inconsistencies, or hallucinations. Existing inference-time guidance methods rely on external signals or architectural modifications, adding computational overhead. We propose T\mathbf{T}angential A\mathbf{A}mplifying G\mathbf{G}uidance (TAG)\mathbf{(TAG)}, a training-free, architecture-agnostic, plug-and-play guidance method that operates purely on trajectory signals. TAG uses an intermediate sample as a projection basis and amplifies the tangential components of the estimated score to correct the sampling trajectory. A first-order Taylor analysis shows that this steers the state toward higher-probability regions of the data manifold, reducing inconsistencies and improving fidelity while adding negligible overhead to existing samplers. Code is available at our Project Page (https://hyeon-cho.github.io/TAG/).

Cite

@article{arxiv.2510.04533,
  title  = {TAG: Tangential Amplifying Guidance for Hallucination-Resistant Sampling},
  author = {Hyunmin Cho and Donghoon Ahn and Susung Hong and Jee Eun Kim and Seungryong Kim and Kyong Hwan Jin},
  journal= {arXiv preprint arXiv:2510.04533},
  year   = {2026}
}

Comments

Accepted to ICML 2026 (Regular)

R2 v1 2026-07-01T06:18:35.669Z