English

Hierarchical Vision-Language Alignment for Text-to-Image Generation via Diffusion Models

Computer Vision and Pattern Recognition 2025-01-03 v1

Abstract

Text-to-image generation has witnessed significant advancements with the integration of Large Vision-Language Models (LVLMs), yet challenges remain in aligning complex textual descriptions with high-quality, visually coherent images. This paper introduces the Vision-Language Aligned Diffusion (VLAD) model, a generative framework that addresses these challenges through a dual-stream strategy combining semantic alignment and hierarchical diffusion. VLAD utilizes a Contextual Composition Module (CCM) to decompose textual prompts into global and local representations, ensuring precise alignment with visual features. Furthermore, it incorporates a multi-stage diffusion process with hierarchical guidance to generate high-fidelity images. Experiments conducted on MARIO-Eval and INNOVATOR-Eval benchmarks demonstrate that VLAD significantly outperforms state-of-the-art methods in terms of image quality, semantic alignment, and text rendering accuracy. Human evaluations further validate the superior performance of VLAD, making it a promising approach for text-to-image generation in complex scenarios.

Keywords

Cite

@article{arxiv.2501.00917,
  title  = {Hierarchical Vision-Language Alignment for Text-to-Image Generation via Diffusion Models},
  author = {Emily Johnson and Noah Wilson},
  journal= {arXiv preprint arXiv:2501.00917},
  year   = {2025}
}
R2 v1 2026-06-28T20:54:04.675Z