English

Toward Early Quality Assessment of Text-to-Image Diffusion Models

Computer Vision and Pattern Recognition 2026-03-05 v2 Machine Learning

Abstract

Recent text-to-image (T2I) diffusion and flow-matching models can produce highly realistic images from natural language prompts. In practical scenarios, T2I systems are often run in a ``generate--then--select'' mode: many seeds are sampled and only a few images are kept for use. However, this pipeline is highly resource-intensive since each candidate requires tens to hundreds of denoising steps, and evaluation metrics such as CLIPScore and ImageReward are post-hoc. In this work, we address this inefficiency by introducing Probe-Select, a plug-in module that enables efficient evaluation of image quality within the generation process. We observe that certain intermediate denoiser activations, even at early timesteps, encode a stable coarse structure, object layout and spatial arrangement--that strongly correlates with final image fidelity. Probe-Select exploits this property by predicting final quality scores directly from early activations, allowing unpromising seeds to be terminated early. Across diffusion and flow-matching backbones, our experiments show that early evaluation at only 20\% of the trajectory accurately ranks candidate seeds and enables selective continuation. This strategy reduces sampling cost by over 60\% while improving the quality of the retained images, demonstrating that early structural signals can effectively guide selective generation without altering the underlying generative model. Code is available at https://github.com/Guhuary/ProbeSelect.

Keywords

Cite

@article{arxiv.2603.02829,
  title  = {Toward Early Quality Assessment of Text-to-Image Diffusion Models},
  author = {Huanlei Guo and Hongxin Wei and Bingyi Jing},
  journal= {arXiv preprint arXiv:2603.02829},
  year   = {2026}
}
R2 v1 2026-07-01T11:00:46.980Z