English

RePrompt: Reasoning-Augmented Reprompting for Text-to-Image Generation via Reinforcement Learning

Computer Vision and Pattern Recognition 2025-05-26 v1 Artificial Intelligence

Abstract

Despite recent progress in text-to-image (T2I) generation, existing models often struggle to faithfully capture user intentions from short and under-specified prompts. While prior work has attempted to enhance prompts using large language models (LLMs), these methods frequently generate stylistic or unrealistic content due to insufficient grounding in visual semantics and real-world composition. Inspired by recent advances in reasoning for language model, we propose RePrompt, a novel reprompting framework that introduces explicit reasoning into the prompt enhancement process via reinforcement learning. Instead of relying on handcrafted rules or stylistic rewrites, our method trains a language model to generate structured, self-reflective prompts by optimizing for image-level outcomes. The tailored reward models assesse the generated images in terms of human preference, semantic alignment, and visual composition, providing indirect supervision to refine prompt generation. Our approach enables end-to-end training without human-annotated data. Experiments on GenEval and T2I-Compbench show that RePrompt significantly boosts spatial layout fidelity and compositional generalization across diverse T2I backbones, establishing new state-of-the-art results.

Keywords

Cite

@article{arxiv.2505.17540,
  title  = {RePrompt: Reasoning-Augmented Reprompting for Text-to-Image Generation via Reinforcement Learning},
  author = {Mingrui Wu and Lu Wang and Pu Zhao and Fangkai Yang and Jianjin Zhang and Jianfeng Liu and Yuefeng Zhan and Weihao Han and Hao Sun and Jiayi Ji and Xiaoshuai Sun and Qingwei Lin and Weiwei Deng and Dongmei Zhang and Feng Sun and Qi Zhang and Rongrong Ji},
  journal= {arXiv preprint arXiv:2505.17540},
  year   = {2025}
}

Comments

Code is available at: https://github.com/microsoft/DKI_LLM/tree/main/RePrompt

R2 v1 2026-07-01T02:33:15.879Z