English
Related papers

Related papers: Improving Text-to-Image Consistency via Automatic …

200 papers

Text-to-image diffusion models have shown impressive capabilities in generating realistic visuals from natural-language prompts, yet they often struggle with accurately binding attributes to corresponding objects, especially in prompts…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Do Huu Dat , Nam Hyeonu , Po-Yuan Mao , Tae-Hyun Oh

We present Infinite-Story, a training-free framework for consistent text-to-image (T2I) generation tailored for multi-prompt storytelling scenarios. Built upon a scale-wise autoregressive model, our method addresses two key challenges in…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Jihun Park , Kyoungmin Lee , Jongmin Gim , Hyeonseo Jo , Minseok Oh , Wonhyeok Choi , Kyumin Hwang , Jaeyeul Kim , Minwoo Choi , Sunghoon Im

Compositionality is a critical capability in Text-to-Image (T2I) models, as it reflects their ability to understand and combine multiple concepts from text descriptions. Existing evaluations of compositional capability rely heavily on…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Xindi Wu , Dingli Yu , Yangsibo Huang , Olga Russakovsky , Sanjeev Arora

Personalized text-to-image (P-T2I) generation aims to create new, text-guided images featuring the personalized subject with a few reference images. However, balancing the trade-off relationship between prompt fidelity and identity…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Kangyeol Kim , Wooseok Seo , Sehyun Nam , Bodam Kim , Suhyeon Jeong , Wonwoo Cho , Jaegul Choo , Youngjae Yu

Currently, the success of large language models (LLMs) illustrates that a unified multitasking approach can significantly enhance model usability, streamline deployment, and foster synergistic benefits across different tasks. However, in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Bin Xia , Yuechen Zhang , Jingyao Li , Chengyao Wang , Yitong Wang , Xinglong Wu , Bei Yu , Jiaya Jia

Prompt learning has become one of the most efficient paradigms for adapting large pre-trained vision-language models to downstream tasks. Current state-of-the-art methods, like CoOp and ProDA, tend to adopt soft prompts to learn an…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Sifan Long , Zhen Zhao , Junkun Yuan , Zichang Tan , Jiangjiang Liu , Luping Zhou , Shengsheng Wang , Jingdong Wang

With AI-generated content becoming ubiquitous across the web, social media, and other digital platforms, it is vital to examine how such content are inspired and generated. The creation of AI-generated images often involves refining the…

Artificial Intelligence · Computer Science 2025-04-30 Khoi Trinh , Scott Seidenberger , Raveen Wijewickrama , Murtuza Jadliwala , Anindya Maiti

The rapid evolution of text-to-image diffusion models has opened the door of generative AI, enabling the translation of textual descriptions into visually compelling images with remarkable quality. However, a persistent challenge within…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Zezhong Fan , Xiaohan Li , Chenhao Fang , Topojoy Biswas , Kaushiki Nag , Jianpeng Xu , Kannan Achan

The popularization of Text-to-Image (T2I) diffusion models enables the generation of high-quality images from text descriptions. However, generating diverse customized images with reference visual attributes remains challenging. This work…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Brian Nlong Zhao , Yuhang Xiao , Jiashu Xu , Xinyang Jiang , Yifan Yang , Dongsheng Li , Laurent Itti , Vibhav Vineet , Yunhao Ge

Text-to-image generative models, specifically those based on diffusion models like Imagen and Stable Diffusion, have made substantial advancements. Recently, there has been a surge of interest in the delicate refinement of text prompts.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Wenyi Mo , Tianyu Zhang , Yalong Bai , Bing Su , Ji-Rong Wen , Qing Yang

Text-to-image generative models have demonstrated remarkable capabilities in generating high-quality images based on textual prompts. However, crafting prompts that accurately capture the user's creative intent remains challenging. It often…

Human-Computer Interaction · Computer Science 2023-04-20 Stephen Brade , Bryan Wang , Mauricio Sousa , Sageev Oore , Tovi Grossman

Despite the integration of safety alignment and external filters, text-to-image (T2I) generative systems are still susceptible to producing harmful content, such as sexual or violent imagery. This raises serious concerns about unintended…

Cryptography and Security · Computer Science 2025-12-09 Boheng Li , Junjie Wang , Yiming Li , Zhiyang Hu , Leyi Qi , Jianshuo Dong , Run Wang , Han Qiu , Zhan Qin , Tianwei Zhang

In text-to-image (T2I) generation, a prevalent training technique involves utilizing Vision Language Models (VLMs) for image re-captioning. Even though VLMs are known to exhibit hallucination, generating descriptive content that deviates…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Weichen Yu , Ziyan Yang , Shanchuan Lin , Qi Zhao , Jianyi Wang , Liangke Gui , Matt Fredrikson , Lu Jiang

Generating images from textual descriptions has recently attracted a lot of interest. While current models can generate photo-realistic images of individual objects such as birds and human faces, synthesising images with multiple objects is…

Computer Vision and Pattern Recognition · Computer Science 2020-10-29 Stanislav Frolov , Shailza Jolly , Jörn Hees , Andreas Dengel

Text-to-Image (T2I) models have advanced significantly, but their growing popularity raises security concerns due to their potential to generate harmful images. To address these issues, we propose UPAM, a novel framework to evaluate the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Duo Peng , Qiuhong Ke , Mark He Huang , Ping Hu , Jun Liu

Despite advancements in text-to-image generation (T2I), prior methods often face text-image misalignment problems such as relation confusion in generated images. Existing solutions involve cross-attention manipulation for better…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Leigang Qu , Wenjie Wang , Yongqi Li , Hanwang Zhang , Liqiang Nie , Tat-Seng Chua

Text-to-image (T2I) generation has seen significant progress with diffusion models, enabling generation of photo-realistic images from text prompts. Despite this progress, existing methods still face challenges in following complex text…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Ashish Goswami , Satyam Kumar Modi , Santhosh Rishi Deshineni , Harman Singh , Prathosh A. P , Parag Singla

The rapid progress in diffusion-based text-to-image (T2I) generation has created an urgent need for interpretable automatic evaluation methods that can assess the quality of generated images, therefore reducing the human annotation burden.…

Artificial Intelligence · Computer Science 2025-05-26 Zi-Ao Ma , Tian Lan , Rong-Cheng Tu , Shu-Hang Liu , Heyan Huang , Zhijing Wu , Chen Xu , Xian-Ling Mao

Recent text-to-image (T2I) generation models have advanced significantly, enabling the creation of high-fidelity images from textual prompts. However, existing evaluation benchmarks primarily focus on the explicit alignment between…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Wenchao Zhang , Jiahe Tian , Runze He , Jizhong Han , Jiao Dai , Miaomiao Feng , Wei Mi , Xiaodan Zhang

Diffusion models have revitalized the image generation domain, playing crucial roles in both academic research and artistic expression. With the emergence of new diffusion models, assessing the performance of text-to-image models has become…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Chutian Meng , Fan Ma , Jiaxu Miao , Chi Zhang , Yi Yang , Yueting Zhuang