English
Related papers

Related papers: T2I-ConBench: Text-to-Image Benchmark for Continua…

200 papers

The rapid development of diffusion models has significantly advanced AI-generated content (AIGC), particularly in Text-to-Image (T2I) and Text-to-Video (T2V) generation. Text-based video editing, leveraging these generative capabilities,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Yupeng Chen , Penglin Chen , Xiaoyu Zhang , Yixian Huang , Qian Xie

Text-to-image (T2I) generation has made significant advances in recent years, but challenges still remain in the generation of perceptual artifacts, misalignment with complex prompts, and safety. The prevailing approach to address these…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Xiaoying Xing , Avinab Saha , Junfeng He , Susan Hao , Paul Vicol , Moonkyung Ryu , Gang Li , Sahil Singla , Sarah Young , Yinxiao Li , Feng Yang , Deepak Ramachandran

Bias in text-to-image (T2I) models can propagate unfair social representations and may be used to aggressively market ideas or push controversial agendas. Existing T2I model bias evaluation methods only focus on social biases. We look…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Jordan Vice , Naveed Akhtar , Richard Hartley , Ajmal Mian

Recent years have seen impressive advances in text-to-image generation, with image generative or unified models producing high-quality images from text. Yet these models still struggle with fine-grained color controllability, often failing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Muhammad Atif Butt , Alexandra Gomez-Villa , Tao Wu , Javier Vazquez-Corral , Joost Van De Weijer , Kai Wang

Text-to-image (T2I) systems increasingly rely on upstream prompters, either humans or multimodal large language models (MLLMs), to translate user intent into detailed prompts. Yet current benchmarks fix the prompt and only evaluate T2I…

Artificial Intelligence · Computer Science 2026-05-22 Hanjun Luo , Zhimu Huang , Sylvia Chung , Yiran Wang , Yingbin Jin , Jialin Li , Jiang Li , Xinfeng Li , Hanan Salam

Text-to-image models often struggle to generate images that precisely match textual prompts. Prior research has extensively studied the evaluation of image-text alignment in text-to-image generation. However, existing evaluations primarily…

Computation and Language · Computer Science 2025-06-11 Huixuan Zhang , Xiaojun Wan

Text-to-image diffusion models (T2I DMs) have achieved remarkable success in generating high-quality and diverse images from text prompts, yet recent studies have revealed their vulnerability to backdoor attacks. Existing attack methods…

Cryptography and Security · Computer Science 2025-08-05 Haoran Dai , Jiawen Wang , Ruo Yang , Manali Sharma , Zhonghao Liao , Yuan Hong , Binghui Wang

Text-to-Image (T2I) models have achieved remarkable success in generating visual content from text inputs. Although multiple safety alignment strategies have been proposed to prevent harmful outputs, they often lead to overly cautious…

Machine Learning · Computer Science 2025-10-28 Ziheng Cheng , Yixiao Huang , Hui Xu , Somayeh Sojoudi , Xuandong Zhao , Dawn Song , Song Mei

As text-to-image diffusion models gain widespread commercial applications, there are increasing concerns about unethical or harmful use, including the unauthorized generation of copyrighted or sensitive content. Concept unlearning has…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Saemi Moon , Minjong Lee , Sangdon Park , Dongwoo Kim

Multilingual text-to-image (T2I) models have advanced rapidly in terms of visual realism and semantic alignment, and are now widely utilized. Yet outputs vary across cultural contexts: because language carries cultural connotations, images…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Chuancheng Shi , Shangze Li , Shiming Guo , Simiao Xie , Wenhua Wu , Jingtong Dou , Chao Wu , Canran Xiao , Cong Wang , Zifeng Cheng , Fei Shen , Tat-Seng Chua

Text-to-image (T2I) diffusion models lack an efficient mechanism for early quality assessment, leading to costly trial-and-error in multi-generation scenarios such as prompt iteration, agent-based generation, and flow-grpo. We reveal a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Benlei Cui , Bukun Huang , Zhizeng Ye , Xuemei Dong , Tuo Chen , Hui Xue , Dingkang Yang , Longtao Huang , Jingqun Tang , Haiwen Hong

Recent text-to-image (T2I) diffusion and flow-matching models can produce highly realistic images from natural language prompts. In practical scenarios, T2I systems are often run in a ``generate--then--select'' mode: many seeds are sampled…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Huanlei Guo , Hongxin Wei , Bingyi Jing

Text-to-Image In-Context Learning (T2I-ICL) enables customized image synthesis via interleaved text-image examples but faces two mutually reinforcing bottlenecks, compliance failure and prior-dominated hallucination, that form a vicious…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Zhiyong Ma , Zhenpeng Li , Yuanjie Shi , Zhengping Li , Jiahao Chen , Qingyuan Chuai

Image editing aims to edit the given synthetic or real image to meet the specific requirements from users. It is widely studied in recent years as a promising and challenging field of Artificial Intelligence Generative Content (AIGC).…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Xincheng Shuai , Henghui Ding , Xingjun Ma , Rongcheng Tu , Yu-Gang Jiang , Dacheng Tao

Fine-tuning text-to-image models with reward functions trained on human feedback data has proven effective for aligning model behavior with human intent. However, excessive optimization with such reward models, which serve as mere proxy…

Machine Learning · Computer Science 2024-04-03 Kyuyoung Kim , Jongheon Jeong , Minyong An , Mohammad Ghavamzadeh , Krishnamurthy Dvijotham , Jinwoo Shin , Kimin Lee

The rapid advancement of text-to-image (T2I) diffusion models has enabled them to generate unprecedented results from given texts. However, as text inputs become longer, existing encoding methods like CLIP face limitations, and aligning the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Luping Liu , Chao Du , Tianyu Pang , Zehan Wang , Chongxuan Li , Dong Xu

This paper analyzes the impact of causal manner in the text encoder of text-to-image (T2I) diffusion models, which can lead to information bias and loss. Previous works have focused on addressing the issues through the denoising process.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Chieh-Yun Chen , Chiang Tseng , Li-Wu Tsao , Hong-Han Shuai

Text-to-image (T2I) diffusion models have achieved remarkable success in generating high-quality images from textual prompts. However, their ability to store vast amounts of knowledge raises concerns in scenarios where selective forgetting…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Gen Li , Yang Xiao , Jie Ji , Kaiyuan Deng , Bo Hui , Linke Guo , Xiaolong Ma

Recent advances in Text-to-3D (T23D) generative models have enabled the synthesis of diverse, high-fidelity 3D assets from textual prompts. However, existing challenges restrict the development of reliable T23D quality assessment (T23DQA).…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Bingyang Cui , Yujie Zhang , Qi Yang , Zhu Li , Yiling Xu

Despite the impressive text-to-image (T2I) synthesis capabilities of diffusion models, they often struggle to understand compositional relationships between objects and attributes, especially in complex settings. Existing solutions have…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Evans Xu Han , Linghao Jin , Xiaofeng Liu , Paul Pu Liang