English
Related papers

Related papers: Universal Prompt Optimizer for Safe Text-to-Image …

200 papers

Text-to-Image(T2I) models typically deploy safety filters to prevent the generation of sensitive images. Unfortunately, recent jailbreaking attack methods manually design instructions for the LLM to generate adversarial prompts, which…

Cryptography and Security · Computer Science 2025-11-24 Chenyu Zhang , Lanjun Wang , Yiwen Ma , Wenhui Li , An-An Liu

Text-to-image generation has advanced rapidly, yet aligning complex textual prompts with generated visuals remains challenging, especially with intricate object relationships and fine-grained details. This paper introduces Fast Prompt…

Computation and Language · Computer Science 2024-12-12 Khalil Mrini , Hanlin Lu , Linjie Yang , Weilin Huang , Heng Wang

Text-to-Image (T2I) models have recently gained significant attention due to their ability to generate high-quality images and are consequently used in a wide range of applications. However, there are concerns about the gender bias of these…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Yunbo Lyu , Zhou Yang , Yuqing Niu , Jing Jiang , David Lo

Despite their impressive capabilities, diffusion-based text-to-image (T2I) models can lack faithfulness to the text prompt, where generated images may not contain all the mentioned objects, attributes or relations. To alleviate these…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Shyamgopal Karthik , Karsten Roth , Massimiliano Mancini , Zeynep Akata

Text-to-image models take a sentence (i.e., prompt) and generate images associated with this input prompt. These models have created award wining-art, videos, and even synthetic datasets. However, text-to-image (T2I) models can generate…

Computation and Language · Computer Science 2023-06-12 Alexander Lin , Lucas Monteiro Paes , Sree Harsha Tanneru , Suraj Srinivas , Himabindu Lakkaraju

In the text-to-image generation field, recent remarkable progress in Stable Diffusion makes it possible to generate rich kinds of novel photorealistic images. However, current models still face misalignment issues (e.g., problematic spatial…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Leigang Qu , Shengqiong Wu , Hao Fei , Liqiang Nie , Tat-Seng Chua

Text-to-image (T2I) models, while offering immense creative potential, are highly reliant on human intervention, posing significant usability challenges that often necessitate manual, iterative prompt engineering over often underspecified…

Artificial Intelligence · Computer Science 2025-09-16 Xingchen Wan , Han Zhou , Ruoxi Sun , Hootan Nakhost , Ke Jiang , Rajarishi Sinha , Sercan Ö. Arık

Text-to-image (T2I) diffusion models have demonstrated impressive image generation capabilities. Still, their computational intensity prohibits resource-constrained organizations from deploying T2I models after fine-tuning them on their…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Alireza Ganjdanesh , Reza Shirkavand , Shangqian Gao , Heng Huang

Text-to-image models (T2I) such as StableDiffusion have been used to generate high quality images of people. However, due to the random nature of the generation process, the person has a different appearance e.g. pose, face, and clothing,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Soon Yau Cheong , Armin Mustafa , Andrew Gilbert

Recent text-to-image (T2I) models have made remarkable progress in generating visually realistic and semantically coherent images. However, they still suffer from randomness and inconsistency with the given prompts, particularly when…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Kaishen Wang , Ruibo Chen , Tong Zheng , Heng Huang

Text-to-image (TTI) diffusion models have achieved remarkable visual quality, yet they have been repeatedly shown to exhibit social biases across sensitive attributes such as gender, race and age. To mitigate these biases, existing…

Machine Learning · Computer Science 2026-03-18 Manos Plitsis , Giorgos Bouritsas , Vassilis Katsouros , Yannis Panagakis

In recent years, Text-to-Image (T2I) models have garnered significant attention due to their remarkable advancements. However, security concerns have emerged due to their potential to generate inappropriate or Not-Safe-For-Work (NSFW)…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Yihao Huang , Le Liang , Tianlin Li , Xiaojun Jia , Run Wang , Weikai Miao , Geguang Pu , Yang Liu

Text-to-image models are powerful for producing high-quality images based on given text prompts, but crafting these prompts often requires specialized vocabulary. To address this, existing methods train rewriting models with supervision…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Hongji Yang , Yucheng Zhou , Wencheng Han , Jianbing Shen

Extremely large image generators offer significant transformative potential across diverse sectors. It allows users to design specific prompts to generate realistic images through some black-box APIs. However, some studies reveal that image…

Cryptography and Security · Computer Science 2024-02-26 Yu Tian , Xiao Yang , Yinpeng Dong , Heming Yang , Hang Su , Jun Zhu

Text-to-Image (T2I) Diffusion Models (DMs) have shown impressive abilities in generating high-quality images based on simple text descriptions. However, as is common with many Deep Learning (DL) models, DMs are subject to a lack of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yi Zhang , Yun Tang , Wenjie Ruan , Xiaowei Huang , Siddartha Khastgir , Paul Jennings , Xingyu Zhao

Text-to-image generative models often present issues regarding fairness with respect to certain sensitive attributes, such as gender or skin tone. This study aims to reproduce the results presented in "ITI-GEN: Inclusive Text-to-Image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Daniel Gallo Fernández , Răzvan-Andrei Matisan , Alejandro Monroy Muñoz , Janusz Partyka

Compositionality is a critical capability in Text-to-Image (T2I) models, as it reflects their ability to understand and combine multiple concepts from text descriptions. Existing evaluations of compositional capability rely heavily on…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Xindi Wu , Dingli Yu , Yangsibo Huang , Olga Russakovsky , Sanjeev Arora

Despite impressive recent advances in text-to-image diffusion models, obtaining high-quality images often requires prompt engineering by humans who have developed expertise in using them. In this work, we present NeuroPrompts, an adaptive…

Artificial Intelligence · Computer Science 2024-04-09 Shachar Rosenman , Vasudev Lal , Phillip Howard

Text-to-image generation models are powerful but difficult to use. Users craft specific prompts to get better images, though the images can be repetitive. This paper proposes a Prompt Expansion framework that helps users generate…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Siddhartha Datta , Alexander Ku , Deepak Ramachandran , Peter Anderson

This paper analyzes the community safety guidelines of five text-to-image (T2I) generation platforms and audits five T2I models, focusing on prompts related to the representation of humans in areas that might lead to societal stigma. While…

Computers and Society · Computer Science 2024-09-27 Piera Riccio , Georgina Curto , Nuria Oliver