English
Related papers

Related papers: GuardT2I: Defending Text-to-Image Models from Adve…

200 papers

Text-to-image (T2I) models have emerged as a significant advancement in generative AI; however, there exist safety concerns regarding their potential to produce harmful image outputs even when users input seemingly safe prompts. This…

Computers and Society · Computer Science 2024-08-19 Susan Hao , Renee Shelby , Yuchi Liu , Hansa Srinivasan , Mukul Bhutani , Burcu Karagol Ayan , Ryan Poplin , Shivani Poddar , Sarah Laszlo

Impressive advances in text-to-image (T2I) generative models have yielded a plethora of high performing models which are able to generate aesthetically appealing, photorealistic images. Despite the progress, these models still struggle to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Oscar Mañas , Pietro Astolfi , Melissa Hall , Candace Ross , Jack Urbanek , Adina Williams , Aishwarya Agrawal , Adriana Romero-Soriano , Michal Drozdzal

The steady improvements of text-to-image (T2I) generative models lead to slow deprecation of automatic evaluation benchmarks that rely on static datasets, motivating researchers to seek alternative ways to evaluate the T2I progress. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Jiahui Chen , Candace Ross , Reyhane Askari-Hemmat , Koustuv Sinha , Melissa Hall , Michal Drozdzal , Adriana Romero-Soriano

Text-to-Image(T2I) models typically deploy safety filters to prevent the generation of sensitive images. Unfortunately, recent jailbreaking attack methods manually design instructions for the LLM to generate adversarial prompts, which…

Cryptography and Security · Computer Science 2025-11-24 Chenyu Zhang , Lanjun Wang , Yiwen Ma , Wenhui Li , An-An Liu

Using risky text prompts, such as pornography and violent prompts, to test the safety of text-to-image (T2I) models is a critical task. However, existing risky prompt datasets are limited in three key areas: 1) limited risky categories, 2)…

Cryptography and Security · Computer Science 2025-11-24 Chenyu Zhang , Tairen Zhang , Lanjun Wang , Ruidong Chen , Wenhui Li , Anan Liu

The rise of text-to-image (T2I) models has enabled the synthesis of photorealistic human portraits, raising serious concerns about identity misuse and the robustness of AIGC detectors. In this work, we propose an automated adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Run Hao , Peng Ying

Text-to-Image (T2I) models have advanced significantly, but their growing popularity raises security concerns due to their potential to generate harmful images. To address these issues, we propose UPAM, a novel framework to evaluate the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Duo Peng , Qiuhong Ke , Mark He Huang , Ping Hu , Jun Liu

Text-to-Image (T2I) models have shown great performance in generating images based on textual prompts. However, these models are vulnerable to unsafe input to generate unsafe content like sexual, harassment and illegal-activity images.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Zongyu Wu , Hongcheng Gao , Yueze Wang , Xiang Zhang , Suhang Wang

Recently, various types of Text-to-Image (T2I) models have emerged (such as DALL-E and Stable Diffusion), and showing their advantages in different aspects. Therefore, some third-party service platforms collect different model interfaces…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Ji Guo , Wenbo Jiang , Rui Zhang , Guoming Lu , Hongwei Li

Text-to-image (T2I) models can generate not-safe-for-work (NSFW) content, motivating multi-stage safety pipelines with both text and image filters. Newer LLM-based filters detect latent intent beyond keywords, making token-level…

Machine Learning · Computer Science 2026-05-26 Zixuan Chen , Hao Lin , Ke Xu , Xinghao Jiang , Tanfeng Sun

Text-to-image (T2I) models have been widely applied in generating high-fidelity images across various domains. However, these models may also be abused to produce Not-Safe-for-Work (NSFW) content via jailbreak attacks. Existing jailbreak…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Xingkai Peng , Jun Jiang , Meng Tong , Shuai Li , Weiming Zhang , Nenghai Yu , Kejiang Chen

Recent advances in text-to-image (T2I) generation have achieved impressive results, yet existing models often struggle with simple or underspecified prompts, leading to suboptimal image-text alignment, aesthetics, and quality. We propose a…

Computation and Language · Computer Science 2025-10-16 Ruibo Chen , Jiacheng Pan , Heng Huang , Zhenheng Yang

Diffusion-based text-to-image (T2I) models enable high-quality image generation but also pose significant risks of misuse, particularly in producing not-safe-for-work (NSFW) content. While prior detection methods have focused on filtering…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Fan Yang , Yihao Huang , Jiayi Zhu , Ling Shi , Geguang Pu , Jin Song Dong , Kailong Wang

Text-to-Image (T2I) diffusion models are widely recognized for their ability to generate high-quality and diverse images based on text prompts. However, despite recent advances, these models are still prone to generating unsafe images…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Jiangweizhi Peng , Zhiwei Tang , Gaowen Liu , Charles Fleming , Mingyi Hong

This paper analyzes the community safety guidelines of five text-to-image (T2I) generation platforms and audits five T2I models, focusing on prompts related to the representation of humans in areas that might lead to societal stigma. While…

Computers and Society · Computer Science 2024-09-27 Piera Riccio , Georgina Curto , Nuria Oliver

Text-to-Image (T2I) diffusion models have demonstrated strong generation ability, but their potential to generate unsafe content raises significant safety concerns. Existing inference-time defense methods typically perform category-agnostic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Binhong Tan , Zhaoxin Wang , Handing Wang

The generative AI revolution in recent years has been spurred by an expansion in compute power and data quantity, which together enable extensive pre-training of powerful text-to-image (T2I) models. With their greater capabilities to…

Text-to-image diffusion models (T2I DMs) have achieved remarkable success in generating high-quality and diverse images from text prompts, yet recent studies have revealed their vulnerability to backdoor attacks. Existing attack methods…

Cryptography and Security · Computer Science 2025-08-05 Haoran Dai , Jiawen Wang , Ruo Yang , Manali Sharma , Zhonghao Liao , Yuan Hong , Binghui Wang

Text-to-image (T2I) models have advanced creative content generation, yet their reliance on large uncurated datasets often reproduces societal biases. We present FairT2I, a training-free and interactive framework grounded in a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Jinya Sakurai , Yuki Koyama , Issei Sato

With the rise of text-to-image (T2I) generative AI models reaching wide audiences, it is critical to evaluate model robustness against non-obvious attacks to mitigate the generation of offensive images. By focusing on ``implicitly…