English
Related papers

Related papers: SafeGuider: Robust and Practical Content Safety Co…

200 papers

Recently, the text-to-image diffusion model has gained considerable attention from the community due to its exceptional image generation capability. A representative model, Stable Diffusion, amassed more than 10 million users within just…

Cryptography and Security · Computer Science 2024-09-16 Chenyu Zhang , Mingwang Hu , Wenhui Li , Lanjun Wang

Text-to-image diffusion models, such as Stable Diffusion, have demonstrated remarkable capabilities in generating high-quality and diverse images from natural language prompts. However, recent studies reveal that these models often…

Machine Learning · Computer Science 2025-10-27 Zihao Fu , Ryan Brown , Shun Shao , Kai Rawal , Eoin Delaney , Chris Russell

Text-to-image (T2I) research has grown explosively in the past year, owing to the large-scale pre-trained diffusion models and many emerging personalization and editing approaches. Yet, one pain point persists: the text prompt engineering,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Xingqian Xu , Jiayi Guo , Zhangyang Wang , Gao Huang , Irfan Essa , Humphrey Shi

Text-to-Image models may generate harmful content, such as pornographic images, particularly when unsafe prompts are submitted. To address this issue, safety filters are often added on top of text-to-image models, or the models themselves…

Cryptography and Security · Computer Science 2026-01-09 Zhengyuan Jiang , Yuepeng Hu , Yuchen Yang , Yinzhi Cao , Neil Zhenqiang Gong

Text-to-image diffusion models have shown impressive capabilities in generating realistic visuals from natural-language prompts, yet they often struggle with accurately binding attributes to corresponding objects, especially in prompts…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Do Huu Dat , Nam Hyeonu , Po-Yuan Mao , Tae-Hyun Oh

Understanding the capabilities of text-to-image (T2I) models in harmful content generation is essential to safety and compliance. However, human red-teaming is costly and inconsistent, driving the need for automatic tools that simulate…

Machine Learning · Computer Science 2026-05-13 Zhi-Yi Chin , Pin-Yu Chen , Wei-Chen Chiu , Mario Fritz

Despite their remarkable image generation capabilities, text-to-image diffusion models inadvertently learn inappropriate concepts from vast and unfiltered training data, which leads to various ethical and business risks. Specifically,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Die Chen , Zhiwen Li , Mingyuan Fan , Cen Chen , Wenmeng Zhou , Yanhao Wang , Yaliang Li

Text-to-image generation models~(e.g., Stable Diffusion) have achieved significant advancements, enabling the creation of high-quality and realistic images based on textual descriptions. Prompt inversion, the task of identifying the textual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Mingzhe Li , Kejing Xia , Gehao Zhang , Zhenting Wang , Guanhong Tao , Siqi Pan , Juan Zhai , Shiqing Ma

Recent advances in diffusion models have notably enhanced text-to-image (T2I) generation quality, but they also raise the risk of generating unsafe content. Traditional safety methods like text blacklisting or harmful content classification…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Zongsheng Cao , Yangfan He , Anran Liu , Jun Xie , Feng Chen , Zepeng Wang

Diffusion Transformers have become a powerful backbone for text-to-image generation, but their layered and cross-modal generation process makes safety control fundamentally different from prompt-level filtering or output-level detection.…

Artificial Intelligence · Computer Science 2026-05-29 Zihao Xue , Yan Wang , Zhen Bi , Long Ma , Zhonglong Zheng , Zeyu Yang , Bingyu Zhu , Longtao Huang , Jie Xiao , Jungang Lou

Despite the record-breaking performance in Text-to-Image (T2I) generation by Stable Diffusion, less research attention is paid to its adversarial robustness. In this work, we study the problem of adversarial attack generation for Stable…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Haomin Zhuang , Yihua Zhang , Sijia Liu

The success of recent text-to-image diffusion models is largely due to their capacity to be guided by a complex text prompt, which enables users to precisely describe the desired content. However, these models struggle to effectively…

Computer Vision and Pattern Recognition · Computer Science 2024-02-09 Senmao Li , Joost van de Weijer , Taihang Hu , Fahad Shahbaz Khan , Qibin Hou , Yaxing Wang , Jian Yang

With the open-sourcing of text-to-image models (T2I) such as stable diffusion (SD) and stable diffusion XL (SD-XL), there is an influx of models fine-tuned in specific domains based on the open-source SD model, such as in anime, character…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Ruyi Gan , Xiaojun Wu , Junyu Lu , Yuanhe Tian , Dixiang Zhang , Ziwei Wu , Renliang Sun , Chang Liu , Jiaxing Zhang , Pingjian Zhang , Yan Song

Recent advances in text-to-image diffusion models enable photorealistic image generation, but they also risk producing malicious content, such as NSFW images. To mitigate risk, concept erasure methods are studied to facilitate the model to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Ruidong Chen , Honglin Guo , Lanjun Wang , Chenyu Zhang , Weizhi Nie , An-An Liu

Concept erasure in Text-To-Image (T2I) diffusion models is vital for safe content generation, but existing inference-time methods face significant limitations. Feature-correction approaches often cause uncontrolled over-correction, while…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Qinghui Gong

Text-to-Image (T2I) diffusion models have demonstrated strong generation ability, but their potential to generate unsafe content raises significant safety concerns. Existing inference-time defense methods typically perform category-agnostic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Binhong Tan , Zhaoxin Wang , Handing Wang

State-of-the-art Diffusion Models (DMs) produce highly realistic images. While prior work has successfully mitigated Not Safe For Work (NSFW) content in the visual domain, we identify a novel threat: the generation of NSFW text embedded…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Aditya Kumar , Tom Blanchard , Adam Dziedzic , Franziska Boenisch

Text-to-image diffusion models have recently attracted the interest of many researchers, and inverting the diffusion process can play an important role in better understanding the generative process and how to engineer prompts in order to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Florinel-Alin Croitoru , Vlad Hondru , Radu Tudor Ionescu , Mubarak Shah

Text-to-image models are known to propagate social biases. For example, when prompted to generate images of people in certain professions, these models tend to systematically generate specific genders or ethnicities. In this paper, we show…

Computation and Language · Computer Science 2024-10-25 Guorun Wang , Lucia Specia

The rapid development of text-to-image generation has brought rising ethical considerations, especially regarding gender bias. Given a text prompt as input, text-to-image models generate images according to the prompt. Pioneering models…

Computers and Society · Computer Science 2024-08-22 Yankun Wu , Yuta Nakashima , Noa Garcia