English
Related papers

Related papers: Prompting4Debugging: Red-Teaming Text-to-Image Dif…

200 papers

The quality of the prompts provided to text-to-image diffusion models determines how faithful the generated content is to the user's intent, often requiring `prompt engineering'. To harness visual concepts from target images without prompt…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Shweta Mahajan , Tanzila Rahman , Kwang Moo Yi , Leonid Sigal

Diffusion models have recently achieved remarkable advancements in terms of image quality and fidelity to textual prompts. Concurrently, the safety of such generative models has become an area of growing concern. This work introduces a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Tong Liu , Zhixin Lai , Jiawen Wang , Gengyuan Zhang , Shuo Chen , Philip Torr , Vera Demberg , Volker Tresp , Jindong Gu

Text-to-image (T2I) diffusion models have shown exceptional capabilities in generating images that closely correspond to textual prompts. However, the advancement of T2I diffusion models presents significant risks, as the models could be…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Jie Ren , Kangrui Chen , Yingqian Cui , Shenglai Zeng , Hui Liu , Yue Xing , Jiliang Tang , Lingjuan Lyu

The recent advances in diffusion models (DMs) have revolutionized the generation of realistic and complex images. However, these models also introduce potential safety hazards, such as producing harmful content and infringing data…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Yimeng Zhang , Jinghan Jia , Xin Chen , Aochuan Chen , Yihua Zhang , Jiancheng Liu , Ke Ding , Sijia Liu

Diffusion models have demonstrated remarkable capability in generating high-quality visual content from textual descriptions. However, since these models are trained on large-scale internet data, they inevitably learn undesirable concepts,…

Machine Learning · Computer Science 2025-02-18 Anh Bui , Khanh Doan , Trung Le , Paul Montague , Tamas Abraham , Dinh Phung

Text-to-image models are increasingly popular and impactful, yet concerns regarding their safety and fairness remain. This study investigates the ability of ten popular Stable Diffusion models to generate harmful images, including NSFW,…

Computers and Society · Computer Science 2025-08-29 Matthias Schneider , Thilo Hagendorff

The remarkable ability of diffusion models to generate high-fidelity images has led to their widespread adoption. However, concerns have also arisen regarding their potential to produce Not Safe for Work (NSFW) content and exhibit social…

Computation and Language · Computer Science 2025-05-22 Zhiwen Li , Die Chen , Mingyuan Fan , Cen Chen , Yaliang Li , Yanhao Wang , Wenmeng Zhou

Text-to-4D generation is rapidly developing and widely applied in various scenarios. However, existing methods often fail to incorporate adequate spatio-temporal modeling and prompt alignment within a unified framework, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Yunze Deng , Haijun Xiong , Bin Feng , Xinggang Wang , Wenyu Liu

Text-to-image (T2I) research has grown explosively in the past year, owing to the large-scale pre-trained diffusion models and many emerging personalization and editing approaches. Yet, one pain point persists: the text prompt engineering,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Xingqian Xu , Jiayi Guo , Zhangyang Wang , Gao Huang , Irfan Essa , Humphrey Shi

Recent works show that text-to-image generative models are surprisingly vulnerable to a variety of poisoning attacks. Empirical results find that these models can be corrupted by altering associations between individual text prompts and…

Cryptography and Security · Computer Science 2024-09-20 Wenxin Ding , Cathy Y. Li , Shawn Shan , Ben Y. Zhao , Haitao Zheng

Text-to-Image (T2I) Diffusion Models (DMs) have shown impressive abilities in generating high-quality images based on simple text descriptions. However, as is common with many Deep Learning (DL) models, DMs are subject to a lack of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yi Zhang , Yun Tang , Wenjie Ruan , Xiaowei Huang , Siddartha Khastgir , Paul Jennings , Xingyu Zhao

With the help of conditioning mechanisms, the state-of-the-art diffusion models have achieved tremendous success in guided image generation, particularly in text-to-image synthesis. To gain a better understanding of the training process and…

Cryptography and Security · Computer Science 2023-10-24 Shengfang Zhai , Yinpeng Dong , Qingni Shen , Shi Pu , Yuejian Fang , Hang Su

Deep neural networks (DNNs) offer significant promise for improving breast cancer diagnosis in medical imaging. However, these models are highly susceptible to adversarial attacks--small, imperceptible changes that can mislead…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Yasamin Medghalchi , Moein Heidari , Clayton Allard , Leonid Sigal , Ilker Hacihaliloglu

While diffusion-based T2I models have achieved remarkable image generation quality, they also enable easy creation of harmful content, raising social concerns and highlighting the need for safer generation. Existing inference-time guiding…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Sumin Yu , Taesup Moon

Text-to-image models, such as Stable Diffusion (SD), undergo iterative updates to improve image quality and address concerns such as safety. Improvements in image quality are straightforward to assess. However, how model updates resolve…

Cryptography and Security · Computer Science 2024-09-02 Yixin Wu , Yun Shen , Michael Backes , Yang Zhang

Current text-to-image (T2I) synthesis diffusion models raise misuse concerns, particularly in creating prohibited or not-safe-for-work (NSFW) images. To address this, various safety mechanisms and red teaming attack methods are proposed to…

Cryptography and Security · Computer Science 2025-02-07 Pucheng Dang , Xing Hu , Dong Li , Rui Zhang , Qi Guo , Kaidi Xu

Recent advances in diffusion models have significantly enhanced the quality of image synthesis, yet they have also introduced serious safety concerns, particularly the generation of Not Safe for Work (NSFW) content. Previous research has…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Yaopei Zeng , Yuanpu Cao , Bochuan Cao , Yurui Chang , Jinghui Chen , Lu Lin

Text-to-image (T2I) models can be maliciously used to generate harmful content such as sexually explicit, unfaithful, and misleading or Not-Safe-for-Work (NSFW) images. Previous attacks largely depend on the availability of the diffusion…

Cryptography and Security · Computer Science 2025-05-27 Jiachen Ma , Yijiang Li , Zhiqing Xiao , Anda Cao , Jie Zhang , Chao Ye , Junbo Zhao

Text-to-image (T2I) models, such as Stable Diffusion, have exhibited remarkable performance in generating high-quality images from text descriptions in recent years. However, text-to-image models may be tricked into generating…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Xinfeng Li , Yuchen Yang , Jiangyi Deng , Chen Yan , Yanjiao Chen , Xiaoyu Ji , Wenyuan Xu

Diffusion models have exhibited substantial success in text-to-image generation. However, they often encounter challenges when dealing with complex and dense prompts involving multiple objects, attribute binding, and long descriptions. In…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Mushui Liu , Yuhang Ma , Yang Zhen , Jun Dan , Yunlong Yu , Zeng Zhao , Zhipeng Hu , Bai Liu , Changjie Fan