English
Related papers

Related papers: T2IShield: Defending Against Backdoors on Text-to-…

200 papers

In the exciting generative AI era, the diffusion model has emerged as a very powerful and widely adopted content generation and editing tool for various data modalities, making the study of their potential security risks very necessary and…

Cryptography and Security · Computer Science 2024-02-06 Yang Sui , Huy Phan , Jinqi Xiao , Tianfang Zhang , Zijie Tang , Cong Shi , Yan Wang , Yingying Chen , Bo Yuan

Recently, the text-to-image diffusion model has gained considerable attention from the community due to its exceptional image generation capability. A representative model, Stable Diffusion, amassed more than 10 million users within just…

Cryptography and Security · Computer Science 2024-09-16 Chenyu Zhang , Mingwang Hu , Wenhui Li , Lanjun Wang

Diffusion models (DMs) are regarded as one of the most advanced generative models today, yet recent studies suggest that they are vulnerable to backdoor attacks, which establish hidden associations between particular input patterns and…

Cryptography and Security · Computer Science 2024-08-23 Jiang Hao , Xiao Jin , Hu Xiaoguang , Chen Tianyou , Zhao Jiajia

In recent years, Text-to-Image (T2I) models have seen remarkable advancements, gaining widespread adoption. However, this progress has inadvertently opened avenues for potential misuse, particularly in generating inappropriate or…

Cryptography and Security · Computer Science 2024-04-02 Yijun Yang , Ruiyuan Gao , Xiaosen Wang , Tsung-Yi Ho , Nan Xu , Qiang Xu

In-context learning (ICL) has demonstrated remarkable success in large language models (LLMs) due to its adaptability and parameter-free nature. However, it also introduces a critical vulnerability to backdoor attacks, where adversaries can…

Machine Learning · Computer Science 2025-07-03 Zhiyao Ren , Siyuan Liang , Aishan Liu , Dacheng Tao

The commercialization of text-to-image diffusion models (DMs) brings forth potential copyright concerns. Despite numerous attempts to protect DMs from copyright issues, the vulnerabilities of these solutions are underexplored. In this…

Cryptography and Security · Computer Science 2024-05-28 Haonan Wang , Qianli Shen , Yao Tong , Yang Zhang , Kenji Kawaguchi

The rapid development of generative artificial intelligence has made text to video models essential for building future multimodal world simulators. However, these models remain vulnerable to jailbreak attacks, where specially crafted…

Cryptography and Security · Computer Science 2025-04-29 Siyuan Liang , Jiayang Liu , Jiecheng Zhai , Tianmeng Fang , Rongcheng Tu , Aishan Liu , Xiaochun Cao , Dacheng Tao

Text-to-Image(T2I) models have achieved remarkable success in image generation and editing, yet these models still have many potential issues, particularly in generating inappropriate or Not-Safe-For-Work(NSFW) content. Strengthening…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Sensen Gao , Xiaojun Jia , Yihao Huang , Ranjie Duan , Jindong Gu , Yang Bai , Yang Liu , Qing Guo

Text-to-image diffusion models have revolutionized generative AI, but their vulnerability to backdoor attacks poses significant security risks. Adversaries can inject imperceptible textual triggers into training data, causing models to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Ashwath Vaithinathan Aravindan , Abha Jha , Matthew Salaway , Atharva Sandeep Bhide , Duygu Nur Yaldiz

Recent studies show that diffusion models (DMs) are vulnerable to backdoor attacks. Existing backdoor attacks impose unconcealed triggers (e.g., a gray box and eyeglasses) that contain evident patterns, rendering remarkable attack effects…

Cryptography and Security · Computer Science 2025-03-03 Yuning Han , Bingyin Zhao , Rui Chu , Feng Luo , Biplab Sikdar , Yingjie Lao

The rapid advancement of generative AI highlights the importance of text-to-image (T2I) security, particularly with the threat of backdoor poisoning. Timely disclosure and mitigation of security vulnerabilities in T2I models are crucial for…

Cryptography and Security · Computer Science 2025-04-22 Chongye Guo , Jinhu Fu , Junfeng Fang , Kun Wang , Guorui Feng

Consistency models are a new class of models that generate images by directly mapping noise to data, allowing for one-step generation and significantly accelerating the sampling process. However, their robustness against adversarial attacks…

Cryptography and Security · Computer Science 2025-02-18 Chengen Wang , Murat Kantarcioglu

Diffusion models (DMs) are advanced deep learning models that achieved state-of-the-art capability on a wide range of generative tasks. However, recent studies have shown their vulnerability regarding backdoor attacks, in which backdoored…

Artificial Intelligence · Computer Science 2024-09-24 Vu Tuan Truong , Long Bao Le

Backdoor attacks are rapidly emerging threats to deep neural networks (DNNs). In the backdoor attack scenario, attackers usually implant the backdoor into the target model by manipulating the training dataset or training process. Then, the…

Cryptography and Security · Computer Science 2022-05-09 Nan Zhong , Zhenxing Qian , Xinpeng Zhang

Recent text-to-image (T2I) diffusion models show outstanding performance in generating high-quality images conditioned on textual prompts. However, they fail to semantically align the generated images with the prompts due to their limited…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Ruichen Wang , Zekang Chen , Chen Chen , Jian Ma , Haonan Lu , Xiaodong Lin

Thanks to their remarkable denoising capabilities, diffusion models are increasingly being employed as defensive tools to reinforce the security of other models, notably in purifying adversarial examples and certifying adversarial…

Cryptography and Security · Computer Science 2024-06-17 Changjiang Li , Ren Pang , Bochuan Cao , Jinghui Chen , Fenglong Ma , Shouling Ji , Ting Wang

Using risky text prompts, such as pornography and violent prompts, to test the safety of text-to-image (T2I) models is a critical task. However, existing risky prompt datasets are limited in three key areas: 1) limited risky categories, 2)…

Cryptography and Security · Computer Science 2025-11-24 Chenyu Zhang , Tairen Zhang , Lanjun Wang , Ruidong Chen , Wenhui Li , Anan Liu

The proliferation of text-to-image diffusion models (T2I DMs) has led to an increased presence of AI-generated images in daily life. However, biased T2I models can generate content with specific tendencies, potentially influencing people's…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Huayang Huang , Xiangye Jin , Jiaxu Miao , Yu Wu

Recent studies show that text to image (T2I) diffusion models are vulnerable to backdoor attacks, where a trigger in the input prompt can steer generation toward harmful or unintended content. Beyond the trigger token itself, backdoor…

Computation and Language · Computer Science 2026-03-19 Oscar Chew , Po-Yi Lu , Jayden Lin , Kuan-Hao Huang , Hsuan-Tien Lin

At present, backdoor attacks attract attention as they do great harm to deep learning models. The adversary poisons the training data making the model being injected with a backdoor after being trained unconsciously by victims using the…

Cryptography and Security · Computer Science 2023-03-06 Shengfang Zhai , Qingni Shen , Xiaoyi Chen , Weilong Wang , Cong Li , Yuejian Fang , Zhonghai Wu