English
Related papers

Related papers: Invisible Backdoor Attacks on Diffusion Models

200 papers

Recent developments in text-to-image models, particularly Stable Diffusion, have marked significant achievements in various applications. With these advancements, there are growing safety concerns about the vulnerability of the model that…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Chenyu Zhang , Lanjun Wang , Anan Liu

As ML models become increasingly complex and integral to high-stakes domains such as finance and healthcare, they also become more susceptible to sophisticated adversarial attacks. We investigate the threat posed by undetectable backdoors,…

Machine Learning · Computer Science 2024-09-10 Alkis Kalavasis , Amin Karbasi , Argyris Oikonomou , Katerina Sotiraki , Grigoris Velegkas , Manolis Zampetakis

Diffusion models (DMs) have revolutionized data generation, particularly in text-to-image (T2I) synthesis. However, the widespread use of personalized generative models raises significant concerns regarding privacy violations and copyright…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Xinwei Liu , Xiaojun Jia , Yuan Xun , Hua Zhang , Xiaochun Cao

Diffusion models have gained prominence in the image domain for their capabilities in data generation and transformation, achieving state-of-the-art performance in various tasks in both image and audio domains. In the rapidly evolving field…

Sound · Computer Science 2023-11-02 Xirong Cao , Xiang Li , Divyesh Jadav , Yanzhao Wu , Zhehui Chen , Chen Zeng , Wenqi Wei

Despite the remarkable progress of diffusion models in image generation, recent studies reveal their vulnerability to backdoor attacks via covert visual or textual triggers. Although evolving defense mechanisms can detect most existing…

Cryptography and Security · Computer Science 2026-05-29 Jia Wu , Yu Pan , Junjun Yang , Yi Du

While diffusion models have revolutionized visual content generation, their rapid adoption has underscored the critical need to investigate vulnerabilities, e.g., to backdoor attacks. In multimodal diffusion models, it is natural to expect…

Machine Learning · Computer Science 2026-03-09 Qitong Wang , Haoran Dai , Haotian Zhang , Christopher Rasmussen , Binghui Wang

Backdoor learning is a critical research topic for understanding the vulnerabilities of deep neural networks. While the diffusion model (DM) has been broadly deployed in public over the past few years, the understanding of its backdoor…

Cryptography and Security · Computer Science 2025-07-22 Weilin Lin , Nanjun Zhou , Yanyun Wang , Jianze Li , Hui Xiong , Li Liu

Person Re-Identification (ReID) systems pose a significant security risk from backdoor attacks, allowing adversaries to evade tracking or impersonate others. Beyond recognizing this issue, we investigate how backdoor attacks can be deployed…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Wenli Sun , Xinyang Jiang , Dongsheng Li , Cairong Zhao

With the broad application of deep neural networks (DNNs), backdoor attacks have gradually attracted attention. Backdoor attacks are insidious, and poisoned models perform well on benign samples and are only triggered when given specific…

Machine Learning · Computer Science 2022-07-12 Chang Yue , Peizhuo Lv , Ruigang Liang , Kai Chen

Diffusion models are state-of-the-art deep learning generative models that are trained on the principle of learning forward and backward diffusion processes via the progressive addition of noise and denoising. In this paper, we aim to fool…

Machine Learning · Computer Science 2025-04-22 Orson Mengara

While text-to-image diffusion models demonstrate impressive generation capabilities, they also exhibit vulnerability to backdoor attacks, which involve the manipulation of model outputs through malicious triggers. In this paper, for the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Zhongqi Wang , Jie Zhang , Shiguang Shan , Xilin Chen

While text-to-image synthesis currently enjoys great popularity among researchers and the general public, the security of these models has been neglected so far. Many text-guided image generation models rely on pre-trained text encoders…

Machine Learning · Computer Science 2023-08-10 Lukas Struppek , Dominik Hintersdorf , Kristian Kersting

Backdoor attacks, representing an emerging threat to the integrity of deep neural networks, have garnered significant attention due to their ability to compromise deep learning systems clandestinely. While numerous backdoor attacks occur…

Cryptography and Security · Computer Science 2024-03-18 Sze Jue Yang , Chinh D. La , Quang H. Nguyen , Kok-Seng Wong , Anh Tuan Tran , Chee Seng Chan , Khoa D. Doan

It is commonplace to produce application-specific models by fine-tuning large pre-trained models using a small bespoke dataset. The widespread availability of foundation model checkpoints on the web poses considerable risks, including the…

Cryptography and Security · Computer Science 2024-04-02 Yuxin Wen , Leo Marchyok , Sanghyun Hong , Jonas Geiping , Tom Goldstein , Nicholas Carlini

In practical application, the widespread deployment of diffusion models often necessitates substantial investment in training. As diffusion models find increasingly diverse applications, concerns about potential misuse highlight the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Jijia Yang , Sen Peng , Xiaohua Jia

In a backdoor attack on a machine learning model, an adversary produces a model that performs well on normal inputs but outputs targeted misclassifications on inputs containing a small trigger pattern. Model compression is a widely-used…

Cryptography and Security · Computer Science 2021-05-03 Yulong Tian , Fnu Suya , Fengyuan Xu , David Evans

Backdoor attacks have emerged as one of the major security threats to deep learning models as they can easily control the model's test-time predictions by pre-injecting a backdoor trigger into the model at training time. While backdoor…

Machine Learning · Computer Science 2023-02-07 Yujing Jiang , Xingjun Ma , Sarah Monazam Erfani , James Bailey

Deep neural networks (DNNs) have been proven vulnerable to backdoor attacks, where hidden features (patterns) trained to a normal model, which is only activated by some specific input (called triggers), trick the model into producing…

Cryptography and Security · Computer Science 2020-09-01 Shaofeng Li , Minhui Xue , Benjamin Zi Hao Zhao , Haojin Zhu , Xinpeng Zhang

Diffusion models have gained significant attention for high-fidelity image generation. Our work investigates the potential of exploiting diffusion models for adversarial robustness in image classification and object detection. Adversarial…

Image and Video Processing · Electrical Eng. & Systems 2025-11-05 Mika Yagoda , Shady Abu-Hussein , Raja Giryes

Diffusion-based text-to-image models have shown immense potential for various image-related tasks. However, despite their prominence and popularity, customizing these models using unauthorized data also brings serious privacy and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Sen Peng , Jijia Yang , Mingyue Wang , Jianfei He , Xiaohua Jia