English
Related papers

Related papers: Towards Making a Trojan-horse Attack on Text-to-Im…

200 papers

Existing textual adversarial attacks usually utilize the gradient or prediction confidence to generate adversarial examples, making it hard to be deployed in real-world applications. To this end, we consider a rarely investigated but more…

Computation and Language · Computer Science 2022-10-25 Zhen Yu , Xiaosen Wang , Wanxiang Che , Kun He

Deep neural networks for image classification remain vulnerable to adversarial examples -- small, imperceptible perturbations that induce misclassifications. In black-box settings, where only the final prediction is accessible, crafting…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Arjhun Swaminathan , Mete Akgün

Despite their success and popularity, deep neural networks (DNNs) are vulnerable when facing backdoor attacks. This impedes their wider adoption, especially in mission critical applications. This paper tackles the problem of Trojan…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Xiaoling Hu , Xiao Lin , Michael Cogswell , Yi Yao , Susmit Jha , Chao Chen

Recently, the Image Prompt Adapter (IP-Adapter) has been increasingly integrated into text-to-image diffusion models (T2I-DMs) to improve controllability. However, in this paper, we reveal that T2I-DMs equipped with the IP-Adapter…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Junxi Chen , Junhao Dong , Xiaohua Xie

Text-to-image (T2I) models commonly incorporate defense mechanisms to prevent the generation of sensitive images. Unfortunately, recent jailbreak attacks have shown that adversarial prompts can effectively bypass these mechanisms and induce…

Cryptography and Security · Computer Science 2026-03-25 Chenyu Zhang , Lanjun Wang , Yiwen Ma , Wenhui Li , Yi Tu , An-An Liu

Text-to-image diffusion models are increasingly developed through open-source reuse and repeated downstream fine-tuning, where reused checkpoints are difficult to verify and thus more susceptible to hidden backdoor behaviors. In such…

Cryptography and Security · Computer Science 2026-05-20 Kai Wang , Jiale Zhang , Chengcheng Zhu , Chuang Ma , Songze Li

Backdoor attacks are a kind of emergent security threat in deep learning. After being injected with a backdoor, a deep neural model will behave normally on standard inputs but give adversary-specified predictions once the input contains…

Cryptography and Security · Computer Science 2022-10-20 Yangyi Chen , Fanchao Qi , Hongcheng Gao , Zhiyuan Liu , Maosong Sun

Adversarial machine learning is an emerging area showing the vulnerability of deep learning models. Exploring attack methods to challenge state of the art artificial intelligence (A.I.) models is an area of critical concern. The reliability…

Computer Vision and Pattern Recognition · Computer Science 2022-08-31 Samet Bayram , Kenneth Barner

While text-to-image diffusion models demonstrate impressive generation capabilities, they also exhibit vulnerability to backdoor attacks, which involve the manipulation of model outputs through malicious triggers. In this paper, for the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Zhongqi Wang , Jie Zhang , Shiguang Shan , Xilin Chen

The proliferation of text-to-image diffusion models (T2I DMs) has led to an increased presence of AI-generated images in daily life. However, biased T2I models can generate content with specific tendencies, potentially influencing people's…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Huayang Huang , Xiangye Jin , Jiaxu Miao , Yu Wu

Recently, the vulnerability of deep image classification models to adversarial attacks has been investigated. However, such an issue has not been thoroughly studied for image-to-image tasks that take an input image and generate an output…

Computer Vision and Pattern Recognition · Computer Science 2022-06-29 Jun-Ho Choi , Huan Zhang , Jun-Hyuk Kim , Cho-Jui Hsieh , Jong-Seok Lee

Text-to-image (T2I) models can be maliciously used to generate harmful content such as sexually explicit, unfaithful, and misleading or Not-Safe-for-Work (NSFW) images. Previous attacks largely depend on the availability of the diffusion…

Cryptography and Security · Computer Science 2025-05-27 Jiachen Ma , Yijiang Li , Zhiqing Xiao , Anda Cao , Jie Zhang , Chao Ye , Junbo Zhao

Deep Neural Networks are vulnerable to Trojan (or backdoor) attacks. Reverse-engineering methods can reconstruct the trigger and thus identify affected models. Existing reverse-engineering methods only consider input space constraints,…

Cryptography and Security · Computer Science 2022-10-28 Zhenting Wang , Kai Mei , Hailun Ding , Juan Zhai , Shiqing Ma

Modern text-to-image (T2I) models can now render legible, paragraph-length text, enabling a fundamentally new class of misuse. We identify and formalize the inscriptive jailbreak, where an adversary coerces a T2I system into generating…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Zonghao Ying , Haowen Dai , Lianyu Hu , Zonglei Jing , Quanchen Zou , Yaodong Yang , Aishan Liu , Xianglong Liu

Backdoor attacks have severely threatened deep neural network (DNN) models in the past several years. These attacks can occur in almost every stage of the deep learning pipeline. Although the attacked model behaves normally on benign…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Yangming Chen

In the evolving landscape of text-to-image (T2I) diffusion models, the remarkable capability to generate high-quality images from textual descriptions faces challenges with the potential misuse of reproducing sensitive content. To address…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Changhoon Kim , Kyle Min , Yezhou Yang

The deep hashing based retrieval method is widely adopted in large-scale image and video retrieval. However, there is little investigation on its security. In this paper, we propose a novel method, dubbed deep hashing targeted attack…

Cryptography and Security · Computer Science 2020-07-24 Jiawang Bai , Bin Chen , Yiming Li , Dongxian Wu , Weiwei Guo , Shu-tao Xia , En-hui Yang

Most existing works of adversarial samples focus on attacking image recognition models, while little attention is paid to the image retrieval task. In this paper, we identify two inherent challenges in applying prevailing image recognition…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Zhedong Zheng , Liang Zheng , Yi Yang , Fei Wu

Backdoor attacks have been shown to be a serious threat against deep learning systems such as biometric authentication and autonomous driving. An effective backdoor attack could enforce the model misbehave under certain predefined…

Cryptography and Security · Computer Science 2021-12-01 Tong Wang , Yuan Yao , Feng Xu , Shengwei An , Hanghang Tong , Ting Wang

End-to-end encryption (E2EE) by messaging platforms enable people to securely and privately communicate with one another. Its widespread adoption however raised concerns that illegal content might now be shared undetected. Following the…

Cryptography and Security · Computer Science 2022-08-03 Shubham Jain , Ana-Maria Cretu , Yves-Alexandre de Montjoye