English
Related papers

Related papers: Semantic-level Backdoor Attack against Text-to-Ima…

200 papers

Self-supervised learning (SSL) models are vulnerable to backdoor attacks. Existing backdoor attacks that are effective in SSL often involve noticeable triggers, like colored patches or visible noise, which are vulnerable to human…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Hanrong Zhang , Zhenting Wang , Boheng Li , Fulin Lin , Tingxu Han , Mingyu Jin , Chenlu Zhan , Mengnan Du , Hongwei Wang , Shiqing Ma

While image-to-text models have demonstrated significant advancements in various vision-language tasks, they remain susceptible to adversarial attacks. Existing white-box attacks on image-to-text models require access to the architecture,…

Artificial Intelligence · Computer Science 2024-08-20 Qingyuan Zeng , Zhenzhong Wang , Yiu-ming Cheung , Min Jiang

Large vision-language models (LVLMs) have achieved impressive performance across a wide range of vision-language tasks, while they remain vulnerable to backdoor attacks. Existing backdoor attacks on LVLMs aim to force the victim model to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Zhifang Zhang , Qiqi Tao , Jiaqi Lv , Na Zhao , Lei Feng , Joey Tianyi Zhou

Large-scale unlabeled data has spurred recent progress in self-supervised learning methods that learn rich visual representations. State-of-the-art self-supervised methods for learning representations from images (e.g., MoCo, BYOL, MSF) use…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Aniruddha Saha , Ajinkya Tejankar , Soroush Abbasi Koohpayegani , Hamed Pirsiavash

Backdoor attacks pose a significant threat to neural networks, enabling adversaries to manipulate model outputs on specific inputs, often with devastating consequences, especially in critical applications. While backdoor attacks have been…

Machine Learning · Computer Science 2025-07-30 Zhen Guo , Abhinav Kumar , Reza Tourani

The rapid progress of graph generation has raised new security concerns, particularly regarding backdoor vulnerabilities. Though prior work has explored backdoor attacks against diffusion models for image or unconditional graph generation,…

Machine Learning · Computer Science 2026-04-24 Liang Ye , Shengqin Chen , Jiazhu Dai

Deep neural networks (DNNs) are vulnerable to backdoor attacks, where adversaries can maliciously trigger model misclassifications by implanting a hidden backdoor during model training. This paper proposes a simple yet effective input-level…

Machine Learning · Computer Science 2024-06-04 Linshan Hou , Ruili Feng , Zhongyun Hua , Wei Luo , Leo Yu Zhang , Yiming Li

Deep learning (DL) based semantic communication methods have been explored for the efficient transmission of images, text, and speech in recent years. In contrast to traditional wireless communication methods that focus on the transmission…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-08 Tianxiao Han , Qianqian Yang , Zhiguo Shi , Shibo He , Zhaoyang Zhang

Text-to-image synthesis has achieved high-quality results with recent advances in diffusion models. However, text input alone has high spatial ambiguity and limited user controllability. Most existing methods allow spatial control through…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Yuki Endo

Deep neural networks (DNNs) are vulnerable to a class of attacks called "backdoor attacks", which create an association between a backdoor trigger and a target label the attacker is interested in exploiting. A backdoored DNN performs well…

Computer Vision and Pattern Recognition · Computer Science 2023-01-23 Hasan Abed Al Kader Hammoud , Shuming Liu , Mohammed Alkhrashi , Fahad AlBalawi , Bernard Ghanem

Text-to-image diffusion models suffer from the risk of generating outdated, copyrighted, incorrect, and biased content. While previous methods have mitigated the issues on a small scale, it is essential to handle them simultaneously in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Tianwei Xiong , Yue Wu , Enze Xie , Yue Wu , Zhenguo Li , Xihui Liu

Backdoor attack intends to inject hidden backdoor into the deep neural networks (DNNs), such that the prediction of the infected model will be maliciously changed if the hidden backdoor is activated by the attacker-defined trigger, while it…

Cryptography and Security · Computer Science 2021-02-02 Yiming Li , Tongqing Zhai , Baoyuan Wu , Yong Jiang , Zhifeng Li , Shutao Xia

Backdoor attacks threaten Deep Neural Networks (DNNs). Towards stealthiness, researchers propose clean-label backdoor attacks, which require the adversaries not to alter the labels of the poisoned training datasets. Clean-label settings…

Cryptography and Security · Computer Science 2022-06-13 Nan Luo , Yuanzhang Li , Yajie Wang , Shangbo Wu , Yu-an Tan , Quanxin Zhang

With the development of diffusion-based customization methods like DreamBooth, individuals now have access to train the models that can generate their personalized images. Despite the convenience, malicious users have misused these…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Yisu Liu , Jinyang An , Wanqian Zhang , Dayan Wu , Jingzi Gu , Zheng Lin , Weiping Wang

Modern LLMs employ safety mechanisms that extend beyond surface-level input filtering to latent semantic representations and generation-time reasoning, enabling them to recover obfuscated malicious intent during inference and refuse…

Computation and Language · Computer Science 2026-03-18 Xiaobing Sun , Perry Lam , Shaohua Li , Zizhou Wang , Rick Siow Mong Goh , Yong Liu , Liangli Zhen

Recently, deep learning-based Image-to-Image (I2I) networks have become the predominant choice for I2I tasks such as image super-resolution and denoising. Despite their remarkable performance, the backdoor vulnerability of I2I networks has…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Wenbo Jiang , Hongwei Li , Jiaming He , Rui Zhang , Guowen Xu , Tianwei Zhang , Rongxing Lu

Diffusion models (DMs) are regarded as one of the most advanced generative models today, yet recent studies suggest that they are vulnerable to backdoor attacks, which establish hidden associations between particular input patterns and…

Cryptography and Security · Computer Science 2024-08-23 Jiang Hao , Xiao Jin , Hu Xiaoguang , Chen Tianyou , Zhao Jiajia

Accurate interpretation and visualization of human instructions are crucial for text-to-image (T2I) synthesis. However, current models struggle to capture semantic variations from word order changes, and existing evaluations, relying on…

Computation and Language · Computer Science 2025-04-18 Xiangru Zhu , Penglei Sun , Yaoxian Song , Yanghua Xiao , Zhixu Li , Chengyu Wang , Jun Huang , Bei Yang , Xiaoxiao Xu

Deep neural networks are vulnerable to adversarial attacks, such as backdoor attacks in which a malicious adversary compromises a model during training such that specific behaviour can be triggered at test time by attaching a specific word…

Cryptography and Security · Computer Science 2022-10-21 You Guo , Jun Wang , Trevor Cohn

Recent advances in image-level self-supervised learning (SSL) have made significant progress, yet learning dense representations for patches remains challenging. Mainstream methods encounter an over-dispersion phenomenon that patches from…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Peisong Wen , Qianqian Xu , Siran Dai , Runmin Cong , Qingming Huang