English
Related papers

Related papers: BadCM: Invisible Backdoor Attack Against Cross-Mod…

200 papers

Adversarial attacks constitute a notable threat to machine learning systems, given their potential to induce erroneous predictions and classifications. However, within real-world contexts, the essential specifics of the deployed model are…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Jingwen Ye , Ruonan Yu , Songhua Liu , Xinchao Wang

Despite the remarkable progress of diffusion models in image generation, recent studies reveal their vulnerability to backdoor attacks via covert visual or textual triggers. Although evolving defense mechanisms can detect most existing…

Cryptography and Security · Computer Science 2026-05-29 Jia Wu , Yu Pan , Junjun Yang , Yi Du

We present BadGD, a unified theoretical framework that exposes the vulnerabilities of gradient descent algorithms through strategic backdoor attacks. Backdoor attacks involve embedding malicious triggers into a training dataset to disrupt…

Machine Learning · Computer Science 2024-05-28 Chi-Hua Wang , Guang Cheng

Precise future human motion prediction over sub-second horizons from past observations is crucial for various safety-critical applications. To date, only a few studies have examined the vulnerability of skeleton-based neural networks to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Chaohui Xu , Si Wang , Chip-Hong Chang

The success of deep learning has enabled advances in multimodal tasks that require non-trivial fusion of multiple input domains. Although multimodal models have shown potential in many problems, their increased complexity makes them more…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Matthew Walmer , Karan Sikka , Indranil Sur , Abhinav Shrivastava , Susmit Jha

The prompt-based learning paradigm has gained much research attention recently. It has achieved state-of-the-art performance on several NLP tasks, especially in the few-shot scenarios. While steering the downstream tasks, few works have…

Computation and Language · Computer Science 2022-11-29 Xiangrui Cai , Haidong Xu , Sihan Xu , Ying Zhang , Xiaojie Yuan

Multimodal contrastive learning models like CLIP have demonstrated remarkable vision-language alignment capabilities, yet their vulnerability to backdoor attacks poses critical security risks. Attackers can implant latent triggers that…

Cryptography and Security · Computer Science 2025-06-17 Mengyuan Sun , Yu Li , Yuchen Liu , Bo Du , Yunjie Ge

In recent years, there has been an explosive growth in multimodal learning. Image captioning, a classical multimodal task, has demonstrated promising applications and attracted extensive research attention. However, recent studies have…

Cryptography and Security · Computer Science 2024-06-11 Wenshu Fan , Hongwei Li , Wenbo Jiang , Meng Hao , Shui Yu , Xiao Zhang

Visual State Space Models (VSSM) have shown remarkable performance in various computer vision tasks. However, backdoor attacks pose significant security challenges, causing compromised models to predict target labels when specific triggers…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Cheng-Yi Lee , Yu-Hsuan Chiang , Zhong-You Wu , Chia-Mu Yu , Chun-Shien Lu

The advent of clinical language models integrated into electronic health records (EHR) for clinical decision support has marked a significant advancement, leveraging the depth of clinical notes for improved decision-making. Despite their…

Computation and Language · Computer Science 2024-07-09 Weimin Lyu , Zexin Bi , Fusheng Wang , Chao Chen

In recent years, the neural network backdoor hidden in the parameters of the federated learning model has been proved to have great security risks. Considering the characteristics of trigger generation, data poisoning and model training in…

Machine Learning · Computer Science 2024-04-23 Rong Wang , Guichen Zhou , Mingjun Gao , Yunpeng Xiao

In recent years, foundation models (FMs) have solidified their role as cornerstone advancements in the deep learning domain. By extracting intricate patterns from vast datasets, these models consistently achieve state-of-the-art results…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Ruinan Jin , Chun-Yin Huang , Chenyu You , Xiaoxiao Li

The advent of multimodal deep learning models, such as CLIP, has unlocked new frontiers in a wide range of applications, from image-text understanding to classification tasks. However, these models are not safe for adversarial attacks,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Md. Iqbal Hossain , Afia Sajeeda , Neeresh Kumar Perla , Ming Shao

Prompt-driven Video Segmentation Foundation Models (VSFMs), such as SAM2, are increasingly used in applications including autonomous driving and digital pathology, yet their security risks remain underexplored. We study backdoor attacks…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Zongmin Zhang , Zhen Sun , Yifan Liao , Wenhan Dong , Xinlei He , Xingshuo Han , Shengmin Xu , Xinyi Huang

Chat template is a common technique used in the training and inference stages of Large Language Models (LLMs). It can transform input and output data into role-based and templated expressions to enhance the performance of LLMs. However,…

Cryptography and Security · Computer Science 2026-02-06 Zihan Wang , Hongwei Li , Rui Zhang , Wenbo Jiang , Guowen Xu

In recent years, the security issues of artificial intelligence have become increasingly prominent due to the rapid development of deep learning research and applications. Backdoor attack is an attack targeting the vulnerability of deep…

Cryptography and Security · Computer Science 2023-12-14 Peixin Zhang , Jun Sun , Mingtian Tan , Xinyu Wang

The financial industry relies on deep learning models for making important decisions. This adoption brings new danger, as deep black-box models are known to be vulnerable to adversarial attacks. In computer vision, one can shape the output…

Machine Learning · Computer Science 2024-08-27 Alina Ermilova , Elizaveta Kovtun , Dmitry Berestnev , Alexey Zaytsev

Multimodal contrastive pretraining has been used to train multimodal representation models, such as CLIP, on large amounts of paired image-text data. However, previous studies have revealed that such models are vulnerable to backdoor…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Hritik Bansal , Nishad Singhi , Yu Yang , Fan Yin , Aditya Grover , Kai-Wei Chang

In recent years, neural backdoor attack has been considered to be a potential security threat to deep learning systems. Such systems, while achieving the state-of-the-art performance on clean data, perform abnormally on inputs with…

Cryptography and Security · Computer Science 2020-10-19 Anh Nguyen , Anh Tran

As collaborative learning allows joint training of a model using multiple sources of data, the security problem has been a central concern. Malicious users can upload poisoned data to prevent the model's convergence or inject hidden…

Cryptography and Security · Computer Science 2021-01-21 Ximing Qiao , Yuhua Bai , Siping Hu , Ang Li , Yiran Chen , Hai Li