中文
相关论文

相关论文: When One Modality Rules Them All: Backdoor Modalit…

200 篇论文

Federated learning is particularly susceptible to model poisoning and backdoor attacks because individual users have direct control over the training data and model updates. At the same time, the attack power of an individual user is…

机器学习 · 计算机科学 2022-10-18 Yuxin Wen , Jonas Geiping , Liam Fowl , Hossein Souri , Rama Chellappa , Micah Goldblum , Tom Goldstein

Multimodal large language models have become an important infrastructure for unified processing of visual and linguistic tasks. However, such models are highly susceptible to backdoor implantation during supervised fine-tuning and will…

计算机视觉与模式识别 · 计算机科学 2026-04-07 Tianmeng Fang , Yong Wang , Zetai Kong , Zengzhen Su , Jun Wang , Chengjin Yu , Wei Wang

In recent years, despite significant advancements in adversarial attack research, the security challenges in cross-modal scenarios, such as the transferability of adversarial attacks between infrared, thermal, and RGB images, have been…

计算机视觉与模式识别 · 计算机科学 2024-09-27 Yunpeng Gong , Qingyuan Zeng , Dejun Xu , Zhenzhong Wang , Min Jiang

Diffusion models (DM) have become state-of-the-art generative models because of their capability to generate high-quality images from noises without adversarial training. However, they are vulnerable to backdoor attacks as reported by…

In recent years, neural backdoor attack has been considered to be a potential security threat to deep learning systems. Such systems, while achieving the state-of-the-art performance on clean data, perform abnormally on inputs with…

密码学与安全 · 计算机科学 2020-10-19 Anh Nguyen , Anh Tran

Multimodal Large Language Models (MLLMs) have achieved remarkable success in tasks such as image captioning, visual question answering, and cross-modal reasoning by integrating visual and textual modalities. However, their multimodal nature…

计算机视觉与模式识别 · 计算机科学 2025-10-14 Fengling Zhu , Boshi Liu , Jingyu Hua , Sheng Zhong

Backdoor attack intends to embed hidden backdoor into deep neural networks (DNNs), so that the attacked models perform well on benign samples, whereas their predictions will be maliciously changed if the hidden backdoor is activated by…

密码学与安全 · 计算机科学 2022-02-17 Yiming Li , Yong Jiang , Zhifeng Li , Shu-Tao Xia

Recent studies have shown that cooperative multi-agent deep reinforcement learning (c-MADRL) is under the threat of backdoor attacks. Once a backdoor trigger is observed, it will perform malicious actions leading to failures or malicious…

人工智能 · 计算机科学 2025-07-21 Jing Fang , Saihao Yan , Xueyu Yin , Yinbo Yu , Chunwei Tian , Jiajia Liu

Diffusion Models have become a cornerstone of modern generative AI for their exceptional generation quality and controllability. However, their inherent \textit{multi-step iterations} and \textit{complex backbone networks} lead to…

Federated learning (FL) is widely used in Internet-of-Things (IoT) systems, but its distributed training process also exposes it to backdoor attacks. Existing studies mainly consider single-target or centralized multi-target settings, while…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Tao Liu , Dapeng Man , Jiguang Lv , Chen Xu , Weiye Xi , Huanran Wang , Yuhang Zhang , Tianming Zhao , Wu Yang

Text-to-image diffusion models are increasingly developed through open-source reuse and repeated downstream fine-tuning, where reused checkpoints are difficult to verify and thus more susceptible to hidden backdoor behaviors. In such…

密码学与安全 · 计算机科学 2026-05-20 Kai Wang , Jiale Zhang , Chengcheng Zhu , Chuang Ma , Songze Li

Deep anomaly detection on sequential data has garnered significant attention due to the wide application scenarios. However, deep learning-based models face a critical security threat - their vulnerability to backdoor attacks. In this…

机器学习 · 计算机科学 2024-02-19 He Cheng , Shuhan Yuan

Backdoor attacks pose a significant threat to neural networks, enabling adversaries to manipulate model outputs on specific inputs, often with devastating consequences, especially in critical applications. While backdoor attacks have been…

机器学习 · 计算机科学 2025-07-30 Zhen Guo , Abhinav Kumar , Reza Tourani

Prompt-based learning paradigm bridges the gap between pre-training and fine-tuning, and works effectively under the few-shot setting. However, we find that this learning paradigm inherits the vulnerability from the pre-training stage,…

计算与语言 · 计算机科学 2022-04-12 Lei Xu , Yangyi Chen , Ganqu Cui , Hongcheng Gao , Zhiyuan Liu

While recent multimodal large language models (MLLMs) have made impressive strides, they predominantly employ a conventional autoregressive architecture as their backbone, leaving significant room to explore effective and efficient…

计算机视觉与模式识别 · 计算机科学 2026-03-09 Lijiang Li , Zuwei Long , Yunhang Shen , Heting Gao , Haoyu Cao , Xing Sun , Caifeng Shan , Ran He , Chaoyou Fu

Diffusion models arise as a powerful generative tool recently. Despite the great progress, existing diffusion models mainly focus on uni-modal control, i.e., the diffusion process is driven by only one modality of condition. To further…

计算机视觉与模式识别 · 计算机科学 2023-04-21 Ziqi Huang , Kelvin C. K. Chan , Yuming Jiang , Ziwei Liu

Multimodal learning has recently gained significant popularity, demonstrating impressive performance across various zero-shot classification tasks and a range of perceptive and generative applications. Models such as Contrastive…

机器学习 · 计算机科学 2026-02-16 Can Yaras , Siyi Chen , Peng Wang , Qing Qu

Transfer learning has recently become the dominant paradigm of machine learning. Pre-trained models fine-tuned for downstream tasks achieve better performance with fewer labelled examples. Nonetheless, it remains unclear how to develop…

机器学习 · 计算机科学 2024-01-30 Jonas Pfeiffer , Sebastian Ruder , Ivan Vulić , Edoardo Maria Ponti

Backdoor learning is an emerging and vital topic for studying deep neural networks' vulnerability (DNNs). Many pioneering backdoor attack and defense methods are being proposed, successively or concurrently, in the status of a rapid arms…

机器学习 · 计算机科学 2022-10-20 Baoyuan Wu , Hongrui Chen , Mingda Zhang , Zihao Zhu , Shaokui Wei , Danni Yuan , Chao Shen

Recent advancements in deep learning-based compression techniques have surpassed traditional methods. However, deep neural networks remain vulnerable to backdoor attacks, where pre-defined triggers induce malicious behaviors. This paper…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Yi Yu , Yufei Wang , Wenhan Yang , Lanqing Guo , Shijian Lu , Ling-Yu Duan , Yap-Peng Tan , Alex C. Kot