English
Related papers

Related papers: InverTune: Removing Backdoors from Multimodal Cont…

200 papers

Large pre-trained Vision-Language Models (VLMs) such as CLIP have demonstrated excellent zero-shot generalizability across various downstream tasks. However, recent studies have shown that the inference performance of CLIP can be greatly…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Xin Wang , Kai Chen , Jiaming Zhang , Jingjing Chen , Xingjun Ma

Backdoor attacks are a significant threat to large language models (LLMs), often embedded via public checkpoints, yet existing defenses rely on impractical assumptions about trigger settings. To address this challenge, we propose…

Computation and Language · Computer Science 2026-05-14 Liang Lin , Miao Yu , Moayad Aloqaily , Zhenhong Zhou , Kun Wang , Linsey Pang , Prakhar Mehrotra , Qingsong Wen

Contrastive vision-language representation learning has achieved state-of-the-art performance for zero-shot classification, by learning from millions of image-caption pairs crawled from the internet. However, the massive data that powers…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Wenhan Yang , Jingdong Gao , Baharan Mirzasoleiman

Deep learning models are well known to be susceptible to backdoor attack, where the attacker only needs to provide a tampered dataset on which the triggers are injected. Models trained on the dataset will passively implant the backdoor, and…

Cryptography and Security · Computer Science 2024-06-21 Zonghao Ying , Bin Wu

Most existing methods to detect backdoored machine learning (ML) models take one of the two approaches: trigger inversion (aka. reverse engineer) and weight analysis (aka. model diagnosis). In particular, the gradient-based trigger…

Cryptography and Security · Computer Science 2024-07-23 Rui Zhu , Di Tang , Siyuan Tang , Guanhong Tao , Shiqing Ma , Xiaofeng Wang , Haixu Tang

Machine learning (ML) models that use deep neural networks are vulnerable to backdoor attacks. Such attacks involve the insertion of a (hidden) trigger by an adversary. As a consequence, any input that contains the trigger will cause the…

Cryptography and Security · Computer Science 2022-03-30 Arezoo Rajabi , Bhaskar Ramasubramanian , Radha Poovendran

Developers increasingly construct multimodal large language models (MLLMs) by assembling pretrained components,introducing supply-chain attack surfaces.Existing security research primarily focuses on poisoning backbones such as encoders or…

Cryptography and Security · Computer Science 2026-05-11 Runhe Wang , Li Bai , Haibo Hu , Songze Li

As machine learning (ML) systems are being increasingly employed in the real world to handle sensitive tasks and make decisions in various fields, the security and privacy of those models have also become increasingly critical. In…

Cryptography and Security · Computer Science 2023-02-21 Marwan Omar

Institutions with limited data and computing resources often outsource model training to third-party providers in a semi-honest setting, assuming adherence to prescribed training protocols with pre-defined learning paradigm (e.g.,…

Machine Learning · Computer Science 2025-04-02 Xuan Wang , Siyuan Liang , Dongping Liao , Han Fang , Aishan Liu , Xiaochun Cao , Yu-liang Lu , Ee-Chien Chang , Xitong Gao

Backdoor attack intends to embed hidden backdoor into deep neural networks (DNNs), so that the attacked models perform well on benign samples, whereas their predictions will be maliciously changed if the hidden backdoor is activated by…

Cryptography and Security · Computer Science 2022-02-17 Yiming Li , Yong Jiang , Zhifeng Li , Shu-Tao Xia

Backdoor attacks pose severe security threats to large language models (LLMs), where a model behaves normally under benign inputs but produces malicious outputs when a hidden trigger appears. Existing backdoor removal methods typically…

Cryptography and Security · Computer Science 2026-03-17 Jianwei Li , Jung-Eun Kim

Backdoor inversion, a central step in many backdoor defenses, is a reverse-engineering process to recover the hidden backdoor trigger inserted into a machine learning model. Existing approaches tackle this problem by searching for a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Mingjie Sun , J. Zico Kolter

Backdoor attacks are emerging threats to deep neural networks, which typically embed malicious behaviors into a victim model by injecting poisoned samples. Adversaries can activate the injected backdoor during inference by presenting the…

Cryptography and Security · Computer Science 2025-12-05 Bingyin Zhao , Yingjie Lao

Large Language Models (LLMs) can acquire deceptive behaviors through backdoor attacks, where the model executes prohibited actions whenever secret triggers appear in the input. Existing safety training methods largely fail to address this…

Cryptography and Security · Computer Science 2025-10-08 Guangyu Shen , Siyuan Cheng , Xiangzhe Xu , Yuan Zhou , Hanxi Guo , Zhuo Zhang , Xiangyu Zhang

As generative models achieve great success, tampering and modifying the sensitive image contents (i.e., human faces, artist signatures, commercial logos, etc.) have induced a significant threat with social impact. The backdoor attack is a…

Cryptography and Security · Computer Science 2024-10-22 Haichuan Zhang , Meiyu Lin , Zhaoyi Liu , Renyuan Li , Zhiyuan Cheng , Carl Yang , Mingjie Tang

Split learning is a collaborative learning design that allows several participants (clients) to train a shared model while keeping their datasets private. Recent studies demonstrate that collaborative learning models, specifically federated…

Cryptography and Security · Computer Science 2023-05-29 Behrad Tajalli , Oguzhan Ersoy , Stjepan Picek

Deep learning models are vulnerable to backdoor attacks, where attackers inject malicious behavior through data poisoning and later exploit triggers to manipulate deployed models. To improve the stealth and effectiveness of backdoors, prior…

Cryptography and Security · Computer Science 2024-09-10 Xiaolei Liu , Ming Yi , Kangyi Ding , Bangzhou Xin , Yixiao Xu , Li Yan , Chao Shen

Backdoor attacks are a significant threat to the performance and integrity of pre-trained language models. Although such models are routinely fine-tuned for downstream NLP tasks, recent work shows they remain vulnerable to backdoor attacks…

Machine Learning · Computer Science 2025-08-28 Santosh Chapagain , Shah Muhammad Hamdi , Soukaina Filali Boubrahimi

Backdoor attacks have been shown to be a serious security threat against deep learning models, and detecting whether a given model has been backdoored becomes a crucial task. Existing defenses are mainly built upon the observation that the…

Cryptography and Security · Computer Science 2022-08-16 Tong Wang , Yuan Yao , Feng Xu , Miao Xu , Shengwei An , Ting Wang

Deep neural networks are vulnerable to backdoor attacks. Among the existing backdoor defense methods, trigger reverse engineering based approaches, which reconstruct the backdoor triggers via optimizations, are the most versatile and…

Cryptography and Security · Computer Science 2024-04-22 Beichen Li , Yuanfang Guo , Heqi Peng , Yangxi Li , Yunhong Wang