English
Related papers

Related papers: BadMerging: Backdoor Attacks Against Model Merging

200 papers

Federated Learning (FL) is a popular distributed machine learning paradigm that enables jointly training a global model without sharing clients' data. However, its repetitive server-client communication gives room for backdoor attacks with…

Machine Learning · Computer Science 2023-01-20 Pei Fang , Jinghui Chen

We consider adversarial attacks to a black-box model when no queries are allowed. In this setting, many methods directly attack surrogate models and transfer the obtained adversarial examples to fool the target model. Plenty of previous…

Machine Learning · Computer Science 2021-09-08 Yunxiao Qin , Yuanhao Xiong , Jinfeng Yi , Cho-Jui Hsieh

While machine learning (ML) models are being increasingly trusted to make decisions in different and varying areas, the safety of systems using such models has become an increasing concern. In particular, ML models are often trained on data…

Backdoor attacks for neural code models have gained considerable attention due to the advancement of code intelligence. However, most existing works insert triggers into task-specific data for code-related downstream tasks, thereby limiting…

Cryptography and Security · Computer Science 2023-06-16 Yanzhou Li , Shangqing Liu , Kangjie Chen , Xiaofei Xie , Tianwei Zhang , Yang Liu

Deep Neural Networks are well known to be vulnerable to adversarial attacks and backdoor attacks, where minor modifications on the input are able to mislead the models to give wrong results. Although defenses against adversarial attacks…

Machine Learning · Computer Science 2022-08-01 Kaidi Jin , Tianwei Zhang , Chao Shen , Yufei Chen , Ming Fan , Chenhao Lin , Ting Liu

Model merging aims to integrate multiple task-specific fine-tuned models derived from a shared pre-trained checkpoint into a single multi-task model without additional training. Despite extensive research, task interference remains a major…

Machine Learning · Computer Science 2026-02-25 Longhua Li , Lei Qi , Qi Tian , Xin Geng

As object detection becomes integral to many safety-critical applications, understanding its vulnerabilities is essential. Backdoor attacks, in particular, pose a serious threat by implanting hidden triggers in victim models, which…

Cryptography and Security · Computer Science 2025-03-14 Jialin Lu , Junjie Shan , Ziqi Zhao , Ka-Ho Chow

As object detection becomes integral to many safety-critical applications, understanding its vulnerabilities is essential. Backdoor attacks, in particular, pose a serious threat by implanting hidden triggers in victim models, which…

Cryptography and Security · Computer Science 2025-03-17 Jialin Lu , Junjie Shan , Ziqi Zhao , Ka-Ho Chow

Transfer learning has become a powerful tool to initialize deep learning models to achieve faster convergence and higher performance. This is especially useful in the medical imaging analysis domain, where data scarcity limits possible…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Ibrahim Almakky , Santosh Sanjeev , Anees Ur Rehman Hashmi , Mohammad Areeb Qazi , Hu Wang , Mohammad Yaqub

Federated learning is a promising approach for training machine learning models while preserving data privacy. However, its distributed nature makes it vulnerable to backdoor attacks, particularly in NLP tasks, where related research…

Machine Learning · Computer Science 2025-07-31 Minyeong Choe , Cheolhee Park , Changho Seo , Hyunil Kim

Federated learning allows clients to collaboratively train a global model without uploading raw data for privacy preservation. This feature, i.e., the inability to review participants' datasets, has recently been found responsible for…

Machine Learning · Computer Science 2023-12-19 Yihang Lin , Pengyuan Zhou , Zhiqian Wu , Yong Liao

Deep learning models are vulnerable to backdoor attacks, where adversaries inject malicious functionality during training that activates on trigger inputs at inference time. Extensive research has focused on developing stealthy backdoor…

Cryptography and Security · Computer Science 2024-11-26 Jeongjin Shin , Sangdon Park

Vision State Space Models (SSMs), particularly architectures like Vision Mamba (ViM), have emerged as promising alternatives to Vision Transformers (ViTs). However, the security implications of this novel architecture, especially their…

Cryptography and Security · Computer Science 2025-07-02 Yinghao Wu , Liyan Zhang

Deep neural networks (DNNs) have progressed rapidly during the past decade and have been deployed in various real-world applications. Meanwhile, DNN models have been shown to be vulnerable to security and privacy attacks. One such attack…

Cryptography and Security · Computer Science 2021-10-06 Xiaoyi Chen , Ahmed Salem , Dingfan Chen , Michael Backes , Shiqing Ma , Qingni Shen , Zhonghai Wu , Yang Zhang

With extensive studies on backdoor attack and detection, still fundamental questions are left unanswered regarding the limits in the adversary's capability to attack and the defender's capability to detect. We believe that answers to these…

Cryptography and Security · Computer Science 2022-10-14 Di Tang , Rui Zhu , XiaoFeng Wang , Haixu Tang , Yi Chen

LLM-based multi-agent systems (MAS) demonstrate increasing integration into next-generation applications, but their safety in backdoor attacks remains largely underexplored. However, existing research has focused exclusively on single-agent…

Cryptography and Security · Computer Science 2025-10-14 Pengyu Zhu , Lijun Li , Yaxing Lyu , Li Sun , Sen Su , Jing Shao

Deep neural networks (DNNs) have long been recognized as vulnerable to backdoor attacks. By providing poisoned training data in the fine-tuning process, the attacker can implant a backdoor into the victim model. This enables input samples…

Cryptography and Security · Computer Science 2024-09-10 Abdullah Arafat Miah , Yu Bi

Recent studies revealed that deep neural networks (DNNs) are exposed to backdoor threats when training with third-party resources (such as training samples or backbones). The backdoored model has promising performance in predicting benign…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Chengxiao Luo , Yiming Li , Yong Jiang , Shu-Tao Xia

Backdoor mechanisms have traditionally been studied as security threats that compromise the integrity of machine learning models. However, the same mechanism -- the conditional activation of specific behaviors through input triggers -- can…

Cryptography and Security · Computer Science 2026-03-10 Yige Li , Wei Zhao , Zhe Li , Nay Myat Min , Hanxun Huang , Yunhan Zhao , Xingjun Ma , Yu-Gang Jiang , Jun Sun

Backdoor attacks pose a significant threat to the training process of deep neural networks (DNNs). As a widely-used DNN-based application in real-world scenarios, face recognition systems once implanted into the backdoor, may cause serious…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Ming Sun , Lihua Jing , Zixuan Zhu , Rui Wang