中文
相关论文

相关论文: Backdoor Attacks in Federated Learning by Rare Emb…

200 篇论文

Collaborative machine learning settings like federated learning can be susceptible to adversarial interference and attacks. One class of such attacks is termed model inversion attacks, characterised by the adversary reverse-engineering the…

机器学习 · 计算机科学 2022-03-02 Dmitrii Usynin , Daniel Rueckert , Georgios Kaissis

Federated learning is inherently vulnerable to model poisoning attacks because its decentralized nature allows attackers to participate with compromised devices. In model poisoning attacks, the attacker reduces the model's performance on…

机器学习 · 计算机科学 2021-12-14 Ashwinee Panda , Saeed Mahloujifar , Arjun N. Bhagoji , Supriyo Chakraborty , Prateek Mittal

Natural language processing (NLP) models are known to be vulnerable to backdoor attacks, which poses a newly arisen threat to NLP models. Prior online backdoor defense methods for NLP models only focus on the anomalies at either the input…

计算与语言 · 计算机科学 2022-10-17 Sishuo Chen , Wenkai Yang , Zhiyuan Zhang , Xiaohan Bi , Xu Sun

Because state-of-the-art language models are expensive to train, most practitioners must make use of one of the few publicly available language models or language model APIs. This consolidation of trust increases the potency of backdoor…

密码学与安全 · 计算机科学 2023-07-28 Nikhil Kandpal , Matthew Jagielski , Florian Tramèr , Nicholas Carlini

Federated learning (FL), as a type of distributed machine learning frameworks, is vulnerable to external attacks on FL models during parameters transmissions. An attacker in FL may control a number of participant clients, and purposely…

机器学习 · 计算机科学 2021-01-29 Kang Wei , Jun Li , Ming Ding , Chuan Ma , Yo-Seb Jeon , H. Vincent Poor

Neural networks are often trained on proprietary datasets, making them attractive attack targets. We present a novel dataset extraction method leveraging an innovative training time backdoor attack, allowing a malicious federated learning…

密码学与安全 · 计算机科学 2025-12-19 Eden Luzon , Guy Amit , Roy Weiss , Torsten Kraub , Alexandra Dmitrienko , Yisroel Mirsky

Gradient inversion attack (or input recovery from gradient) is an emerging threat to the security and privacy preservation of Federated learning, whereby malicious eavesdroppers or participants in the protocol can recover (partially) the…

密码学与安全 · 计算机科学 2021-12-02 Yangsibo Huang , Samyak Gupta , Zhao Song , Kai Li , Sanjeev Arora

This paper proposes a novel backdoor threat attacking the LLM-as-a-Judge evaluation regime, where the adversary controls both the candidate and evaluator model. The backdoored evaluator victimizes benign users by unfairly assigning inflated…

计算与语言 · 计算机科学 2025-03-04 Terry Tong , Fei Wang , Zhe Zhao , Muhao Chen

Deep Neural Networks (DNNs) are known to be vulnerable to backdoor attacks. In Natural Language Processing (NLP), DNNs are often backdoored during the fine-tuning process of a large-scale Pre-trained Language Model (PLM) with poisoned…

计算与语言 · 计算机科学 2022-10-19 Zhiyuan Zhang , Lingjuan Lyu , Xingjun Ma , Chenguang Wang , Xu Sun

Backdoor attacks change a small portion of training data by introducing hand-crafted triggers and rewiring the corresponding labels towards a desired target class. Training on such data injects a backdoor which causes malicious inference in…

机器学习 · 计算机科学 2024-09-05 Ivan Sabolić , Ivan Grubišić , Siniša Šegvić

Backdoor attacks pose a new threat to NLP models. A standard strategy to construct poisoned data in backdoor attacks is to insert triggers (e.g., rare words) into selected sentences and alter the original label to a target label. This…

计算与语言 · 计算机科学 2022-04-28 Leilei Gan , Jiwei Li , Tianwei Zhang , Xiaoya Li , Yuxian Meng , Fei Wu , Yi Yang , Shangwei Guo , Chun Fan

Federated Prompt Learning has emerged as a communication-efficient and privacy-preserving paradigm for adapting large vision-language models like CLIP across decentralized clients. However, the security implications of this setup remain…

密码学与安全 · 计算机科学 2026-01-28 Momin Ahmad Khan , Yasra Chandio , Fatima Muhammad Anwar

Recent studies have widely investigated backdoor attacks on Large Language Models (LLMs) by inserting harmful question-answer (QA) pairs into their training data. However, we revisit existing attacks and identify two critical limitations:…

计算与语言 · 计算机科学 2025-10-07 Jiawei Kong , Hao Fang , Xiaochen Yang , Kuofeng Gao , Bin Chen , Shu-Tao Xia , Ke Xu , Han Qiu

Federated learning (FL) has become an emerging machine learning technique lately due to its efficacy in safeguarding the client's confidential information. Nevertheless, despite the inherent and additional privacy-preserving mechanisms…

密码学与安全 · 计算机科学 2021-09-22 Md Tamjid Hossain , Shafkat Islam , Shahriar Badsha , Haoting Shen

Federated learning (FL) enables learning a global machine learning model from local data distributed among a set of participating workers. This makes it possible i) to train more accurate models due to learning from rich joint training…

机器学习 · 计算机科学 2025-11-25 Najeeb Jebreel , Josep Domingo-Ferrer

With the widespread use of deep learning system in many applications, the adversary has strong incentive to explore vulnerabilities of deep neural networks and manipulate them. Backdoor attacks against deep neural networks have been…

密码学与安全 · 计算机科学 2019-06-05 Jiazhu Dai , Chuanshuai Chen

A number of online services nowadays rely upon machine learning to extract valuable information from data collected in the wild. This exposes learning algorithms to the threat of data poisoning, i.e., a coordinate attack in which a fraction…

Federated learning (FL), as a powerful learning paradigm, trains a shared model by aggregating model updates from distributed clients. However, the decoupling of model learning from local data makes FL highly vulnerable to backdoor attacks,…

密码学与安全 · 计算机科学 2025-03-07 Xiyue Zhang , Xiaoyong Xue , Xiaoning Du , Xiaofei Xie , Yang Liu , Meng Sun

Pre-trained language models have achieved remarkable success across a wide range of natural language processing (NLP) tasks, particularly when fine-tuned on large, domain-relevant datasets. However, they remain vulnerable to backdoor…

计算与语言 · 计算机科学 2026-02-02 Anindya Sundar Das , Kangjie Chen , Monowar Bhuyan

Research on backdoor attacks in Federated Learning (FL) has accelerated in recent years, with new attacks and defenses continually proposed in an escalating arms race. However, the evaluation of these methods remains neither standardized…

密码学与安全 · 计算机科学 2025-11-26 Thinh Dao , Dung Thuy Nguyen , Khoa D Doan , Kok-Seng Wong