中文
相关论文

相关论文: Backdoor Attacks Against Incremental Learners: An …

200 篇论文

Federated learning allows multiple users to collaboratively train a shared classification model while preserving data privacy. This approach, where model updates are aggregated by a central server, was shown to be vulnerable to poisoning…

机器学习 · 计算机科学 2020-12-17 Chien-Lun Chen , Leana Golubchik , Marco Paolieri

Split learning is a collaborative learning design that allows several participants (clients) to train a shared model while keeping their datasets private. Recent studies demonstrate that collaborative learning models, specifically federated…

密码学与安全 · 计算机科学 2023-05-29 Behrad Tajalli , Oguzhan Ersoy , Stjepan Picek

Deep neural networks are vulnerable to backdoor attacks, a type of adversarial attack that poisons the training data to manipulate the behavior of models trained on such data. Clean-label attacks are a more stealthy form of backdoor attacks…

Backdoor attacks are a kind of emergent security threat in deep learning. After being injected with a backdoor, a deep neural model will behave normally on standard inputs but give adversary-specified predictions once the input contains…

密码学与安全 · 计算机科学 2022-10-20 Yangyi Chen , Fanchao Qi , Hongcheng Gao , Zhiyuan Liu , Maosong Sun

Backdoor attack intends to embed hidden backdoor into deep neural networks (DNNs), so that the attacked models perform well on benign samples, whereas their predictions will be maliciously changed if the hidden backdoor is activated by…

密码学与安全 · 计算机科学 2022-02-17 Yiming Li , Yong Jiang , Zhifeng Li , Shu-Tao Xia

Federated learning allows multiple participants to collaboratively train a central model without sharing their private data. However, this distributed nature also exposes new attack surfaces. In particular, backdoor attacks allow attackers…

机器学习 · 计算机科学 2025-09-24 Zhaoxin Wang , Handing Wang , Cong Tian , Yaochu Jin

In-context learning, a paradigm bridging the gap between pre-training and fine-tuning, has demonstrated high efficacy in several NLP tasks, especially in few-shot settings. Despite being widely applied, in-context learning is vulnerable to…

计算与语言 · 计算机科学 2024-10-10 Shuai Zhao , Meihuizi Jia , Luu Anh Tuan , Fengjun Pan , Jinming Wen

Continual (or "incremental") learning approaches are employed when additional knowledge or tasks need to be learned from subsequent batches or from streaming data. However these approaches are typically adversary agnostic, i.e., they do not…

机器学习 · 计算机科学 2021-02-17 Muhammad Umer , Robi Polikar

Deep learning models have consistently outperformed traditional machine learning models in various classification tasks, including image classification. As such, they have become increasingly prevalent in many real world applications…

密码学与安全 · 计算机科学 2018-08-31 Cong Liao , Haoti Zhong , Anna Squicciarini , Sencun Zhu , David Miller

In-context learning (ICL) has demonstrated remarkable success in large language models (LLMs) due to its adaptability and parameter-free nature. However, it also introduces a critical vulnerability to backdoor attacks, where adversaries can…

机器学习 · 计算机科学 2025-07-03 Zhiyao Ren , Siyuan Liang , Aishan Liu , Dacheng Tao

Deep learning models have recently shown to be vulnerable to backdoor poisoning, an insidious attack where the victim model predicts clean images correctly but classifies the same images as the target class when a trigger poison pattern is…

计算机视觉与模式识别 · 计算机科学 2019-11-20 Alvin Chan , Yew-Soon Ong

As collaborative learning and the outsourcing of data collection become more common, malicious actors (or agents) which attempt to manipulate the learning process face an additional obstacle as they compete with each other. In backdoor…

机器学习 · 计算机科学 2021-10-12 Siddhartha Datta , Giulio Lovisotto , Ivan Martinovic , Nigel Shadbolt

Machine unlearning has emerged as a key component in ensuring ``Right to be Forgotten'', enabling the removal of specific data points from trained models. However, even when the unlearning is performed without poisoning the forget-set…

密码学与安全 · 计算机科学 2025-06-17 Marco Arazzi , Antonino Nocera , Vinod P

Machine learning models have achieved great success in supervised learning tasks for end-to-end training, which requires a large amount of labeled data that is not always feasible. Recently, many practitioners have shifted to…

机器学习 · 计算机科学 2024-02-21 Yiwei Lu , Matthew Y. R. Yang , Gautam Kamath , Yaoliang Yu

As asynchronous event data is more frequently engaged in various vision tasks, the risk of backdoor attacks becomes more evident. However, research into the potential risk associated with backdoor attacks in asynchronous event data has been…

密码学与安全 · 计算机科学 2024-07-16 Ruofei Wang , Qing Guo , Haoliang Li , Renjie Wan

Multimodal contrastive learning methods like CLIP train on noisy and uncurated training datasets. This is cheaper than labeling datasets manually, and even improves out-of-distribution robustness. We show that this practice makes backdoor…

机器学习 · 计算机科学 2022-03-29 Nicholas Carlini , Andreas Terzis

The rapid expansion of connected devices has made them prime targets for cyberattacks. To address these threats, deep learning-based, data-driven intrusion detection systems (IDS) have emerged as powerful tools for detecting and mitigating…

机器学习 · 计算机科学 2025-01-29 Ajesh Koyatan Chathoth , Stephen Lee

Making learners robust to adversarial perturbation at test time (i.e., evasion attacks) or training time (i.e., poisoning attacks) has emerged as a challenging task. It is known that for some natural settings, sublinear perturbations in the…

机器学习 · 计算机科学 2018-11-07 Saeed Mahloujifar , Mohammad Mahmoody

Multimodal contrastive learning uses various data modalities to create high-quality features, but its reliance on extensive data sources on the Internet makes it vulnerable to backdoor attacks. These attacks insert malicious behaviors…

密码学与安全 · 计算机科学 2024-10-01 Kuanrong Liu , Siyuan Liang , Jiawei Liang , Pengwen Dai , Xiaochun Cao

Because state-of-the-art language models are expensive to train, most practitioners must make use of one of the few publicly available language models or language model APIs. This consolidation of trust increases the potency of backdoor…

密码学与安全 · 计算机科学 2023-07-28 Nikhil Kandpal , Matthew Jagielski , Florian Tramèr , Nicholas Carlini