中文
相关论文

相关论文: BrainWash: A Poisoning Attack to Forget in Continu…

200 篇论文

Our research addresses the overlooked security concerns related to data poisoning in continual learning (CL). Data poisoning - the intentional manipulation of training data to affect the predictions of machine learning models - was recently…

密码学与安全 · 计算机科学 2025-08-12 Stanisław Pawlak , Bartłomiej Twardowski , Tomasz Trzciński , Joost van de Weijer

Machine unlearning, which aims to efficiently remove the influence of specific data from trained models, is crucial for upholding data privacy regulations like the ``right to be forgotten". However, existing research predominantly evaluates…

机器学习 · 计算机科学 2026-02-24 Liheng Yu , Zhe Zhao , Yuxuan Wang , Pengkun Wang , Xiaofeng Cao , Binwu Wang , Yang Wang

Catastrophic forgetting of previous knowledge is a critical issue in continual learning typically handled through various regularization strategies. However, existing methods struggle especially when several incremental steps are performed.…

计算机视觉与模式识别 · 计算机科学 2024-02-20 Chang Liu , Giulia Rizzoli , Francesco Barbato , Andrea Maracani , Marco Toldo , Umberto Michieli , Yi Niu , Pietro Zanuttigh

With the capacity of continual learning, humans can continuously acquire knowledge throughout their lifespan. However, computational systems are not, in general, capable of learning tasks sequentially. This long-standing challenge for deep…

机器学习 · 计算机科学 2022-08-05 Qihan Yang , Fan Feng , Rosa Chan

Continual learning is considered a promising step towards next-generation Artificial Intelligence (AI), where deep neural networks (DNNs) make decisions by continuously learning a sequence of different tasks akin to human learning…

机器学习 · 计算机科学 2021-05-06 Yuyang Gao , Giorgio A. Ascoli , Liang Zhao

We study a security threat to batch reinforcement learning and control where the attacker aims to poison the learned policy. The victim is a reinforcement learner / controller which first estimates the dynamics and the rewards from a batch…

机器学习 · 计算机科学 2019-11-01 Yuzhe Ma , Xuezhou Zhang , Wen Sun , Xiaojin Zhu

In Continual Learning, a Neural Network is trained on a stream of data whose distribution shifts over time. Under these assumptions, it is especially challenging to improve on classes appearing later in the stream while remaining accurate…

机器学习 · 计算机科学 2020-10-13 Pietro Buzzega , Matteo Boschini , Angelo Porrello , Simone Calderara

Artificial neural networks (ANNs) continue to face challenges in continual learning, particularly due to catastrophic forgetting, the loss of previously learned knowledge when acquiring new tasks. Inspired by memory consolidation in the…

机器学习 · 计算机科学 2025-09-03 Jina Kim

Fake audio attack becomes a major threat to the speaker verification system. Although current detection approaches have achieved promising results on dataset-specific scenarios, they encounter difficulties on unseen spoofing data.…

声音 · 计算机科学 2022-07-12 Haoxin Ma , Jiangyan Yi , Jianhua Tao , Ye Bai , Zhengkun Tian , Chenglong Wang

Continual learning (CL) empowers AI systems to progressively acquire knowledge from non-stationary data streams. However, catastrophic forgetting remains a critical challenge. In this work, we identify attention drift in Vision Transformers…

计算机视觉与模式识别 · 计算机科学 2026-02-06 Yue Lu , Xiangyu Zhou , Shizhou Zhang , Yinghui Xing , Guoqiang Liang , Wencong Zhang

Data poisoning is one of the most relevant security threats against machine learning and data-driven technologies. Since many applications rely on untrusted training data, an attacker can easily craft malicious samples and inject them into…

密码学与安全 · 计算机科学 2021-12-01 Nicolas M. Müller , Simon Roschmann , Konstantin Böttinger

Lifelong learning with deep neural networks is well-known to suffer from catastrophic forgetting: the performance on previous tasks drastically degrades when learning a new task. To alleviate this effect, we propose to leverage a large…

计算机视觉与模式识别 · 计算机科学 2019-10-29 Kibok Lee , Kimin Lee , Jinwoo Shin , Honglak Lee

We introduce a novel continual learning method based on multifidelity deep neural networks. This method learns the correlation between the output of previously trained models and the desired output of the model on the current training…

数值分析 · 数学 2024-07-01 Amanda Howard , Yucheng Fu , Panos Stinis

The financial industry relies on deep learning models for making important decisions. This adoption brings new danger, as deep black-box models are known to be vulnerable to adversarial attacks. In computer vision, one can shape the output…

机器学习 · 计算机科学 2024-08-27 Alina Ermilova , Elizaveta Kovtun , Dmitry Berestnev , Alexey Zaytsev

The goal of continual learning is to find a model that solves multiple learning tasks which are presented sequentially to the learner. A key challenge in this setting is that the learner may forget how to solve a previous task when learning…

机器学习 · 计算机科学 2023-06-09 Liangzu Peng , Paris V. Giampouras , René Vidal

Deep neural networks suffer from catastrophic forgetting, where performance on previous tasks degrades after training on a new task. This issue arises due to the model's tendency to overwrite previously acquired knowledge with new…

Continual learning aims to sequentially learn new tasks without forgetting previous tasks' knowledge (catastrophic forgetting). One factor that can cause forgetting is the interference between the gradients on losses from different tasks.…

计算与语言 · 计算机科学 2025-12-01 Xueying Bai , Jinghuan Shang , Yifan Sun , Niranjan Balasubramanian

Federated learning allows multiple clients to collaboratively train a global model with the assistance of a server. However, its distributed nature makes it susceptible to poisoning attacks, where malicious clients can compromise the global…

密码学与安全 · 计算机科学 2025-01-30 Wenbin Wang , Qiwen Ma , Zifan Zhang , Yuchen Liu , Zhuqing Liu , Minghong Fang

Continual learning refers to the capability of a machine learning model to learn and adapt to new information, without compromising its performance on previously learned tasks. Although several studies have investigated continual learning…

信息检索 · 计算机科学 2024-06-21 Jingrui Hou , Georgina Cosma , Axel Finke

We introduce a novel clean-label targeted poisoning attack on learning mechanisms. While classical poisoning attacks typically corrupt data via addition, modification and omission, our attack focuses on data omission only. Our attack…

机器学习 · 计算机科学 2021-05-06 Guy Barash , Eitan Farchi , Sarit Kraus , Onn Shehory