中文
相关论文

相关论文: Lethean Attack: An Online Data Poisoning Technique

200 篇论文

Data poisoning has been proposed as a compelling defense against facial recognition models trained on Web-scraped pictures. Users can perturb images they post online, so that models will misclassify future (unperturbed) pictures. We…

机器学习 · 计算机科学 2022-03-15 Evani Radiya-Dixit , Sanghyun Hong , Nicholas Carlini , Florian Tramèr

Large amounts of incremental learning algorithms have been proposed to alleviate the catastrophic forgetting issue arises while dealing with sequential data on a time series. However, the adversarial robustness of incremental learners has…

密码学与安全 · 计算机科学 2023-05-31 Yiqi Zhong , Xianming Liu , Deming Zhai , Junjun Jiang , Xiangyang Ji

Neural machine translation systems are known to be vulnerable to adversarial test inputs, however, as we show in this paper, these systems are also vulnerable to training attacks. Specifically, we propose a poisoning attack in which a…

计算与语言 · 计算机科学 2021-07-13 Jun Wang , Chang Xu , Francisco Guzman , Ahmed El-Kishky , Yuqing Tang , Benjamin I. P. Rubinstein , Trevor Cohn

The growing reliance of intelligent systems on data makes the systems vulnerable to data poisoning attacks. Such attacks could compromise machine learning or deep learning models by disrupting the input data. Previous studies on data…

最优化与控制 · 数学 2025-05-19 Xin Wang , Feilong Wang , Yuan Hong , R. Tyrrell Rockafellar , Xuegang , Ban

The expansion of large-scale online education platforms has made vast amounts of student interaction data available for knowledge tracing (KT). KT models estimate students' concept mastery from interaction data, but their performance is…

计算机与社会 · 计算机科学 2026-01-13 Qinyi Liu , Lin Li , Valdemar Švábenský , Conrad Borchers , Mohammad Khalil

Modern language models remain vulnerable to backdoor attacks via poisoned data, where training inputs containing a trigger are paired with a target output, causing the model to reproduce that behavior whenever the trigger appears at…

密码学与安全 · 计算机科学 2026-01-06 Eric Xue , Ruiyi Zhang , Pengtao Xie

Federated Learning systems are increasingly subjected to a multitude of model poisoning attacks from clients. Among these, edge-case attacks that target a small fraction of the input space are nearly impossible to detect using existing…

机器学习 · 计算机科学 2024-08-15 Kiran Purohit , Soumi Das , Sourangshu Bhattacharya , Santu Rana

We study offline data poisoning attacks in contextual bandits, a class of reinforcement learning problems with important applications in online recommendation and adaptive medical treatment, among others. We provide a general attack…

机器学习 · 计算机科学 2018-08-27 Yuzhe Ma , Kwang-Sung Jun , Lihong Li , Xiaojin Zhu

We introduce a novel clean-label targeted poisoning attack on learning mechanisms. While classical poisoning attacks typically corrupt data via addition, modification and omission, our attack focuses on data omission only. Our attack…

机器学习 · 计算机科学 2021-05-06 Guy Barash , Eitan Farchi , Sarit Kraus , Onn Shehory

Machine unlearning has emerged as a key component in ensuring ``Right to be Forgotten'', enabling the removal of specific data points from trained models. However, even when the unlearning is performed without poisoning the forget-set…

密码学与安全 · 计算机科学 2025-06-17 Marco Arazzi , Antonino Nocera , Vinod P

This paper proposes an online environment poisoning algorithm tailored for reinforcement learning agents operating in a black-box setting, where an adversary deliberately manipulates training data to lead the agent toward a mischievous…

机器学习 · 计算机科学 2024-12-03 Jianhui Li , Bokang Zhang , Junfeng Wu

Poisoning attacks have emerged as a significant security threat to machine learning algorithms. It has been demonstrated that adversaries who make small changes to the training set, such as adding specially crafted data points, can hurt the…

机器学习 · 计算机科学 2021-12-14 Samuel Deng , Sanjam Garg , Somesh Jha , Saeed Mahloujifar , Mohammad Mahmoody , Abhradeep Thakurta

Semi-supervised learning methods can train high-accuracy machine learning models with a fraction of the labeled training samples required for traditional supervised learning. Such methods do not typically involve close review of the…

机器学习 · 计算机科学 2022-12-07 Marissa Connor , Vincent Emanuele

Machine learning models trained on data from the outside world can be corrupted by data poisoning attacks that inject malicious points into the models' training sets. A common defense against these attacks is data sanitization: first filter…

机器学习 · 统计学 2021-12-06 Pang Wei Koh , Jacob Steinhardt , Percy Liang

The adversarial machine learning literature is largely partitioned into evasion attacks on testing data and poisoning attacks on training data. In this work, we show that adversarial examples, originally intended for attacking pre-trained…

机器学习 · 计算机科学 2021-06-22 Liam Fowl , Micah Goldblum , Ping-yeh Chiang , Jonas Geiping , Wojtek Czaja , Tom Goldstein

Adversarial attacks such as poisoning attacks have attracted the attention of many machine learning researchers. Traditionally, poisoning attacks attempt to inject adversarial training data in order to manipulate the trained model. In…

机器学习 · 计算机科学 2025-03-26 Ali Raza , Shujun Li , Kim-Phuc Tran , Ludovic Koehl , Kim Duc Tran

Federated Learning (FL) is a decentralized learning paradigm, enabling parties to collaboratively train models while keeping their data confidential. Within autonomous driving, it brings the potential of reducing data storage costs,…

机器学习 · 计算机科学 2024-05-03 Sonakshi Garg , Hugo Jönsson , Gustav Kalander , Axel Nilsson , Bhhaanu Pirange , Viktor Valadi , Johan Östman

This demo paper examines the susceptibility of Federated Learning (FL) systems to targeted data poisoning attacks, presenting a novel system for visualizing and mitigating such threats. We simulate targeted data poisoning attacks via label…

密码学与安全 · 计算机科学 2024-05-28 Xueqing Zhang , Junkai Zhang , Ka-Ho Chow , Juntao Chen , Ying Mao , Mohamed Rahouti , Xiang Li , Yuchen Liu , Wenqi Wei

Recent studies have revealed a security threat to natural language processing (NLP) models, called the Backdoor Attack. Victim models can maintain competitive performance on clean samples while behaving abnormally on samples with a specific…

计算与语言 · 计算机科学 2021-03-30 Wenkai Yang , Lei Li , Zhiyuan Zhang , Xuancheng Ren , Xu Sun , Bin He

With the success of deep learning algorithms in various domains, studying adversarial attacks to secure deep models in real world applications has become an important research topic. Backdoor attacks are a form of adversarial attacks on…

计算机视觉与模式识别 · 计算机科学 2019-12-24 Aniruddha Saha , Akshayvarun Subramanya , Hamed Pirsiavash