中文
相关论文

相关论文: Potion: Towards Poison Unlearning

200 篇论文

Data poisoning attacks manipulate training data to introduce unexpected behaviors into machine learning models at training time. For text-to-image generative models with massive training datasets, current understanding of poisoning attacks…

密码学与安全 · 计算机科学 2024-04-30 Shawn Shan , Wenxin Ding , Josephine Passananti , Stanley Wu , Haitao Zheng , Ben Y. Zhao

Poisoning attacks, in which an attacker adversarially manipulates the training dataset of a machine learning (ML) model, pose a significant threat to ML security. Beta Poisoning is a recently proposed poisoning attack that disrupts model…

密码学与安全 · 计算机科学 2025-08-05 Nilufer Gulciftci , M. Emre Gursoy

Data poisoning attacks, in which a malicious adversary aims to influence a model by injecting "poisoned" data into the training process, have attracted significant recent attention. In this work, we take a closer look at existing poisoning…

机器学习 · 计算机科学 2024-02-16 Yiwei Lu , Gautam Kamath , Yaoliang Yu

Large language models trained on web-scale data can memorize private or sensitive knowledge, raising significant privacy risks. Although some unlearning methods mitigate these risks, they remain vulnerable to "relearning" during subsequent…

机器学习 · 计算机科学 2026-03-05 Nakyeong Yang , Dong-Kyum Kim , Jea Kwon , Minsung Kim , Kyomin Jung , Meeyoung Cha

Our research addresses the overlooked security concerns related to data poisoning in continual learning (CL). Data poisoning - the intentional manipulation of training data to affect the predictions of machine learning models - was recently…

密码学与安全 · 计算机科学 2025-08-12 Stanisław Pawlak , Bartłomiej Twardowski , Tomasz Trzciński , Joost van de Weijer

Poisoning attack is identified as a severe security threat to machine learning algorithms. In many applications, for example, deep neural network (DNN) models collect public data as the inputs to perform re-training, where the input data…

密码学与安全 · 计算机科学 2017-03-07 Chaofei Yang , Qing Wu , Hai Li , Yiran Chen

Semi-supervised Federated Learning (SSFL) has recently drawn much attention due to its practical consideration, i.e., the clients may only have unlabeled data. In practice, these SSFL systems implement semi-supervised training by assigning…

机器学习 · 计算机科学 2022-05-10 Yi Liu , Xingliang Yuan , Ruihui Zhao , Cong Wang , Dusit Niyato , Yefeng Zheng

Machine unlearning, which enables a model to forget specific data, is crucial for ensuring data privacy and model reliability. However, its effectiveness can be severely undermined in real-world scenarios where models learn unintended…

机器学习 · 计算机科学 2026-02-26 JuneHyoung Kwon , MiHyeon Kim , Eunju Lee , Yoonji Lee , Seunghoon Lee , YoungBin Kim

Machine unlearning algorithms, designed for selective removal of training data from models, have emerged as a promising approach to growing privacy concerns. In this work, we expose a critical yet underexplored vulnerability in the…

密码学与安全 · 计算机科学 2024-10-15 Yangsibo Huang , Daogao Liu , Lynn Chua , Badih Ghazi , Pritish Kamath , Ravi Kumar , Pasin Manurangsi , Milad Nasr , Amer Sinha , Chiyuan Zhang

Semi-supervised learning methods can train high-accuracy machine learning models with a fraction of the labeled training samples required for traditional supervised learning. Such methods do not typically involve close review of the…

机器学习 · 计算机科学 2022-12-07 Marissa Connor , Vincent Emanuele

Machine learning models trained on data from the outside world can be corrupted by data poisoning attacks that inject malicious points into the models' training sets. A common defense against these attacks is data sanitization: first filter…

机器学习 · 统计学 2021-12-06 Pang Wei Koh , Jacob Steinhardt , Percy Liang

During pretraining, LLMs inadvertently memorize sensitive or copyrighted data, posing significant compliance challenges under legal frameworks like the GDPR and the EU AI Act. Fulfilling these mandates demands techniques that can remove…

机器学习 · 计算机科学 2026-03-23 Efstratios Zaradoukas , Bardh Prenkaj , Gjergji Kasneci

In the evolving landscape of Federated Learning (FL), a new type of attacks concerns the research community, namely Data Poisoning Attacks, which threaten the model integrity by maliciously altering training data. This paper introduces a…

密码学与安全 · 计算机科学 2024-04-22 Nick Galanis

To promote secure and private artificial intelligence (SPAI), we review studies on the model security and data privacy of DNNs. Model security allows system to behave as intended without being affected by malicious external influences that…

密码学与安全 · 计算机科学 2021-03-11 Ho Bae , Jaehee Jang , Dahuin Jung , Hyemi Jang , Heonseok Ha , Hyungyu Lee , Sungroh Yoon

In recent years, data poisoning attacks have been increasingly designed to appear harmless and even beneficial, often with the intention of verifying dataset ownership or safeguarding private data from unauthorized use. However, these…

密码学与安全 · 计算机科学 2025-10-13 Yifan Zhu , Lijia Yu , Xiao-Shan Gao

This paper investigates policy resilience to training-environment poisoning attacks on reinforcement learning (RL) policies, with the goal of recovering the deployment performance of a poisoned RL policy. Due to the fact that the policy…

机器学习 · 计算机科学 2023-04-25 Hang Xu , Xinghua Qu , Zinovi Rabinovich

In the era of increasing concerns over cybersecurity threats, defending against backdoor attacks is paramount in ensuring the integrity and reliability of machine learning models. However, many existing approaches require substantial…

机器学习 · 计算机科学 2024-05-08 Kealan Dunnett , Reza Arablouei , Dimity Miller , Volkan Dedeoglu , Raja Jurdak

The efficacy of availability poisoning, a method of poisoning data by injecting imperceptible perturbations to prevent its use in model training, has been a hot subject of investigation. Previous research suggested that it was difficult to…

计算机视觉与模式识别 · 计算机科学 2023-08-08 Tianrui Qin , Xitong Gao , Juanjuan Zhao , Kejiang Ye , Cheng-Zhong Xu

Poisoning attacks compromise the training phase of federated learning (FL) such that the learned global model misclassifies attacker-chosen inputs called target inputs. Existing defenses mainly focus on protecting the training phase of FL…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Yuqi Jia , Minghong Fang , Hongbin Liu , Jinghuai Zhang , Neil Zhenqiang Gong

Once users have shared their data online, it is generally difficult for them to revoke access and ask for the data to be deleted. Machine learning (ML) exacerbates this problem because any model trained with said data may have memorized it,…