English
Related papers

Related papers: Delta-Influence: Unlearning Poisons via Influence …

200 papers

We study how training data contributes to the emergence of toxic behaviors in large language models. Most prior work on reducing model toxicity adopts reactive approaches, such as fine-tuning pre-trained (and potentially toxic) models to…

Machine Learning · Computer Science 2025-12-08 Zachary Coalson , Juhan Bae , Nicholas Carlini , Sanghyun Hong

A critical aspect of analyzing and improving modern machine learning systems lies in understanding how individual training examples influence a model's predictive behavior. Estimating this influence enables critical applications, including…

Machine Learning · Computer Science 2025-10-15 Narine Kokhlikyan , Kamalika Chaudhuri , Saeed Mahloujifar

This paper investigates poisoning attacks against data-driven control methods. This work is motivated by recent trends showing that, in supervised learning, slightly modifying the data in a malicious manner can drastically deteriorate the…

Systems and Control · Electrical Eng. & Systems 2021-03-11 Alessio Russo , Alexandre Proutiere

Among the most critical limitations of deep learning NLP models are their lack of interpretability, and their reliance on spurious correlations. Prior work proposed various approaches to interpreting the black-box models to unveil the…

Computation and Language · Computer Science 2021-10-08 Xiaochuang Han , Yulia Tsvetkov

Removing information from a machine learning model is a non-trivial task that requires to partially revert the training process. This task is unavoidable when sensitive data, such as credit card numbers or passwords, accidentally enter the…

Machine Learning · Computer Science 2023-08-08 Alexander Warnecke , Lukas Pirch , Christian Wressnegger , Konrad Rieck

Backdoor attacks inject poisoning samples during training, with the goal of forcing a machine learning model to output an attacker-chosen class when presented a specific trigger at test time. Although backdoor attacks have been demonstrated…

Training data attribution (TDA) methods offer to trace a model's prediction on any given example back to specific influential training examples. Existing approaches do so by assigning a scalar influence score to each training example, under…

Machine Learning · Computer Science 2023-03-15 Kelvin Guu , Albert Webson , Ellie Pavlick , Lucas Dixon , Ian Tenney , Tolga Bolukbasi

The trustworthy machine learning (ML) community is increasingly recognizing the crucial need for models capable of selectively 'unlearning' data points after training. This leads to the problem of machine unlearning (MU), aiming to…

Machine Learning · Computer Science 2024-07-10 Chongyu Fan , Jiancheng Liu , Alfred Hero , Sijia Liu

Influence functions approximate the effect of training samples in test-time predictions and have a wide variety of applications in machine learning interpretability and uncertainty estimation. A commonly-used (first-order) influence…

Machine Learning · Computer Science 2021-02-12 Samyadeep Basu , Philip Pope , Soheil Feizi

Machine unlearning refers to the process of mitigating the influence of specific training data on machine learning models based on removal requests from data owners. However, one important area that has been largely overlooked in the…

Cryptography and Security · Computer Science 2025-07-17 Dayong Ye , Tianqing Zhu , Congcong Zhu , Derui Wang , Kun Gao , Zewei Shi , Sheng Shen , Wanlei Zhou , Minhui Xue

Targeted training-set attacks inject malicious instances into the training set to cause a trained model to mislabel one or more specific test instances. This work proposes the task of target identification, which determines whether a…

Machine Learning · Computer Science 2022-09-07 Zayd Hammoudeh , Daniel Lowd

Influence Functions are a standard tool for attributing predictions to training data in a principled manner and are widely used in applications such as data valuation and fairness. In this work, we present realistic incentives to manipulate…

Machine Learning · Computer Science 2024-10-08 Chhavi Yadav , Ruihan Wu , Kamalika Chaudhuri

Machine unlearning enables pre-trained models to eliminate the effects of partial training samples. Previous research has mainly focused on proposing efficient unlearning strategies. However, the verification of machine unlearning, or in…

Cryptography and Security · Computer Science 2024-06-18 Heng Xu , Tianqing Zhu , Lefeng Zhang , Wanlei Zhou

Sequential recommendation approaches have demonstrated remarkable proficiency in modeling user preferences. Nevertheless, they are susceptible to profile pollution attacks (PPA), wherein items are introduced into a user's interaction…

Information Retrieval · Computer Science 2024-12-03 Xiaoyu Du , Yingying Chen , Yang Zhang , Jinhui Tang

Data poisoning attacks compromise the integrity of machine-learning models by introducing malicious training samples to influence the results during test time. In this work, we investigate backdoor data poisoning attack on deep neural…

Machine Learning · Computer Science 2019-12-04 Mahesh Subedar , Nilesh Ahuja , Ranganath Krishnan , Ibrahima J. Ndiour , Omesh Tickoo

The need for machine unlearning is critical for data privacy, yet existing methods often cause Knowledge Contamination by unintentionally damaging related knowledge. Such a degraded model performance after unlearning has been recently…

Machine Learning · Computer Science 2026-03-03 Jinmyeong Shin , Joshua Tapia , Nicholas Ferreira , Gabriel Diaz , Moayed Daneshyari , Hyeran Jeon

The recent success of machine learning (ML) has been fueled by the increasing availability of computing power and large amounts of data in many different applications. However, the trustworthiness of the resulting models can be compromised…

Cryptography and Security · Computer Science 2024-03-11 Antonio Emanuele Cinà , Kathrin Grosse , Ambra Demontis , Battista Biggio , Fabio Roli , Marcello Pelillo

Website Fingerprinting (WF) is an effective tool for regulating and governing the dark web. However, its performance can be significantly degraded by backdoor poisoning attacks in practical deployments. This paper aims to address the…

Cryptography and Security · Computer Science 2025-06-17 Yali Yuan , Kai Xu , Ruolin Ma , Yuchen Zhang

Machine Unlearning (MU) aims to selectively erase the influence of specific data points from pretrained models. However, most existing MU methods rely on the retain set to preserve model utility, which is often impractical due to privacy…

Machine Learning · Computer Science 2026-04-15 Xindi Fan , Jing Wu , Mingyi Zhou , Pengwei Liang , Mehrtash Harandi , Dinh Phung

Data poisoning is one of the most relevant security threats against machine learning and data-driven technologies. Since many applications rely on untrusted training data, an attacker can easily craft malicious samples and inject them into…

Cryptography and Security · Computer Science 2021-12-01 Nicolas M. Müller , Simon Roschmann , Konstantin Böttinger