中文
相关论文

相关论文: Towards Fair Classification against Poisoning Atta…

200 篇论文

Data poisoning is a training-time attack that undermines the trustworthiness of learned models. In a targeted data poisoning attack, an adversary manipulates the training dataset to alter the classification of a targeted test point. Given…

机器学习 · 计算机科学 2025-11-18 Nakshatra Gupta , Sumanth Prabhu , Supratik Chakraborty , R Venkatesh

As machine learning becomes widely used for automated decisions, attackers have strong incentives to manipulate the results and models generated by machine learning algorithms. In this paper, we perform the first systematic study of…

密码学与安全 · 计算机科学 2021-09-29 Matthew Jagielski , Alina Oprea , Battista Biggio , Chang Liu , Cristina Nita-Rotaru , Bo Li

Under a commonly-studied backdoor poisoning attack against classification models, an attacker adds a small trigger to a subset of the training data, such that the presence of this trigger at test time causes the classifier to always predict…

机器学习 · 计算机科学 2021-10-06 Mingjie Sun , Siddhant Agarwal , J. Zico Kolter

Machine learning algorithms are vulnerable to poisoning attacks: An adversary can inject malicious points in the training dataset to influence the learning process and degrade the algorithm's performance. Optimal poisoning attacks have…

机器学习 · 计算机科学 2019-09-26 Luis Muñoz-González , Bjarne Pfitzner , Matteo Russo , Javier Carnerero-Cano , Emil C. Lupu

Supervised learning systems are trained using historical data and, if the data was tainted by discrimination, they may unintentionally learn to discriminate against protected groups. We propose that fair learning methods, despite training…

机器学习 · 计算机科学 2026-01-22 Przemyslaw A. Grabowicz , Nicholas Perello , Kenta Takatsu

Machine learning algorithms are known to be susceptible to data poisoning attacks, where an adversary manipulates the training data to degrade performance of the resulting classifier. In this work, we present a unifying view of randomized…

机器学习 · 计算机科学 2021-02-24 Elan Rosenfeld , Ezra Winston , Pradeep Ravikumar , J. Zico Kolter

Data Poisoning (DP) is an effective attack that causes trained classifiers to misclassify their inputs. DP attacks significantly degrade a classifier's accuracy by covertly injecting attack samples into the training set. Broadly applicable…

机器学习 · 计算机科学 2022-05-13 Xi Li , David J. Miller , Zhen Xiang , George Kesidis

The unprecedented availability of training data fueled the rapid development of powerful neural networks in recent years. However, the need for such large amounts of data leads to potential threats such as poisoning attacks: adversarial…

机器学习 · 计算机科学 2024-03-21 Fabio De Gaspari , Dorjan Hitaj , Luigi V. Mancini

Deep image classification models trained on vast amounts of web-scraped data are susceptible to data poisoning - a mechanism for backdooring models. A small number of poisoned samples seen during training can severely undermine a model's…

密码学与安全 · 计算机科学 2023-06-30 Nils Lukas , Florian Kerschbaum

Targeted data poisoning attacks manipulate model predictions on specific test samples by injecting malicious data into training. Yet existing evaluations report average attack success rates over randomly selected targets, obscuring true…

机器学习 · 计算机科学 2026-05-25 William Xu , Chenyu Zhang , Yihan Wang , Matthew Y. R. Yang , Zuoqiu Liu , Gautam Kamath , Yaoliang Yu , Yiwei Lu

Property inference attacks consider an adversary who has access to the trained model and tries to extract some global statistics of the training data. In this work, we study property inference in scenarios where the adversary can…

机器学习 · 计算机科学 2021-01-28 Melissa Chase , Esha Ghosh , Saeed Mahloujifar

We consider availability data poisoning attacks, where an adversary aims to degrade the overall test accuracy of a machine learning model by crafting small perturbations to its training data. Existing poisoning strategies can achieve the…

密码学与安全 · 计算机科学 2024-06-07 Yiyong Liu , Michael Backes , Xiao Zhang

Despite the rapid development and great success of machine learning models, extensive studies have exposed their disadvantage of inheriting latent discrimination and societal bias from the training data. This phenomenon hinders their…

机器学习 · 计算机科学 2021-12-30 Tianxiang Zhao , Enyan Dai , Kai Shu , Suhang Wang

Recent attempts to achieve fairness in predictive models focus on the balance between fairness and accuracy. In sensitive applications such as healthcare or criminal justice, this trade-off is often undesirable as any increase in prediction…

机器学习 · 统计学 2018-12-12 Irene Chen , Fredrik D. Johansson , David Sontag

Classification, a heavily-studied data-driven machine learning task, drives an increasing number of prediction systems involving critical human decisions such as loan approval and criminal risk assessment. However, classifiers often…

机器学习 · 计算机科学 2022-04-12 Maliha Tashfia Islam , Anna Fariha , Alexandra Meliou , Babak Salimi

While data-driven predictive models are a strictly technological construct, they may operate within a social context in which benign engineering choices entail implicit, indirect and unexpected real-life consequences. Fairness of such…

机器学习 · 计算机科学 2024-07-11 Kacper Sokol , Meelis Kull , Jeffrey Chan , Flora Salim

Data poisoning is one of the most relevant security threats against machine learning and data-driven technologies. Since many applications rely on untrusted training data, an attacker can easily craft malicious samples and inject them into…

密码学与安全 · 计算机科学 2021-12-01 Nicolas M. Müller , Simon Roschmann , Konstantin Böttinger

The success of machine learning is fueled by the increasing availability of computing power and large training datasets. The training data is used to learn new models or update existing ones, assuming that it is sufficiently representative…

Ensuring fairness in machine learning is a critical and challenging task, as biased data representations often lead to unfair predictions. To address this, we propose Deep Fair Learning, a framework that integrates nonlinear sufficient…

机器学习 · 统计学 2025-04-10 Enze Shi , Linglong Kong , Bei Jiang

Addressing fairness concerns about machine learning models is a crucial step towards their long-term adoption in real-world automated systems. While many approaches have been developed for training fair models from data, little is known…

机器学习 · 计算机科学 2022-06-09 Nikola Konstantinov , Christoph H. Lampert