English
Related papers

Related papers: Mathematical Foundations of Poisoning Attacks on L…

200 papers

Data Poisoning (DP) is an effective attack that causes trained classifiers to misclassify their inputs. DP attacks significantly degrade a classifier's accuracy by covertly injecting attack samples into the training set. Broadly applicable…

Machine Learning · Computer Science 2022-05-13 Xi Li , David J. Miller , Zhen Xiang , George Kesidis

Federated learning (FL) enables learning a global machine learning model from local data distributed among a set of participating workers. This makes it possible i) to train more accurate models due to learning from rich joint training…

Machine Learning · Computer Science 2025-11-25 Najeeb Jebreel , Josep Domingo-Ferrer

With the increase in machine learning (ML) applications in different domains, incentives for deceiving these models have reached more than ever. As data is the core backbone of ML algorithms, attackers shifted their interest toward…

Cryptography and Security · Computer Science 2023-01-04 Kshitiz Aryal , Maanak Gupta , Mahmoud Abdelsalam

Federated learning is inherently vulnerable to model poisoning attacks because its decentralized nature allows attackers to participate with compromised devices. In model poisoning attacks, the attacker reduces the model's performance on…

Machine Learning · Computer Science 2021-12-14 Ashwinee Panda , Saeed Mahloujifar , Arjun N. Bhagoji , Supriyo Chakraborty , Prateek Mittal

Modern machine learning pipelines leverage large amounts of public data, making it infeasible to guarantee data quality and leaving models open to poisoning and backdoor attacks. Provably bounding model behavior under such attacks remains…

Machine Learning · Computer Science 2024-10-31 Philip Sosnin , Mark N. Müller , Maximilian Baader , Calvin Tsay , Matthew Wicker

Research in adversarial machine learning (AML) has shown that statistical models are vulnerable to maliciously altered data. However, despite advances in Bayesian machine learning models, most AML research remains concentrated on classical…

Machine Learning · Statistics 2025-06-04 Matthieu Carreau , Roi Naveiro , William N. Caballero

Recommender systems play a crucial role in helping users to find their interested information in various web services such as Amazon, YouTube, and Google News. Various recommender systems, ranging from neighborhood-based,…

Cryptography and Security · Computer Science 2021-01-11 Hai Huang , Jiaming Mu , Neil Zhenqiang Gong , Qi Li , Bin Liu , Mingwei Xu

Two widely used techniques for training supervised machine learning models on small datasets are Active Learning and Transfer Learning. The former helps to optimally use a limited budget to label new data. The latter uses large pre-trained…

Machine Learning · Computer Science 2021-01-28 Nicolas M. Müller , Konstantin Böttinger

This review paper takes a comprehensive look at malicious attacks against FL, categorizing them from new perspectives on attack origins and targets, and providing insights into their methodology and impact. In this survey, we focus on…

Machine Learning · Computer Science 2024-01-10 Xianghua Xie , Chen Hu , Hanchi Ren , Jingjing Deng

Recent advances in federated learning have demonstrated its promising capability to learn on decentralized datasets. However, a considerable amount of work has raised concerns due to the potential risks of adversaries participating in the…

Machine Learning · Computer Science 2022-10-25 KiYoon Yoo , Nojun Kwak

Deep image classification models trained on vast amounts of web-scraped data are susceptible to data poisoning - a mechanism for backdooring models. A small number of poisoned samples seen during training can severely undermine a model's…

Cryptography and Security · Computer Science 2023-06-30 Nils Lukas , Florian Kerschbaum

Federated Learning (FL), as a popular distributed learning paradigm, has shown outstanding performance in improving computational efficiency and protecting data privacy, and is widely applied in industrial image classification. However, due…

Machine Learning · Computer Science 2026-03-26 Tao Liu , Jiguang Lv , Dapeng Man , Weiye Xi , Yaole Li , Feiyu Zhao , Kuiming Wang , Yingchao Bian , Chen Xu , Wu Yang

Continual learning algorithms are typically exposed to untrusted sources that contain training data inserted by adversaries and bad actors. An adversary can insert a small number of poisoned samples, such as mislabeled samples from…

Machine Learning · Computer Science 2023-11-21 Huayu Li , Gregory Ditzler

Fair machine learning seeks to mitigate model prediction bias against certain demographic subgroups such as elder and female. Recently, fair representation learning (FRL) trained by deep neural networks has demonstrated superior…

Machine Learning · Computer Science 2024-03-06 Tianci Liu , Haoyu Wang , Feijie Wu , Hengtong Zhang , Pan Li , Lu Su , Jing Gao

We study a security threat to batch reinforcement learning and control where the attacker aims to poison the learned policy. The victim is a reinforcement learner / controller which first estimates the dynamics and the rewards from a batch…

Machine Learning · Computer Science 2019-11-01 Yuzhe Ma , Xuezhou Zhang , Wen Sun , Xiaojin Zhu

Semi-supervised learning methods can train high-accuracy machine learning models with a fraction of the labeled training samples required for traditional supervised learning. Such methods do not typically involve close review of the…

Machine Learning · Computer Science 2022-12-07 Marissa Connor , Vincent Emanuele

This paper proposes and investigates a new approach for detecting and preventing several different types of poisoning attacks from affecting a centralized Federated Learning model via average accuracy deviation detection (AADD). By…

Cryptography and Security · Computer Science 2022-10-28 Viktor Valadi , Madeleine Englund , Mark Spanier , Austin O'brien

The widespread adoption of generative models such as Stable Diffusion and ChatGPT has made them increasingly attractive targets for malicious exploitation, particularly through data poisoning. Existing poisoning attacks compromising…

Machine Learning · Computer Science 2025-11-10 Mathias Lundteigen Mohus , Jingyue Li , Zhirong Yang

Deep learning has become a cornerstone of modern artificial intelligence, enabling transformative applications across a wide range of domains. As the core element of deep learning, the quality and security of training data critically…

Cryptography and Security · Computer Science 2025-04-01 Pinlong Zhao , Weiyao Zhu , Pengfei Jiao , Di Gao , Ou Wu

Federated learning---multi-party, distributed learning in a decentralized environment---is vulnerable to model poisoning attacks, even more so than centralized learning approaches. This is because malicious clients can collude and send in…

Machine Learning · Computer Science 2021-10-20 Atul Sharma , Wei Chen , Joshua Zhao , Qiang Qiu , Somali Chaterji , Saurabh Bagchi