English
Related papers

Related papers: Phantom Transfer: Data-level Defences are Insuffic…

200 papers

Federated Learning (FL) has recently emerged as a revolutionary approach to collaborative training Machine Learning models. In particular, it enables decentralized model training while preserving data privacy, but its distributed nature…

Cryptography and Security · Computer Science 2025-12-30 Sameera K. M. , Serena Nicolazzo , Antonino Nocera , Vinod P. , Rafidha Rehiman K. A

Federated learning is inherently vulnerable to model poisoning attacks because its decentralized nature allows attackers to participate with compromised devices. In model poisoning attacks, the attacker reduces the model's performance on…

Machine Learning · Computer Science 2021-12-14 Ashwinee Panda , Saeed Mahloujifar , Arjun N. Bhagoji , Supriyo Chakraborty , Prateek Mittal

To promote secure and private artificial intelligence (SPAI), we review studies on the model security and data privacy of DNNs. Model security allows system to behave as intended without being affected by malicious external influences that…

Cryptography and Security · Computer Science 2021-03-11 Ho Bae , Jaehee Jang , Dahuin Jung , Hyemi Jang , Heonseok Ha , Hyungyu Lee , Sungroh Yoon

Covert communication has become an important area of research in computer security. It involves hiding specific information on a carrier for message transmission and is often used to transmit private data, military secrets, and even…

Machine Learning · Computer Science 2023-06-05 Junchuan Liang , Rong Wang

The growing reliance of intelligent systems on data makes the systems vulnerable to data poisoning attacks. Such attacks could compromise machine learning or deep learning models by disrupting the input data. Previous studies on data…

Optimization and Control · Mathematics 2025-05-19 Xin Wang , Feilong Wang , Yuan Hong , R. Tyrrell Rockafellar , Xuegang , Ban

Ensuring the reliability of machine learning-based intrusion detection systems remains a critical challenge in Internet of Things (IoT) environments, particularly as data poisoning attacks increasingly threaten the integrity of model…

Modern machine learning increasingly requires training on a large collection of data from multiple sources, not all of which can be trusted. A particularly concerning scenario is when a small fraction of poisoned data changes the behavior…

Machine Learning · Computer Science 2021-04-26 Jonathan Hayase , Weihao Kong , Raghav Somani , Sewoong Oh

Various attack methods against recommender systems have been proposed in the past years, and the security issues of recommender systems have drawn considerable attention. Traditional attacks attempt to make target items recommended to as…

Information Retrieval · Computer Science 2025-11-11 Dazhong Rong , Qinming He , Jianhai Chen

While recent works have indicated that federated learning (FL) may be vulnerable to poisoning attacks by compromised clients, their real impact on production FL systems is not fully understood. In this work, we aim to develop a…

Machine Learning · Computer Science 2021-12-14 Virat Shejwalkar , Amir Houmansadr , Peter Kairouz , Daniel Ramage

Many machine learning models are vulnerable to adversarial examples: inputs that are specially crafted to cause a machine learning model to produce an incorrect output. Adversarial examples that affect one model often affect another model,…

Cryptography and Security · Computer Science 2016-05-25 Nicolas Papernot , Patrick McDaniel , Ian Goodfellow

The ability to transfer adversarial attacks from one model (the surrogate) to another model (the victim) has been an issue of concern within the machine learning (ML) community. The ability to successfully evade unseen models represents an…

Machine Learning · Computer Science 2021-09-28 Luke E. Richards , André Nguyen , Ryan Capps , Steven Forsythe , Cynthia Matuszek , Edward Raff

When an adversary provides poison samples to a machine learning model, privacy leakage, such as membership inference attacks that infer whether a sample was included in the training of the model, becomes effective by moving the sample to an…

Cryptography and Security · Computer Science 2023-03-23 Yumeki Goto , Nami Ashizawa , Toshiki Shibahara , Naoto Yanai

Large language models are pre-trained on uncurated text datasets consisting of trillions of tokens scraped from the Web. Prior work has shown that: (1) web-scraped pre-training datasets can be practically poisoned by malicious actors; and…

Cryptography and Security · Computer Science 2024-10-18 Yiming Zhang , Javier Rando , Ivan Evtimov , Jianfeng Chi , Eric Michael Smith , Nicholas Carlini , Florian Tramèr , Daphne Ippolito

Backdoor attack against image classification task has been widely studied and proven to be successful, while there exist little research on the backdoor attack against vision-language models. In this paper, we explore backdoor attack…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Meiling Li , Nan Zhong , Xinpeng Zhang , Zhenxing Qian , Sheng Li

Recently, self-supervised learning (SSL) was shown to be vulnerable to patch-based data poisoning backdoor attacks. It was shown that an adversary can poison a small part of the unlabeled data so that when a victim trains an SSL model on…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Ajinkya Tejankar , Maziar Sanjabi , Qifan Wang , Sinong Wang , Hamed Firooz , Hamed Pirsiavash , Liang Tan

Machine learning models are brittle, and small changes in the training data can result in different predictions. We study the problem of proving that a prediction is robust to data poisoning, where an attacker can inject a number of…

Programming Languages · Computer Science 2020-06-25 Samuel Drews , Aws Albarghouthi , Loris D'Antoni

Federated Learning (FL) allows multiple clients to collaboratively train a Neural Network (NN) model on their private data without revealing the data. Recently, several targeted poisoning attacks against FL have been introduced. These…

Cryptography and Security · Computer Science 2022-01-04 Phillip Rieger , Thien Duc Nguyen , Markus Miettinen , Ahmad-Reza Sadeghi

Recent advances in federated learning have demonstrated its promising capability to learn on decentralized datasets. However, a considerable amount of work has raised concerns due to the potential risks of adversaries participating in the…

Machine Learning · Computer Science 2022-10-25 KiYoon Yoo , Nojun Kwak

Model poisoning attacks on federated learning (FL) intrude in the entire system via compromising an edge model, resulting in malfunctioning of machine learning models. Such compromised models are tampered with to perform adversary-desired…

Machine Learning · Computer Science 2022-05-11 Yuwei Sun , Hideya Ochiai , Jun Sakuma

Poisoning attacks, in which an attacker adversarially manipulates the training dataset of a machine learning (ML) model, pose a significant threat to ML security. Beta Poisoning is a recently proposed poisoning attack that disrupts model…

Cryptography and Security · Computer Science 2025-08-05 Nilufer Gulciftci , M. Emre Gursoy