English
Related papers

Related papers: Generalizable Targeted Data Poisoning against Vary…

200 papers

Learning reward models from pairwise comparisons is a fundamental component in a number of domains, including autonomous control, conversational agents, and recommendation systems, as part of a broad goal of aligning automated decisions…

Machine Learning · Computer Science 2024-10-10 Junlin Wu , Jiongxiao Wang , Chaowei Xiao , Chenguang Wang , Ning Zhang , Yevgeniy Vorobeychik

Machine learning is vulnerable to a wide variety of attacks. It is now well understood that by changing the underlying data distribution, an adversary can poison the model trained with it or introduce backdoors. In this paper we present a…

Machine Learning · Computer Science 2021-06-08 Ilia Shumailov , Zakhar Shumaylov , Dmitry Kazhdan , Yiren Zhao , Nicolas Papernot , Murat A. Erdogdu , Ross Anderson

Federated learning is a promising direction to tackle the privacy issues related to sharing patients' sensitive data. Often, federated systems in the medical image analysis domain assume that the participating local clients are…

Machine Learning · Computer Science 2023-08-16 Indu Joshi , Priyank Upadhya , Gaurav Kumar Nayak , Peter Schüffler , Nassir Navab

Under a commonly-studied backdoor poisoning attack against classification models, an attacker adds a small trigger to a subset of the training data, such that the presence of this trigger at test time causes the classifier to always predict…

Machine Learning · Computer Science 2021-10-06 Mingjie Sun , Siddhant Agarwal , J. Zico Kolter

In big data era, machine learning is one of fundamental techniques in intrusion detection systems (IDSs). However, practical IDSs generally update their decision module by feeding new data then retraining learning models in a periodical…

Machine Learning · Computer Science 2018-03-13 Pan Li , Qiang Liu , Wentao Zhao , Dongxu Wang , Siqi Wang

Modern neural networks are often trained on massive datasets that are web scraped with minimal human inspection. As a result of this insecure curation pipeline, an adversary can poison or backdoor the resulting model by uploading malicious…

The rapidly expanding number of Internet of Things (IoT) devices is generating huge quantities of data, but the data privacy and security exposure in IoT devices, especially in the automatic driving system. Federated learning (FL) is a…

Cryptography and Security · Computer Science 2022-09-15 Jiayin Li , Wenzhong Guo , Xingshuo Han , Jianping Cai , Ximeng Liu

While state-of-the-art general object detectors are getting better and better, there are not many systems specifically designed to take advantage of the instance detection problem. For many applications, such as household robotics, a system…

Computer Vision and Pattern Recognition · Computer Science 2019-10-02 Phil Ammirato , Cheng-Yang Fu , Mykhailo Shvets , Jana Kosecka , Alexander C. Berg

Model adaptation tackles the distribution shift problem with a pre-trained model instead of raw data, which has become a popular paradigm due to its great privacy protection. Existing methods always assume adapting to a clean target domain,…

Cryptography and Security · Computer Science 2025-02-18 Lijun Sheng , Jian Liang , Ran He , Zilei Wang , Tieniu Tan

Federated learning (FL) combined with local differential privacy (LDP) enables privacy-preserving model training across decentralized data sources. However, the decentralized data-management paradigm leaves LDPFL vulnerable to participants…

Cryptography and Security · Computer Science 2025-09-08 Zijian Wang , Wei Tong , Tingxuan Han , Haoyu Chen , Tianling Zhang , Yunlong Mao , Sheng Zhong

The performance of machine learning models depends on the quality of the underlying data. Malicious actors can attack the model by poisoning the training data. Current detectors are tied to either specific data types, models, or attacks,…

Cryptography and Security · Computer Science 2023-10-26 Xinglong Chang , Katharina Dost , Gillian Dobbie , Jörg Wicker

We show that by controlling parts of a physical environment in which a pre-trained deep neural network (DNN) is being fine-tuned online, an adversary can launch subtle data poisoning attacks that degrade the performance of the system. While…

Machine Learning · Computer Science 2020-12-08 Naman Patel , Prashanth Krishnamurthy , Siddharth Garg , Farshad Khorrami

This work introduces a verification framework that provides both sound and complete guarantees for data poisoning attacks during neural network training. We formulate adversarial data manipulation, model training, and test-time evaluation…

Machine Learning · Computer Science 2026-02-20 Philip Sosnin , Jodie Knapp , Fraser Kennedy , Josh Collyer , Calvin Tsay

Object detection is a critical task in computer vision, with applications in various domains such as autonomous driving and urban scene monitoring. However, deep learning-based approaches often demand large volumes of annotated data, which…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Hao Li , Xiangyuan Yang , Mengzhu Wang , Long Lan , Ke Liang , Xinwang Liu , Kenli Li

Decentralised post-training of large language models utilises data and pipeline parallelism techniques to split the data and the model. Unfortunately, decentralised post-training can be vulnerable to poisoning and backdoor attacks by one or…

Cryptography and Security · Computer Science 2026-04-06 Oğuzhan Ersoy , Nikolay Blagoev , Jona te Lintelo , Stefanos Koffas , Marina Krček , Stjepan Picek

We use distributionally-robust optimization for machine learning to mitigate the effect of data poisoning attacks. We provide performance guarantees for the trained model on the original data (not including the poison records) by training…

Machine Learning · Computer Science 2020-01-30 Farhad Farokhi

Recommender systems have been shown to be vulnerable to poisoning attacks, where malicious data is injected into the dataset to cause the recommender system to provide biased recommendations. To defend against such attacks, various robust…

Machine Learning · Computer Science 2023-10-02 Yichang Xu , Chenwang Wu , Defu Lian

We investigate a family of poisoning attacks against Support Vector Machines (SVM). Such attacks inject specially crafted training data that increases the SVM's test error. Central to the motivation for these attacks is the fact that most…

Machine Learning · Computer Science 2013-03-26 Battista Biggio , Blaine Nelson , Pavel Laskov

Recent research has successfully demonstrated new types of data poisoning attacks. To address this problem, some researchers have proposed both offline and online data poisoning detection defenses which employ machine learning algorithms to…

Cryptography and Security · Computer Science 2021-05-24 Jack W. Stokes , Paul England , Kevin Kane

There has been recent interest in leveraging federated learning (FL) for radio signal classification tasks. In FL, model parameters are periodically communicated from participating devices, training on their own local datasets, to a central…

Signal Processing · Electrical Eng. & Systems 2023-01-24 Su Wang , Rajeev Sahay , Christopher G. Brinton