English
Related papers

Related papers: Provably effective detection of effective data poi…

200 papers

The perturbation analysis of linear solvers applied to systems arising broadly in machine learning settings -- for instance, when using linear regression models -- establishes an important perspective when reframing these analyses through…

Machine Learning · Computer Science 2024-10-02 Yixin Liu , Arielle Carr , Lichao Sun

Recommender systems play a crucial role in helping users to find their interested information in various web services such as Amazon, YouTube, and Google News. Various recommender systems, ranging from neighborhood-based,…

Cryptography and Security · Computer Science 2021-01-11 Hai Huang , Jiaming Mu , Neil Zhenqiang Gong , Qi Li , Bin Liu , Mingwei Xu

Conformal prediction is a flexible framework for calibrating machine learning predictions, providing distribution-free statistical guarantees. In outlier detection, this calibration relies on a reference set of labeled inlier data to…

Machine Learning · Statistics 2025-06-17 Meshi Bashari , Matteo Sesia , Yaniv Romano

In this paper, we study PAC learnability and certification of predictions under instance-targeted poisoning attacks, where the adversary who knows the test instance may change a fraction of the training set with the goal of fooling the…

Machine Learning · Computer Science 2021-08-10 Ji Gao , Amin Karbasi , Mohammad Mahmoody

Adversarial data poisoning is an effective attack against machine learning and threatens model integrity by introducing poisoned data into the training dataset. So far, it has been studied mostly for classification, even though regression…

Machine Learning · Computer Science 2020-09-16 Nicolas Michael Müller , Daniel Kowatsch , Konstantin Böttinger

Machine learning models are brittle, and small changes in the training data can result in different predictions. We study the problem of proving that a prediction is robust to data poisoning, where an attacker can inject a number of…

Programming Languages · Computer Science 2020-06-25 Samuel Drews , Aws Albarghouthi , Loris D'Antoni

Neural networks are successfully used in a variety of applications, many of them having safety and security concerns. As a result researchers have proposed formal verification techniques for verifying neural network properties. While…

Cryptography and Security · Computer Science 2022-05-10 Youcheng Sun , Muhammad Usman , Divya Gopinath , Corina S. Păsăreanu

Healthcare IoMT systems are becoming intelligent, miniaturized, and more integrated into daily life. As for the distributed devices in the IoMT, federated learning has become a topical area with cloud-based training procedures when meeting…

Cryptography and Security · Computer Science 2022-11-04 Chong Chen , Ying Gao , Leyu Shi , Siquan Huang

In this paper, we investigate data-driven attack detection and identification in a model-free setting. We consider a practically motivated scenario in which the available dataset may be compromised by malicious sensor attacks, but contains…

Systems and Control · Electrical Eng. & Systems 2026-02-09 Takumi Shinohara , Karl H. Johansson , Henrik Sandberg

Deep neural networks are susceptible to poisoning attacks by purposely polluted training data with specific triggers. As existing episodes mainly focused on attack success rate with patch-based samples, defense algorithms can easily detect…

Cryptography and Security · Computer Science 2021-01-11 Jinyin Chen , Longyuan Zhang , Haibin Zheng , Xueke Wang , Zhaoyan Ming

Poisoning attacks pose an increasing threat to the security and robustness of Artificial Intelligence systems in the military domain. The widespread use of open-source datasets and pretrained models exacerbates this risk. Despite the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Alma M. Liezenga , Stefan Wijnja , Puck de Haan , Niels W. T. Brink , Jip J. van Stijn , Yori Kamphuis , Klamer Schutte

We study backdoor poisoning attacks against image classification networks, whereby an attacker inserts a trigger into a subset of the training data, in such a way that at test time, this trigger causes the classifier to predict some target…

Cryptography and Security · Computer Science 2022-02-03 Muhammad Usman , Youcheng Sun , Divya Gopinath , Corina S. Pasareanu

In this paper, we proposed a general framework for data poisoning attacks to graph-based semi-supervised learning (G-SSL). In this framework, we first unify different tasks, goals, and constraints into a single formula for data poisoning…

Machine Learning · Computer Science 2019-11-01 Xuanqing Liu , Si Si , Xiaojin Zhu , Yang Li , Cho-Jui Hsieh

Deep learning has become a cornerstone of modern artificial intelligence, enabling transformative applications across a wide range of domains. As the core element of deep learning, the quality and security of training data critically…

Cryptography and Security · Computer Science 2025-04-01 Pinlong Zhao , Weiyao Zhu , Pengfei Jiao , Di Gao , Ou Wu

Instruction fine-tuning attacks pose a serious threat to large language models (LLMs) by subtly embedding poisoned examples in fine-tuning datasets, leading to harmful or unintended behaviors in downstream applications. Detecting such…

Machine Learning · Computer Science 2026-02-02 Jiawei Li

Modern machine learning pipelines leverage large amounts of public data, making it infeasible to guarantee data quality and leaving models open to poisoning and backdoor attacks. Provably bounding model behavior under such attacks remains…

Machine Learning · Computer Science 2024-10-31 Philip Sosnin , Mark N. Müller , Maximilian Baader , Calvin Tsay , Matthew Wicker

Dataset ownership verification, the process of determining if a dataset is used in a model's training data, is necessary for detecting unauthorized data usage and data contamination. Existing approaches, such as backdoor watermarking, rely…

Cryptography and Security · Computer Science 2025-12-09 Wassim Bouaziz , Nicolas Usunier , El-Mahdi El-Mhamdi

The aim of dataset distillation is to encode the rich features of an original dataset into a tiny dataset. It is a promising approach to accelerate neural network training and related studies. Different approaches have been proposed to…

Machine Learning · Computer Science 2023-05-30 Zongxiong Chen , Jiahui Geng , Derui Zhu , Herbert Woisetschlaeger , Qing Li , Sonja Schimmler , Ruben Mayer , Chunming Rong

Ensuring the reliability of machine learning-based intrusion detection systems remains a critical challenge in Internet of Things (IoT) environments, particularly as data poisoning attacks increasingly threaten the integrity of model…

The term dataset shift refers to the situation where the data used to train a machine learning model is different from where the model operates. While several types of shifts naturally occur, existing shift detectors are usually designed to…

Machine Learning · Computer Science 2021-06-29 Simona Maggio , Léo Dreyfus-Schmidt