English
Related papers

Related papers: Learning under $p$-Tampering Attacks

200 papers

Contrastive learning pre-trains an image encoder using a large amount of unlabeled data such that the image encoder can be used as a general-purpose feature extractor for various downstream tasks. In this work, we propose PoisonedEncoder, a…

Cryptography and Security · Computer Science 2023-01-04 Hongbin Liu , Jinyuan Jia , Neil Zhenqiang Gong

Approximate learning machines have become popular in the era of small devices, including quantised, factorised, hashed, or otherwise compressed predictors, and the quest to explain and guarantee good generalisation abilities for such…

Machine Learning · Computer Science 2022-03-16 Andrew J. Turner , Ata Kabán

We consider the vulnerability of fairness-constrained learning to small amounts of malicious noise in the training data. Konstantinov and Lampert (2021) initiated the study of this question and presented negative results showing there exist…

Machine Learning · Computer Science 2024-08-26 Avrim Blum , Princewill Okoroafor , Aadirupa Saha , Kevin Stangl

Federated learning security research has predominantly focused on backdoor threats from a minority of malicious clients that intentionally corrupt model updates. This paper challenges this paradigm by investigating a more pervasive and…

Cryptography and Security · Computer Science 2026-02-18 Haodong Zhao , Jinming Hu , Gongshen Liu

Backdoor attacks mislead machine-learning models to output an attacker-specified class when presented a specific trigger at test time. These attacks require poisoning the training data to compromise the learning algorithm, e.g., by…

Machine Learning · Computer Science 2021-11-03 Kathrin Grosse , Taesung Lee , Battista Biggio , Youngja Park , Michael Backes , Ian Molloy

Recent studies demonstrated the vulnerability of control policies learned through deep reinforcement learning against adversarial attacks, raising concerns about the application of such models to risk-sensitive tasks such as autonomous…

Machine Learning · Computer Science 2022-03-10 Prasanth Buddareddygari , Travis Zhang , Yezhou Yang , Yi Ren

In autonomous driving, behavior prediction is fundamental for safe motion planning, hence the security and robustness of prediction models against adversarial attacks are of paramount importance. We propose a novel adversarial backdoor…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Mozhgan Pourkeshavarz , Mohammad Sabokrou , Amir Rasouli

At present, backdoor attacks attract attention as they do great harm to deep learning models. The adversary poisons the training data making the model being injected with a backdoor after being trained unconsciously by victims using the…

Cryptography and Security · Computer Science 2023-03-06 Shengfang Zhai , Qingni Shen , Xiaoyi Chen , Weilong Wang , Cong Li , Yuejian Fang , Zhonghai Wu

Recent advances in machine learning (ML) algorithms, especially deep neural networks (DNNs), have demonstrated remarkable success (sometimes exceeding human-level performance) on several tasks, including face and speech recognition.…

Machine Learning · Computer Science 2020-03-04 Yue Gao , Harrison Rosenberg , Kassem Fawaz , Somesh Jha , Justin Hsu

Text classifiers are vulnerable to adversarial examples -- correctly-classified examples that are deliberately transformed to be misclassified while satisfying acceptability constraints. The conventional approach to finding adversarial…

Computation and Language · Computer Science 2024-05-21 Tom Roth , Inigo Jauregi Unanue , Alsharif Abuadbba , Massimo Piccardi

Several years of research have shown that machine-learning systems are vulnerable to adversarial examples, both in theory and in practice. Until now, such attacks have primarily targeted visual models, exploiting the gap between human and…

Computation and Language · Computer Science 2021-12-14 Nicholas Boucher , Ilia Shumailov , Ross Anderson , Nicolas Papernot

Despite their performance, Artificial Neural Networks are not reliable enough for most of industrial applications. They are sensitive to noises, rotations, blurs and adversarial examples. There is a need to build defenses that protect…

Machine Learning · Computer Science 2020-08-20 Alfred Laugros , Alice Caplier , Matthieu Ospici

Deep learning models are vulnerable to various adversarial manipulations of their training data, parameters, and input sample. In particular, an adversary can modify the training data and model parameters to embed backdoors into the model,…

Machine Learning · Computer Science 2020-06-09 Te Juin Lester Tan , Reza Shokri

Poisoning-based backdoor attacks expose vulnerabilities in the data preparation stage of deep neural network (DNN) training. The DNNs trained on the poisoned dataset will be embedded with a backdoor, making them behave well on clean data…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Binxiao Huang , Jason Chun Lok , Chang Liu , Ngai Wong

The recent success of machine learning (ML) has been fueled by the increasing availability of computing power and large amounts of data in many different applications. However, the trustworthiness of the resulting models can be compromised…

Cryptography and Security · Computer Science 2024-03-11 Antonio Emanuele Cinà , Kathrin Grosse , Ambra Demontis , Battista Biggio , Fabio Roli , Marcello Pelillo

Black box attacks, where adversaries have limited knowledge of the target model, pose a significant threat to machine learning systems. Adversarial examples generated with a substitute model often suffer from limited transferability to the…

Machine Learning · Computer Science 2024-10-22 Bar Avraham , Yisroel Mirsky

Adversarial examples represent a serious issue for the application of machine learning models in many sensitive domains. For generating adversarial examples, decision based black-box attacks are one of the most practical techniques as they…

Machine Learning · Computer Science 2024-11-20 Nicole Meng , Caleb Manicke , David Chen , Yingjie Lao , Caiwen Ding , Pengyu Hong , Kaleel Mahmood

The concept of learned index structures relies on the idea that the input-output functionality of a database index can be viewed as a prediction task and, thus, be implemented using a machine learning model instead of traditional…

Cryptography and Security · Computer Science 2022-03-01 Evgenios M. Kornaropoulos , Silei Ren , Roberto Tamassia

In spam and malware detection, attackers exploit randomization to obfuscate malicious data and increase their chances of evading detection at test time; e.g., malware code is typically obfuscated using random strings or byte sequences to…

Machine Learning · Computer Science 2016-09-07 Samuel Rota Bulò , Battista Biggio , Ignazio Pillai , Marcello Pelillo , Fabio Roli

In recent years, deep neural networks demonstrated state-of-the-art performance in a large variety of tasks and therefore have been adopted in many applications. On the other hand, the latest studies revealed that neural networks are…

Computer Vision and Pattern Recognition · Computer Science 2018-12-07 Jingyang Zhang , Hsin-Pai Cheng , Chunpeng Wu , Hai Li , Yiran Chen