English
Related papers

Related papers: A Framework of Randomized Selection Based Certifie…

200 papers

With deep neural networks providing state-of-the-art machine learning models for numerous machine learning tasks, quantifying the robustness of these models has become an important area of research. However, most of the research literature…

Machine Learning · Computer Science 2019-01-08 Tsui-Wei Weng , Pin-Yu Chen , Lam M. Nguyen , Mark S. Squillante , Ivan Oseledets , Luca Daniel

Regression models, which are widely used from engineering applications to financial forecasting, are vulnerable to targeted malicious attacks such as training data poisoning, through which adversaries can manipulate their predictions.…

Machine Learning · Computer Science 2020-08-24 Sandamal Weerasinghe , Sarah M. Erfani , Tansu Alpcan , Christopher Leckie , Justin Kopacz

Patch adversarial attacks on images, in which the attacker can distort pixels within a region of bounded size, are an important threat model since they provide a quantitative model for physical adversarial attacks. In this paper, we…

Machine Learning · Computer Science 2021-01-11 Alexander Levine , Soheil Feizi

Deep Neural Network-based systems are now the state-of-the-art in many robotics tasks, but their application in safety-critical domains remains dangerous without formal guarantees on network robustness. Small perturbations to sensor inputs…

Robotics · Computer Science 2020-03-10 Björn Lütjens , Michael Everett , Jonathan P. How

Deep neural networks are known to be vulnerable to adversarial attacks. Current methods of defense from such attacks are based on either implicit or explicit regularization, e.g., adversarial training. Randomized smoothing, the averaging of…

Machine learning models are vulnerable to data-poisoning attacks, in which an attacker maliciously modifies the training set to change the prediction of a learned model. In a trigger-less attack, the attacker can modify the training set but…

Machine Learning · Computer Science 2022-10-18 Yuhao Zhang , Aws Albarghouthi , Loris D'Antoni

Machine learning algorithms are effective in several applications, but they are not as much successful when applied to intrusion detection in cyber security. Due to the high sensitivity to their training data, cyber detectors based on…

Cryptography and Security · Computer Science 2021-06-15 Giovanni Apruzzese , Mauro Andreolini , Michele Colajanni , Mirco Marchetti

There has been considerable and growing interest in applying machine learning for cyber defenses. One promising approach has been to apply natural language processing techniques to analyze logs data for suspicious behavior. A natural…

Machine Learning · Computer Science 2020-07-30 Kai Steverson , Jonathan Mullin , Metin Ahiskali

It is becoming increasingly imperative to design robust ML defenses. However, recent work has found that many defenses that initially resist state-of-the-art attacks can be broken by an adaptive adversary. In this work we take steps to…

Machine Learning · Computer Science 2023-02-28 Keane Lucas , Matthew Jagielski , Florian Tramèr , Lujo Bauer , Nicholas Carlini

Neural networks are susceptible to data inference attacks such as the model inversion attack and the membership inference attack, where the attacker could infer the reconstruction and the membership of a data sample from the confidence…

Cryptography and Security · Computer Science 2020-08-21 Ziqi Yang , Bin Shao , Bohan Xuan , Ee-Chien Chang , Fan Zhang

We study backdoor poisoning attacks against image classification networks, whereby an attacker inserts a trigger into a subset of the training data, in such a way that at test time, this trigger causes the classifier to predict some target…

Cryptography and Security · Computer Science 2022-02-03 Muhammad Usman , Youcheng Sun , Divya Gopinath , Corina S. Pasareanu

While recent works have indicated that federated learning (FL) may be vulnerable to poisoning attacks by compromised clients, their real impact on production FL systems is not fully understood. In this work, we aim to develop a…

Machine Learning · Computer Science 2021-12-14 Virat Shejwalkar , Amir Houmansadr , Peter Kairouz , Daniel Ramage

This study investigates a counterintuitive phenomenon in adversarial machine learning: the potential for noise-based defenses to inadvertently aid evasion attacks in certain scenarios. While randomness is often employed as a defensive…

Cryptography and Security · Computer Science 2024-11-01 Steve Bakos , Pooria Madani , Heidar Davoudi

In a poisoning attack, an adversary with control over a small fraction of the training data attempts to select that data in a way that induces a corrupted model that misbehaves in favor of the adversary. We consider poisoning attacks…

Machine Learning · Computer Science 2021-04-22 Fnu Suya , Saeed Mahloujifar , Anshuman Suri , David Evans , Yuan Tian

In this paper, we study PAC learnability and certification of predictions under instance-targeted poisoning attacks, where the adversary who knows the test instance may change a fraction of the training set with the goal of fooling the…

Machine Learning · Computer Science 2021-08-10 Ji Gao , Amin Karbasi , Mohammad Mahmoody

Recent research has successfully demonstrated new types of data poisoning attacks. To address this problem, some researchers have proposed both offline and online data poisoning detection defenses which employ machine learning algorithms to…

Cryptography and Security · Computer Science 2021-05-24 Jack W. Stokes , Paul England , Kevin Kane

In this paper, we address a problem of machine learning system vulnerability to adversarial attacks. We propose and investigate a Key based Diversified Aggregation (KDA) mechanism as a defense strategy. The KDA assumes that the attacker (i)…

Machine Learning · Computer Science 2019-05-15 Olga Taran , Shideh Rezaeifar , Taras Holotyak , Slava Voloshynovskiy

A powerful category of (invisible) data poisoning attacks modify a subset of training examples by small adversarial perturbations to change the prediction of certain test-time data. Existing defense mechanisms are not desirable to deploy in…

Cryptography and Security · Computer Science 2023-07-21 Tian Yu Liu , Yu Yang , Baharan Mirzasoleiman

Machine learning-based malware detection is known to be vulnerable to adversarial evasion attacks. The state-of-the-art is that there are no effective defenses against these attacks. As a response to the adversarial malware classification…

Cryptography and Security · Computer Science 2021-01-18 Deqiang Li , Qianmu Li , Yanfang Ye , Shouhuai Xu

Graph neural networks (GNNs) are becoming the de facto method to learn on the graph data and have achieved the state-of-the-art on node and graph classification tasks. However, recent works show GNNs are vulnerable to training-time…

Machine Learning · Computer Science 2025-03-25 Jiate Li , Meng Pang , Yun Dong , Binghui Wang