中文
相关论文

相关论文: Can Adversarially Robust Learning Leverage Computa…

200 篇论文

Adversarial attacks, e.g., adversarial perturbations of the input and adversarial samples, pose significant challenges to machine learning and deep learning techniques, including interactive recommendation systems. The latent embedding…

机器学习 · 计算机科学 2021-12-03 Siyu Wang , Yuanjiang Cao , Xiaocong Chen , Lina Yao , Xianzhi Wang , Quan Z. Sheng

We study indiscriminate poisoning for linear learners where an adversary injects a few crafted examples into the training data with the goal of forcing the induced model to incur higher test error. Inspired by the observation that linear…

机器学习 · 计算机科学 2023-11-13 Fnu Suya , Xiao Zhang , Yuan Tian , David Evans

Machine learning algorithms are known to be susceptible to data poisoning attacks, where an adversary manipulates the training data to degrade performance of the resulting classifier. In this work, we present a unifying view of randomized…

机器学习 · 计算机科学 2021-02-24 Elan Rosenfeld , Ezra Winston , Pradeep Ravikumar , J. Zico Kolter

In security-sensitive applications, the success of machine learning depends on a thorough vetting of their resistance to adversarial data. In one pertinent, well-motivated attack scenario, an adversary may attempt to evade a deployed system…

密码学与安全 · 计算机科学 2017-08-22 Battista Biggio , Igino Corona , Davide Maiorca , Blaine Nelson , Nedim Srndic , Pavel Laskov , Giorgio Giacinto , Fabio Roli

Despite the remarkable success of deep neural networks, significant concerns have emerged about their robustness to adversarial perturbations to inputs. While most attacks aim to ensure that these are imperceptible, physical perturbation…

机器学习 · 计算机科学 2020-10-09 Liang Tong , Minzhe Guo , Atul Prakash , Yevgeniy Vorobeychik

This paper examines the robustness of deployed few-shot meta-learning systems when they are fed an imperceptibly perturbed few-shot dataset. We attack amortized meta-learners, which allows us to craft colluding sets of inputs that are…

机器学习 · 计算机科学 2022-11-24 Elre T. Oldewage , John Bronskill , Richard E. Turner

Data poisoning attacks aim to manipulate the model produced by a learning algorithm by adversarially modifying the training set. We consider differential privacy as a defensive measure against this type of attack. We show that such learners…

机器学习 · 计算机科学 2019-07-08 Yuzhe Ma , Xiaojin Zhu , Justin Hsu

The rise of foundation models fine-tuned on human feedback from potentially untrusted users has increased the risk of adversarial data poisoning, necessitating the study of robustness of learning algorithms against such attacks. Existing…

机器学习 · 计算机科学 2025-02-25 Avinandan Bose , Laurent Lessard , Maryam Fazel , Krishnamurthy Dj Dvijotham

State-of-art deep neural networks (DNN) are vulnerable to attacks by adversarial examples: a carefully designed small perturbation to the input, that is imperceptible to human, can mislead DNN. To understand the root cause of adversarial…

机器学习 · 统计学 2019-10-29 Xupeng Shi , A. Adam Ding

Poisoning attacks on machine learning systems compromise the model performance by deliberately injecting malicious samples in the training dataset to influence the training process. Prior works focus on either availability attacks (i.e.,…

机器学习 · 计算机科学 2021-10-13 Bingyin Zhao , Yingjie Lao

The adversarial machine learning literature is largely partitioned into evasion attacks on testing data and poisoning attacks on training data. In this work, we show that adversarial examples, originally intended for attacking pre-trained…

机器学习 · 计算机科学 2021-06-22 Liam Fowl , Micah Goldblum , Ping-yeh Chiang , Jonas Geiping , Wojtek Czaja , Tom Goldstein

It is becoming increasingly important to understand the vulnerability of machine learning models to adversarial attacks. One of the fundamental problems in adversarial machine learning is to quantify how much training data is needed in the…

机器学习 · 计算机科学 2023-08-24 Pascale Gourdeau

Optimizing prediction accuracy can come at the expense of fairness. Towards minimizing discrimination against a group, fair machine learning algorithms strive to equalize the behavior of a model across different groups, by imposing a…

机器学习 · 统计学 2020-06-17 Hongyan Chang , Ta Duy Nguyen , Sasi Kumar Murakonda , Ehsan Kazemi , Reza Shokri

Adversarial or test time robustness measures the susceptibility of a classifier to perturbations to the test input. While there has been a flurry of recent work on designing defenses against such perturbations, the theory of adversarial…

机器学习 · 计算机科学 2020-04-29 Pranjal Awasthi , Natalie Frank , Mehryar Mohri

Recent works have shown the effectiveness of randomized smoothing as a scalable technique for building neural network-based classifiers that are provably robust to $\ell_2$-norm adversarial perturbations. In this paper, we employ…

机器学习 · 计算机科学 2020-01-13 Hadi Salman , Greg Yang , Jerry Li , Pengchuan Zhang , Huan Zhang , Ilya Razenshteyn , Sebastien Bubeck

It is becoming increasingly important to understand the vulnerability of machine learning models to adversarial attacks. In this paper we study the feasibility of robust learning from the perspective of computational learning theory,…

机器学习 · 计算机科学 2019-09-13 Pascale Gourdeau , Varun Kanade , Marta Kwiatkowska , James Worrell

In our recent work (Bubeck, Price, Razenshteyn, arXiv:1805.10204) we argued that adversarial examples in machine learning might be due to an inherent computational hardness of the problem. More precisely, we constructed a binary…

机器学习 · 计算机科学 2018-11-16 Sébastien Bubeck , Yin Tat Lee , Eric Price , Ilya Razenshteyn

Adversarial training (AT) is a robust learning algorithm that can defend against adversarial attacks in the inference phase and mitigate the side effects of corrupted data in the training phase. As such, it has become an indispensable…

密码学与安全 · 计算机科学 2023-05-02 Jingfeng Zhang , Bo Song , Bo Han , Lei Liu , Gang Niu , Masashi Sugiyama

Predictions of certifiably robust classifiers remain constant in a neighborhood of a point, making them resilient to test-time attacks with a guarantee. In this work, we present a previously unrecognized threat to robust machine learning…

机器学习 · 计算机科学 2021-03-31 Akshay Mehra , Bhavya Kailkhura , Pin-Yu Chen , Jihun Hamm

This study investigates a counterintuitive phenomenon in adversarial machine learning: the potential for noise-based defenses to inadvertently aid evasion attacks in certain scenarios. While randomness is often employed as a defensive…

密码学与安全 · 计算机科学 2024-11-01 Steve Bakos , Pooria Madani , Heidar Davoudi