中文
相关论文

相关论文: Robust or Private? Adversarial Training Makes Mode…

200 篇论文

Adversarial examples are malicious inputs designed to fool machine learning models. They often transfer from one model to another, allowing attackers to mount black box attacks without knowledge of the target model's parameters. Adversarial…

计算机视觉与模式识别 · 计算机科学 2017-02-14 Alexey Kurakin , Ian Goodfellow , Samy Bengio

While deep neural networks have achieved remarkable success in various computer vision tasks, they often fail to generalize to new domains and subtle variations of input images. Several defenses have been proposed to improve the robustness…

计算机视觉与模式识别 · 计算机科学 2021-09-08 Omid Poursaeed , Tianxing Jiang , Harry Yang , Serge Belongie , SerNam Lim

We study the difficulties in learning that arise from robust and differentially private optimization. We first study convergence of gradient descent based adversarial training with differential privacy, taking a simple binary classification…

机器学习 · 计算机科学 2022-01-10 Jamie Hayes , Borja Balle , M. Pawan Kumar

This paper studies model-inversion attacks, in which the access to a model is abused to infer information about the training data. Since its first introduction, such attacks have raised serious concerns given that training data usually…

机器学习 · 计算机科学 2020-04-21 Yuheng Zhang , Ruoxi Jia , Hengzhi Pei , Wenxiao Wang , Bo Li , Dawn Song

Adversarial training and its variants have become de facto standards for learning robust deep neural networks. In this paper, we explore the landscape around adversarial training in a bid to uncover its limits. We systematically study the…

机器学习 · 统计学 2021-03-31 Sven Gowal , Chongli Qin , Jonathan Uesato , Timothy Mann , Pushmeet Kohli

DNNs' demand for massive data forces practitioners to collect data from the Internet without careful check due to the unacceptable cost, which brings potential risks of backdoor attacks. A backdoored model always predicts a target class in…

机器学习 · 计算机科学 2022-02-23 Yinghua Gao , Dongxian Wu , Jingfeng Zhang , Guanhao Gan , Shu-Tao Xia , Gang Niu , Masashi Sugiyama

Given access to a machine learning model, can an adversary reconstruct the model's training data? This work studies this question from the lens of a powerful informed adversary who knows all the training data points except one. By…

密码学与安全 · 计算机科学 2022-04-26 Borja Balle , Giovanni Cherubin , Jamie Hayes

Adversarial training can considerably robustify deep neural networks to resist adversarial attacks. However, some works suggested that adversarial training might comprise the privacy-preserving and generalization abilities. This paper…

机器学习 · 计算机科学 2020-12-29 Fengxiang He , Shaopeng Fu , Bohan Wang , Dacheng Tao

Neural networks are susceptible to adversarial examples-small input perturbations that cause models to fail. Adversarial training is one of the solutions that stops adversarial examples; models are exposed to attacks during training and…

机器学习 · 计算机科学 2022-07-05 Maximilian Kaufmann , Yiren Zhao , Ilia Shumailov , Robert Mullins , Nicolas Papernot

Although current deep learning techniques have yielded superior performance on various computer vision tasks, yet they are still vulnerable to adversarial examples. Adversarial training and its variants have been shown to be the most…

计算机视觉与模式识别 · 计算机科学 2022-11-02 Junhao Dong , Seyed-Mohsen Moosavi-Dezfooli , Jianhuang Lai , Xiaohua Xie

While deep learning has led to remarkable results on a number of challenging problems, researchers have discovered a vulnerability of neural networks in adversarial settings, where small but carefully chosen perturbations to the input can…

神经与进化计算 · 计算机科学 2018-11-26 Edward Grefenstette , Robert Stanforth , Brendan O'Donoghue , Jonathan Uesato , Grzegorz Swirszcz , Pushmeet Kohli

Recent attacks on Machine Learning (ML) models such as evasion attacks with adversarial examples and models stealing through extraction attacks pose several security and privacy threats. Prior work proposes to use adversarial training to…

机器学习 · 计算机科学 2022-08-23 Kacem Khaled , Gabriela Nicolescu , Felipe Gohring de Magalhães

Adversarial robustness, the ability of a model to withstand manipulated inputs that cause errors, is essential for ensuring the trustworthiness of machine learning models in real-world applications. However, previous studies have shown that…

机器学习 · 计算机科学 2025-08-26 Xiaoyu Luo , Qiongxiu Li

With the increasing adoption of AI, inherent security and privacy vulnerabilities formachine learning systems are being discovered. One such vulnerability makes itpossible for an adversary to obtain private information about the types of…

机器学习 · 计算机科学 2019-10-11 Samyadeep Basu , Rauf Izmailov , Chris Mesterharm

Pretrained models from self-supervision are prevalently used in fine-tuning downstream tasks faster or for better accuracy. However, gaining robustness from pretraining is left unexplored. We introduce adversarial training into…

计算机视觉与模式识别 · 计算机科学 2020-03-31 Tianlong Chen , Sijia Liu , Shiyu Chang , Yu Cheng , Lisa Amini , Zhangyang Wang

Adversarial training is a popular method to robustify models against adversarial attacks. However, it exhibits much more severe overfitting than training on clean inputs. In this work, we investigate this phenomenon from the perspective of…

机器学习 · 计算机科学 2024-12-18 Chen Liu , Zhichao Huang , Mathieu Salzmann , Tong Zhang , Sabine Süsstrunk

As neural networks become the tool of choice to solve an increasing variety of problems in our society, adversarial attacks become critical. The possibility of generating data instances deliberately designed to fool a network's analysis can…

机器学习 · 计算机科学 2021-03-19 Gabriel D. Cantareira , Rodrigo F. Mello , Fernando V. Paulovich

Adversarial examples are inputs to machine learning models that an attacker has intentionally designed to confuse the model into making a mistake. Such examples pose a serious threat to the applicability of machine-learning-based systems,…

机器学习 · 计算机科学 2023-10-18 Peiyu Xiong , Michael Tegegn , Jaskeerat Singh Sarin , Shubhraneel Pal , Julia Rubin

Adversarial robustness studies the worst-case performance of a machine learning model to ensure safety and reliability. With the proliferation of deep-learning-based technology, the potential risks associated with model development and…

机器学习 · 计算机科学 2023-01-06 Pin-Yu Chen , Sijia Liu

Although deep networks achieve strong accuracy on a range of computer vision benchmarks, they remain vulnerable to adversarial attacks, where imperceptible input perturbations fool the network. We present both theoretical and empirical…

计算机视觉与模式识别 · 计算机科学 2020-09-14 Chengzhi Mao , Amogh Gupta , Vikram Nitin , Baishakhi Ray , Shuran Song , Junfeng Yang , Carl Vondrick