中文
相关论文

相关论文: Label Smoothing and Logit Squeezing: A Replacement…

200 篇论文

Adversarial training is one of the most effective approaches defending against adversarial examples for deep learning models. Unlike other defense strategies, adversarial training aims to promote the robustness of models intrinsically.…

机器学习 · 计算机科学 2021-04-22 Tao Bai , Jinqi Luo , Jun Zhao , Bihan Wen , Qian Wang

Constraint-based learning reduces the burden of collecting labels by having users specify general properties of structured outputs, such as constraints imposed by physical laws. We propose a novel framework for simultaneously learning these…

机器学习 · 计算机科学 2018-06-01 Hongyu Ren , Russell Stewart , Jiaming Song , Volodymyr Kuleshov , Stefano Ermon

This paper investigates the theory of robustness against adversarial attacks. We focus on randomized classifiers (\emph{i.e.} classifiers that output random variables) and provide a thorough analysis of their behavior through the lens of…

机器学习 · 计算机科学 2021-02-23 Rafael Pinot , Laurent Meunier , Florian Yger , Cédric Gouy-Pailler , Yann Chevaleyre , Jamal Atif

Real-world natural language processing systems need to be robust to human adversaries. Collecting examples of human adversaries for training is an effective but expensive solution. On the other hand, training on synthetic attacks with small…

机器学习 · 计算机科学 2024-02-16 Aradhana Sinha , Ananth Balashankar , Ahmad Beirami , Thi Avrahami , Jilin Chen , Alex Beutel

"Benign overfitting", where classifiers memorize noisy training data yet still achieve a good generalization performance, has drawn great attention in the machine learning community. To explain this surprising phenomenon, a series of works…

机器学习 · 计算机科学 2022-01-03 Jinghui Chen , Yuan Cao , Quanquan Gu

Adversarial perturbations dramatically decrease the accuracy of state-of-the-art image classifiers. In this paper, we propose and analyze a simple and computationally efficient defense strategy: inject random Gaussian noise, discretize each…

机器学习 · 计算机科学 2019-03-27 Yuchen Zhang , Percy Liang

This paper proposes an attack-independent (non-adversarial training) technique for improving adversarial robustness of neural network models, with minimal loss of standard accuracy. We suggest creating a neighborhood around each training…

机器学习 · 计算机科学 2021-07-28 Bronya Roni Chernyak , Bhiksha Raj , Tamir Hazan , Joseph Keshet

We investigate two causes for adversarial vulnerability in deep neural networks: bad data and (poorly) trained models. When trained with SGD, deep neural networks essentially achieve zero training error, even in the presence of label noise,…

机器学习 · 计算机科学 2020-07-09 Amartya Sanyal , Puneet K Dokania , Varun Kanade , Philip H. S. Torr

Randomized smoothing is a defensive technique to achieve enhanced robustness against adversarial examples which are small input perturbations that degrade the performance of neural network models. Conventional randomized smoothing adds…

机器学习 · 计算机科学 2024-07-17 Ryo Hase , Ye Wang , Toshiaki Koike-Akino , Jing Liu , Kieran Parsons

Recently, adversarial training has been incorporated in self-supervised contrastive pre-training to augment label efficiency with exciting adversarial robustness. However, the robustness came at a cost of expensive adversarial training. In…

机器学习 · 计算机科学 2022-11-01 Yijiang Pang , Boyang Liu , Jiayu Zhou

Virtual Adversarial Training (VAT) has shown impressive results among recently developed regularization methods called consistency regularization. VAT utilizes adversarial samples, generated by injecting perturbation in the input space, for…

机器学习 · 计算机科学 2022-12-27 Genki Osada , Budrul Ahsan , Revoti Prasad Bora , Takashi Nishide

Label noise presents a real challenge for supervised learning algorithms. Consequently, mitigating label noise has attracted immense research in recent years. Noise robust losses is one of the more promising approaches for dealing with…

机器学习 · 计算机科学 2021-04-27 Neta Shoham , Tomer Avidor , Nadav Israel

Adversarial examples are maliciously tweaked images that can easily fool machine learning techniques, such as neural networks, but they are normally not visually distinguishable for human beings. One of the main approaches to solve this…

计算机视觉与模式识别 · 计算机科学 2018-09-11 Zukang Liao

Adversarial examples are carefully crafted attack points that are supposed to fool machine learning classifiers. In the last years, the field of adversarial machine learning, especially the study of perturbation-based adversarial examples,…

机器学习 · 计算机科学 2023-09-19 Roland Rauter , Martin Nocker , Florian Merkle , Pascal Schöttle

Deep neural networks have exhibited impressive performance in image classification tasks but remain vulnerable to adversarial examples. Standard adversarial training enhances robustness but typically fails to explicitly address inter-class…

计算机视觉与模式识别 · 计算机科学 2026-04-10 Himanshu Singh , A. V. Subramanyam , Shivank Rajput , Mohan Kankanhalli

Adversarial attacks have been widely studied for general classification tasks, but remain unexplored in the context of fine-grained recognition, where the inter-class similarities facilitate the attacker's task. In this paper, we identify…

计算机视觉与模式识别 · 计算机科学 2020-06-12 Krishna Kanth Nakka , Mathieu Salzmann

Adversarial examples are carefully perturbed in-puts for fooling machine learning models. A well-acknowledged defense method against such examples is adversarial training, where adversarial examples are injected into training data to…

机器学习 · 计算机科学 2019-05-17 Bai Li , Changyou Chen , Wenlin Wang , Lawrence Carin

In most practical problems of classifier learning, the training data suffers from the label noise. Hence, it is important to understand how robust is a learning algorithm to such label noise. This paper presents some theoretical analysis to…

机器学习 · 计算机科学 2016-08-29 Aritra Ghosh , Naresh Manwani , P. S. Sastry

Ideally, what confuses neural network should be confusing to humans. However, recent experiments have shown that small, imperceptible perturbations can change the network prediction. To address this gap in perception, we propose a novel…

机器学习 · 计算机科学 2018-10-31 Alexander Matyasko , Lap-Pui Chau

Adversarial training has been shown as an effective approach to improve the robustness of image classifiers against white-box attacks. However, its effectiveness against black-box attacks is more nuanced. In this work, we demonstrate that…

机器学习 · 计算机科学 2021-07-27 Ali Rahmati , Seyed-Mohsen Moosavi-Dezfooli , Huaiyu Dai