中文
相关论文

相关论文: Improving the Adversarial Robustness of NLP Models…

200 篇论文

It has been suggested that adversarial examples cause deep learning models to make incorrect predictions with high confidence. In this work, we take the opposite stance: an overly confident model is more likely to be vulnerable to…

机器学习 · 计算机科学 2018-02-14 Angus Galloway , Graham W. Taylor , Medhat Moussa

Large pre-trained language models have shown remarkable performance over the past few years. These models, however, sometimes learn superficial features from the dataset and cannot generalize to the distributions that are dissimilar to the…

计算与语言 · 计算机科学 2022-10-31 Jieyu Zhao , Xuezhi Wang , Yao Qin , Jilin Chen , Kai-Wei Chang

Training machine learning models that are robust against adversarial inputs poses seemingly insurmountable challenges. To better understand adversarial robustness, we consider the underlying problem of learning robust representations. We…

机器学习 · 计算机科学 2020-07-07 Sicheng Zhu , Xiao Zhang , David Evans

Convolutional neural networks (CNNs) have achieved state-of-the-art performance on various tasks in computer vision. However, recent studies demonstrate that these models are vulnerable to carefully crafted adversarial samples and suffer…

机器学习 · 计算机科学 2020-12-15 Xin Li , Xiangrui Li , Deng Pan , Dongxiao Zhu

Neural networks are vulnerable to small adversarial perturbations. Existing literature largely focused on understanding and mitigating the vulnerability of learned models. In this paper, we demonstrate an intriguing phenomenon about the…

机器学习 · 计算机科学 2019-02-25 Gavin Weiguang Ding , Kry Yik Chau Lui , Xiaomeng Jin , Luyu Wang , Ruitong Huang

There has been emerging interest to use transductive learning for adversarial robustness (Goldwasser et al., NeurIPS 2020; Wu et al., ICML 2020). Compared to traditional "test-time" defenses, these defense mechanisms "dynamically retrain"…

机器学习 · 计算机科学 2021-06-17 Jiefeng Chen , Yang Guo , Xi Wu , Tianqi Li , Qicheng Lao , Yingyu Liang , Somesh Jha

Adversarial examples have been shown to cause neural networks to fail on a wide range of vision and language tasks, but recent work has claimed that Bayesian neural networks (BNNs) are inherently robust to adversarial perturbations. In this…

机器学习 · 计算机科学 2024-05-01 Yunzhen Feng , Tim G. J. Rudner , Nikolaos Tsilivis , Julia Kempe

We propose a novel approach to achieving invariance for deep neural networks in the form of inducing amnesia to unwanted factors of data through a new adversarial forgetting mechanism. We show that the forgetting mechanism serves as an…

机器学习 · 计算机科学 2019-11-22 Ayush Jaiswal , Daniel Moyer , Greg Ver Steeg , Wael AbdAlmageed , Premkumar Natarajan

Sensitivity to adversarial noise hinders deployment of machine learning algorithms in security-critical applications. Although many adversarial defenses have been proposed, robustness to adversarial noise remains an open problem. The most…

机器学习 · 计算机科学 2020-08-13 Alex Serban , Erik Poll , Joost Visser

Neural Probabilistic Circuits (NPCs), a new class of concept bottleneck models, comprise an attribute recognition model and a probabilistic circuit for reasoning. By integrating the outputs from these two modules, NPCs produce compositional…

机器学习 · 计算机科学 2025-09-26 Weixin Chen , Han Zhao

Information Bottleneck (IB) is a generalization of rate-distortion theory that naturally incorporates compression and relevance trade-offs for learning. Though the original IB has been extensively studied, there has not been much…

机器学习 · 计算机科学 2019-10-08 Thanh T. Nguyen , Jaesik Choi

In the era of widespread public use of AI systems across various domains, ensuring adversarial robustness has become increasingly vital to maintain safety and prevent undesirable errors. Researchers have curated various adversarial datasets…

机器学习 · 计算机科学 2023-11-08 Yuanchen Bai , Raoyi Huang , Vijay Viswanathan , Tzu-Sheng Kuo , Tongshuang Wu

Intentionally crafted adversarial samples have effectively exploited weaknesses in deep neural networks. A standard method in adversarial robustness assumes a framework to defend against samples crafted by minimally perturbing a sample such…

机器学习 · 计算机科学 2022-11-07 Anaelia Ovalle , Evan Czyzycki , Cho-Jui Hsieh

Deep neural networks (DNNs) have gained prominence in various applications, such as classification, recognition, and prediction, prompting increased scrutiny of their properties. A fundamental attribute of traditional DNNs is their…

机器学习 · 计算机科学 2023-08-15 Roman Garaev , Bader Rasheed , Adil Khan

Adversarial pruning compresses models while preserving robustness. Current methods require access to adversarial examples during pruning. This significantly hampers training efficiency. Moreover, as new adversarial attacks and training…

机器学习 · 计算机科学 2022-10-11 Tong Jian , Zifeng Wang , Yanzhi Wang , Jennifer Dy , Stratis Ioannidis

Following the recent adoption of deep neural networks (DNN) accross a wide range of applications, adversarial attacks against these models have proven to be an indisputable threat. Adversarial samples are crafted with a deliberate intention…

机器学习 · 计算机科学 2017-08-31 Valentina Zantedeschi , Maria-Irina Nicolae , Ambrish Rawat

Adversarial examples have attracted significant attention in machine learning, but the reasons for their existence and pervasiveness remain unclear. We demonstrate that adversarial examples can be directly attributed to the presence of…

The field of adversarial robustness has attracted significant attention in machine learning. Contrary to the common approach of training models that are accurate in average case, it aims at training models that are accurate for worst case…

机器学习 · 计算机科学 2020-10-12 Oriol Barbany Mayor

In recent years numerous methods have been developed to formally verify the robustness of deep neural networks (DNNs). Though the proposed techniques are effective in providing mathematical guarantees about the DNNs behavior, it is not…

机器学习 · 计算机科学 2023-02-01 Debangshu Banerjee , Avaljot Singh , Gagandeep Singh

The adversarial vulnerability of neural nets, and subsequent techniques to create robust models have attracted significant attention; yet we still lack a full understanding of this phenomenon. Here, we study adversarial examples of trained…

机器学习 · 计算机科学 2023-02-01 Nikolaos Tsilivis , Julia Kempe