中文
相关论文

相关论文: Toward Adversarial Training on Contextualized Lang…

200 篇论文

Adversarial training (AT) is proved to reliably improve network's robustness against adversarial data. However, current AT with a pre-specified perturbation budget has limitations in learning a robust network. Firstly, applying a…

机器学习 · 计算机科学 2022-10-05 Chaojian Yu , Dawei Zhou , Li Shen , Jun Yu , Bo Han , Mingming Gong , Nannan Wang , Tongliang Liu

Deep neural networks have been proven to be vulnerable to adversarial examples and various methods have been proposed to defend against adversarial attacks for natural language processing tasks. However, previous defense methods have…

机器学习 · 计算机科学 2024-03-01 Fangyuan Zhang , Huichi Zhou , Shuangjiao Li , Hongtao Wang

Recent developments in Natural Language Processing (NLP) demonstrate that large-scale, self-supervised pre-training can be extremely beneficial for downstream tasks. These ideas have been adapted to other domains, including the analysis of…

计算与语言 · 计算机科学 2021-02-02 Matthew B. A. McDermott , Brendan Yap , Harry Hsu , Di Jin , Peter Szolovits

In this paper, drawing intuition from the Turing test, we propose using adversarial training for open-domain dialogue generation: the system is trained to produce sequences that are indistinguishable from human-generated dialogue…

计算与语言 · 计算机科学 2017-09-26 Jiwei Li , Will Monroe , Tianlin Shi , Sébastien Jean , Alan Ritter , Dan Jurafsky

Neural networks are vulnerable to adversarial attacks -- small visually imperceptible crafted noise which when added to the input drastically changes the output. The most effective method of defending against these adversarial attacks is to…

Deep neural networks (DNNs) have a high capacity to completely memorize noisy labels given sufficient training time, and its memorization, unfortunately, leads to performance degradation. Recently, virtual adversarial training (VAT)…

计算与语言 · 计算机科学 2022-06-24 Do-Myoung Lee , Yeachan Kim , Chang-gyun Seo

Transcribed datasets typically contain speaker identity for each instance in the data. We investigate two ways to incorporate this information during training: Multi-Task Learning and Adversarial Learning. In multi-task learning, the goal…

机器学习 · 计算机科学 2019-02-15 Yossi Adi , Neil Zeghidour , Ronan Collobert , Nicolas Usunier , Vitaliy Liptchinsky , Gabriel Synnaeve

By injecting adversarial examples into training data, adversarial training is promising for improving the robustness of deep learning models. However, most existing adversarial training approaches are based on a specific type of adversarial…

机器学习 · 计算机科学 2019-03-18 Chuanbiao Song , Kun He , Liwei Wang , John E. Hopcroft

This paper presents a novel concept learning framework for enhancing model interpretability and performance in visual classification tasks. Our approach appends an unsupervised explanation generator to the primary classifier network and…

计算机视觉与模式识别 · 计算机科学 2024-04-04 Tanmay Garg , Deepika Vemuri , Vineeth N Balasubramanian

Despite their outstanding accuracy, semi-supervised segmentation methods based on deep neural networks can still yield predictions that are considered anatomically impossible by clinicians, for instance, containing holes or disconnected…

计算机视觉与模式识别 · 计算机科学 2021-07-14 Ping Wang , Jizong Peng , Marco Pedersoli , Yuanfeng Zhou , Caiming Zhang , Christian Desrosiers

In this paper, we propose Inverse Adversarial Training (IAT) algorithm for training neural dialogue systems to avoid generic responses and model dialogue history better. In contrast to standard adversarial training algorithms, IAT…

计算与语言 · 计算机科学 2021-06-01 Wangchunshu Zhou , Qifei Li , Chenle Li

Advancements in reinforcement learning (RL) have been remarkable in recent years. However, the limitations of traditional training methods have become increasingly evident, particularly in meta-RL settings where agents face new, unseen…

机器学习 · 计算机科学 2023-02-07 Ramnath Kumar , Tristan Deleu , Yoshua Bengio

Understanding the vulnerability of large-scale pre-trained vision-language models like CLIP against adversarial attacks is key to ensuring zero-shot generalization capacity on various downstream tasks. State-of-the-art defense mechanisms…

计算机视觉与模式识别 · 计算机科学 2024-05-21 Fan Yang , Mingxuan Xia , Sangzhou Xia , Chicheng Ma , Hui Hui

Recent advances in the development of large language models have resulted in public access to state-of-the-art pre-trained language models (PLMs), including Generative Pre-trained Transformer 3 (GPT-3) and Bidirectional Encoder…

Adversarial training (AT) is a widely recognized defense mechanism to gain the robustness of deep neural networks against adversarial attacks. It is built on min-max optimization (MMO), where the minimizer (i.e., defender) seeks a robust…

机器学习 · 计算机科学 2022-10-06 Yihua Zhang , Guanhua Zhang , Prashant Khanduri , Mingyi Hong , Shiyu Chang , Sijia Liu

Adversarial training (AT) is always formulated as a minimax problem, of which the performance depends on the inner optimization that involves the generation of adversarial examples (AEs). Most previous methods adopt Projected Gradient…

计算机视觉与模式识别 · 计算机科学 2022-03-15 Xiaojun Jia , Yong Zhang , Baoyuan Wu , Ke Ma , Jue Wang , Xiaochun Cao

We propose a simple and general method to regularize the fine-tuning of Transformer-based encoders for text classification tasks. Specifically, during fine-tuning we generate adversarial examples by perturbing the word embeddings of the…

计算与语言 · 计算机科学 2022-02-21 Lin Pan , Chung-Wei Hang , Avirup Sil , Saloni Potdar

Recent improvements in deep learning models and their practical applications have raised concerns about the robustness of these models against adversarial examples. Adversarial training (AT) has been shown effective to reach a robust model…

机器学习 · 计算机科学 2021-03-30 Mohammad Azizmalayeri , Mohammad Hossein Rohban

Recent work has proposed several efficient approaches for generating gradient-based adversarial perturbations on embeddings and proved that the model's performance and robustness can be improved when they are trained with these contaminated…

计算与语言 · 计算机科学 2021-09-15 Yao Qiu , Jinchao Zhang , Jie Zhou

Recently, deep learning has been applied to many security-sensitive applications, such as facial authentication. The existence of adversarial examples hinders such applications. The state-of-the-art result on defense shows that adversarial…

机器学习 · 计算机科学 2018-05-15 Qi-Zhi Cai , Min Du , Chang Liu , Dawn Song