English
Related papers

Related papers: AdvEntuRe: Adversarial Training for Textual Entail…

200 papers

Neural text generation models conditioning on given input (e.g. machine translation and image captioning) are usually trained by maximum likelihood estimation of target text. However, the trained models suffer from various types of errors…

Computation and Language · Computer Science 2020-12-29 Keisuke Shirai , Kazuma Hashimoto , Akiko Eriguchi , Takashi Ninomiya , Shinsuke Mori

Neural text generation models are often autoregressive language models or seq2seq models. These models generate text by sampling words sequentially, with each word conditioned on the previous word, and are state-of-the-art for several…

Machine Learning · Statistics 2018-03-02 William Fedus , Ian Goodfellow , Andrew M. Dai

Adversarial examples are carefully crafted attack points that are supposed to fool machine learning classifiers. In the last years, the field of adversarial machine learning, especially the study of perturbation-based adversarial examples,…

Machine Learning · Computer Science 2023-09-19 Roland Rauter , Martin Nocker , Florian Merkle , Pascal Schöttle

Applying generative adversarial networks (GANs) to text-related tasks is challenging due to the discrete nature of language. One line of research resolves this issue by employing reinforcement learning (RL) and optimizing the next-word…

Computation and Language · Computer Science 2020-11-05 Yanghoon Kim , Seungpil Won , Seunghyun Yoon , Kyomin Jung

This paper explores the use of adversarial examples in training speech recognition systems to increase robustness of deep neural network acoustic models. During training, the fast gradient sign method is used to generate adversarial…

Computation and Language · Computer Science 2018-06-19 Sining Sun , Ching-Feng Yeh , Mari Ostendorf , Mei-Yuh Hwang , Lei Xie

Over the last few years, Contextualized Pre-trained Neural Language Models, such as BERT, GPT, have shown significant gains in various NLP tasks. To enhance the robustness of existing pre-trained models, one way is adversarial examples…

Computation and Language · Computer Science 2021-10-05 Wenqian Ye , Fei Xu , Yaojia Huang , Cassie Huang , Ji A

The existence of adversarial examples points to a basic weakness of deep neural networks. One of the most effective defenses against such examples, adversarial training, entails training models with some degree of robustness, usually at the…

Machine Learning · Computer Science 2023-10-05 Matan Levi , Aryeh Kontorovich

Adversarial examples are intentionally crafted data with the purpose of deceiving neural networks into misclassification. When we talk about strategies to create such examples, we usually refer to perturbation-based methods that fabricate…

Computer Vision and Pattern Recognition · Computer Science 2018-06-28 Shih-hong Tsai

The ability to deploy neural networks in real-world, safety-critical systems is severely limited by the presence of adversarial examples: slightly perturbed inputs that are misclassified by the network. In recent years, several techniques…

Machine Learning · Computer Science 2018-02-21 Nicholas Carlini , Guy Katz , Clark Barrett , David L. Dill

Multiple different approaches of generating adversarial examples have been proposed to attack deep neural networks. These approaches involve either directly computing gradients with respect to the image pixels, or directly solving an…

Neural and Evolutionary Computing · Computer Science 2017-03-29 Shumeet Baluja , Ian Fischer

This paper presents a novel concept learning framework for enhancing model interpretability and performance in visual classification tasks. Our approach appends an unsupervised explanation generator to the primary classifier network and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Tanmay Garg , Deepika Vemuri , Vineeth N Balasubramanian

Adversarial examples are inputs to machine learning models designed by an adversary to cause an incorrect output. So far, adversarial examples have been studied most extensively in the image domain. In this domain, adversarial examples can…

Audio and Speech Processing · Electrical Eng. & Systems 2019-06-10 Yao Qin , Nicholas Carlini , Ian Goodfellow , Garrison Cottrell , Colin Raffel

Self-supervised learning approach like contrastive learning is attached great attention in natural language processing. It uses pairs of training data augmentations to build a classification task for an encoder with well representation…

Computation and Language · Computer Science 2021-12-03 Deshui Miao , Jiaqi Zhang , Wenbo Xie , Jian Song , Xin Li , Lijuan Jia , Ning Guo

We present an approach for generating clarification questions with the goal of eliciting new information that would make the given textual context more complete. We propose that modeling hypothetical answers (to clarification questions) as…

Computation and Language · Computer Science 2019-04-05 Sudha Rao , Hal Daumé

Recently, with the advancement of deep learning, several applications in text classification have advanced significantly. However, this improvement comes with a cost because deep learning is vulnerable to adversarial examples. This weakness…

Machine Learning · Computer Science 2024-05-08 Korn Sooksatra , Bikram Khanal , Pablo Rivas

Conventional Generative Adversarial Networks (GANs) for text generation tend to have issues of reward sparsity and mode collapse that affect the quality and diversity of generated samples. To address the issues, we propose a novel…

Computation and Language · Computer Science 2020-02-13 Wangchunshu Zhou , Tao Ge , Ke Xu , Furu Wei , Ming Zhou

Adversarial training, a method for learning robust deep neural networks, constructs adversarial examples during training. However, recent methods for generating NLP adversarial examples involve combinatorial search and expensive sentence…

Computation and Language · Computer Science 2021-09-14 Jin Yong Yoo , Yanjun Qi

Training models that are robust to data domain shift has gained an increasing interest both in academia and industry. Question-Answering language models, being one of the typical problem in Natural Language Processing (NLP) research, has…

Computation and Language · Computer Science 2022-06-27 Shubham Shrivastava , Kaiyue Wang

Synthesising a text-to-image model of high-quality images by guiding the generative model through the Text description is an innovative and challenging task. In recent years, AttnGAN based on the Attention mechanism to guide GAN training…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Mingyu Jin , Chong Zhang , Qinkai Yu , Haochen Xue , Xiaobo Jin , Xi Yang

Knowledge Tracing (KT) monitors students' knowledge states and simulates their responses to question sequences. Existing KT models typically follow a single-step training paradigm, which leads to discrepancies with the multi-step inference…

Machine Learning · Computer Science 2026-01-06 Lingyue Fu , Ting Long , Jianghao Lin , Wei Xia , Xinyi Dai , Ruiming Tang , Yasheng Wang , Weinan Zhang , Yong Yu