中文
相关论文

相关论文: Adversarial Subword Regularization for Robust Neur…

200 篇论文

This paper proposes an approach for applying GANs to NMT. We build a conditional sequence generative adversarial net which comprises of two adversarial sub models, a generator and a discriminator. The generator aims to generate sentences…

计算与语言 · 计算机科学 2018-04-10 Zhen Yang , Wei Chen , Feng Wang , Bo Xu

Targeted adversarial attacks are widely used to evaluate the robustness of neural machine translation systems. Unfortunately, this paper first identifies a critical issue in the existing settings of NMT targeted adversarial attacks, where…

计算与语言 · 计算机科学 2024-07-09 Junjie Wu , Lemao Liu , Wei Bi , Dit-Yan Yeung

Evaluating on adversarial examples has become a standard procedure to measure robustness of deep learning models. Due to the difficulty of creating white-box adversarial examples for discrete text input, most analyses of the robustness of…

计算与语言 · 计算机科学 2018-06-26 Javid Ebrahimi , Daniel Lowd , Dejing Dou

Recent research showed that deep neural networks are highly sensitive to so-called adversarial perturbations, which are tiny perturbations of the input data purposely designed to fool a machine learning classifier. Most classification…

机器学习 · 计算机科学 2018-01-15 Akram Erraqabi , Aristide Baratin , Yoshua Bengio , Simon Lacoste-Julien

Unlike traditional learning to rank models that depend on hand-crafted features, neural representation learning models learn higher level features for the ranking task by training on large datasets. Their ability to learn new features…

信息检索 · 计算机科学 2018-05-10 Daniel Cohen , Bhaskar Mitra , Katja Hofmann , W. Bruce Croft

Generating adversarial examples for Neural Machine Translation (NMT) with single Round-Trip Translation (RTT) has achieved promising results by releasing the meaning-preserving restriction. However, a potential pitfall for this approach is…

计算与语言 · 计算机科学 2022-04-20 Siyu Lai , Zhen Yang , Fandong Meng , Xue Zhang , Yufeng Chen , Jinan Xu , Jie Zhou

The vulnerability of deep neural networks (DNNs) to adversarial attack, which is an attack that can mislead state-of-the-art classifiers into making an incorrect classification with high confidence by deliberately perturbing the original…

机器学习 · 计算机科学 2021-06-18 Lina Wang , Rui Tang , Yawei Yue , Xingshu Chen , Wei Wang , Yi Zhu , Xuemei Zeng

Conditional masked language models (CMLM) have shown impressive progress in non-autoregressive machine translation (NAT). They learn the conditional translation model by predicting the random masked subset in the target sentence. Based on…

计算与语言 · 计算机科学 2021-08-20 Pan Xie , Zexian Li , Xiaohui Hu

Unsupervised neural machine translation (UNMT) has recently attracted great interest in the machine translation community. The main advantage of the UNMT lies in its easy collection of required large training text sentences while with only…

计算与语言 · 计算机科学 2020-12-04 Haipeng Sun , Rui Wang , Kehai Chen , Xugang Lu , Masao Utiyama , Eiichiro Sumita , Tiejun Zhao

Gradient-based adversarial training is widely used in improving the robustness of neural networks, while it cannot be easily adapted to natural language processing tasks since the embedding space is discrete. In natural language processing…

计算与语言 · 计算机科学 2020-12-07 Linyang Li , Xipeng Qiu

Multilingual training has been shown to improve acoustic modeling performance by sharing and transferring knowledge in modeling different languages. Knowledge sharing is usually achieved by using common lower-level layers for different…

计算与语言 · 计算机科学 2019-06-18 Ke Hu , Hasim Sak , Hank Liao

Training deep neural networks for automatic speech recognition (ASR) requires large amounts of transcribed speech. This becomes a bottleneck for training robust models for accented speech which typically contains high variability in…

音频与语音处理 · 电气工程与系统科学 2021-03-11 Nilaksh Das , Sravan Bodapati , Monica Sunkara , Sundararajan Srinivasan , Duen Horng Chau

Adversarial training is the industry standard for producing models that are robust to small adversarial perturbations. However, machine learning practitioners need models that are robust to other kinds of changes that occur naturally, such…

计算机视觉与模式识别 · 计算机科学 2021-11-02 Manli Shu , Zuxuan Wu , Micah Goldblum , Tom Goldstein

Attacking Neural Machine Translation models is an inherently combinatorial task on discrete sequences, solved with approximate heuristics. Most methods use the gradient to attack the model on each sample independently. Instead of…

计算与语言 · 计算机科学 2021-09-02 Badr Youbi Idrissi , Stéphane Clinchant

While deep neural networks have achieved remarkable success in various computer vision tasks, they often fail to generalize to new domains and subtle variations of input images. Several defenses have been proposed to improve the robustness…

计算机视觉与模式识别 · 计算机科学 2021-09-08 Omid Poursaeed , Tianxing Jiang , Harry Yang , Serge Belongie , SerNam Lim

Machine learning models are vulnerable to tiny adversarial input perturbations optimized to cause a very large output error. To measure this vulnerability, we need reliable methods that can find such adversarial perturbations. For image…

计算机视觉与模式识别 · 计算机科学 2024-07-15 Levente Halmosi , Bálint Mohos , Márk Jelasity

Neural machine translation (NMT) models typically operate with a fixed vocabulary, but translation is an open-vocabulary problem. Previous work addresses the translation of out-of-vocabulary words by backing off to a dictionary. In this…

计算与语言 · 计算机科学 2016-06-13 Rico Sennrich , Barry Haddow , Alexandra Birch

Neural Machine Translation (NMT) models have been shown to be vulnerable to adversarial attacks, wherein carefully crafted perturbations of the input can mislead the target model. In this paper, we introduce ACT, a novel adversarial attack…

计算与语言 · 计算机科学 2024-02-23 Sahar Sadrizadeh , Ljiljana Dolamic , Pascal Frossard

Learning meaningful representations using deep neural networks involves designing efficient training schemes and well-structured networks. Currently, the method of stochastic gradient descent that has a momentum with dropout is one of the…

机器学习 · 计算机科学 2016-01-15 Taehoon Lee , Minsuk Choi , Sungroh Yoon

Deep neural networks for natural language processing tasks are vulnerable to adversarial input perturbations. In this paper, we present a versatile language for programmatically specifying string transformations -- e.g., insertions,…

机器学习 · 计算机科学 2020-09-03 Yuhao Zhang , Aws Albarghouthi , Loris D'Antoni