English
Related papers

Related papers: Syntax-aware Data Augmentation for Neural Machine …

200 papers

Neural Machine Translation (NMT) models have demonstrated strong state of the art performance on translation tasks where well-formed training and evaluation data are provided, but they remain sensitive to inputs that include errors of…

Computation and Language · Computer Science 2020-10-22 Daniel Li , Te I , Naveen Arivazhagan , Colin Cherry , Dirk Padfield

Although more additional corpora are now available for Statistical Machine Translation (SMT), only the ones which belong to the same or similar domains with the original corpus can indeed enhance SMT performance directly. Most of the…

Computation and Language · Computer Science 2017-03-02 Rui Wang , Hai Zhao , Bao-Liang Lu , Masao Utiyama , Eiichro Sumita

This paper explores the use of text data augmentation techniques to enhance conflict and duplicate detection in software engineering tasks through sentence pair classification. The study adapts generic augmentation techniques such as…

Software Engineering · Computer Science 2023-05-17 Garima Malik , Mucahit Cevik , Ayşe Başar

Pretrained neural models such as BERT, when fine-tuned to perform natural language inference (NLI), often show high accuracy on standard datasets, but display a surprising lack of sensitivity to word order on controlled challenge sets. We…

Computation and Language · Computer Science 2020-04-28 Junghyun Min , R. Thomas McCoy , Dipanjan Das , Emily Pitler , Tal Linzen

Traditional Neural machine translation (NMT) involves a fixed training procedure where each sentence is sampled once during each epoch. In reality, some sentences are well-learned during the initial few epochs; however, using this approach,…

Computation and Language · Computer Science 2019-10-04 Rui Wang , Masao Utiyama , Eiichiro Sumita

Machine Translation models are trained to translate a variety of documents from one language into another. However, models specifically trained for a particular characteristics of the documents tend to perform better. Fine-tuning is a…

Computation and Language · Computer Science 2019-10-09 Alberto Poncelas , Gideon Maillette de Buy Wenniger , Andy Way

In this paper, we introduce a hybrid search for attention-based neural machine translation (NMT). A target phrase learned with statistical MT models extends a hypothesis in the NMT beam search when the attention of the NMT model focuses on…

Computation and Language · Computer Science 2017-08-11 Leonard Dahlmann , Evgeny Matusov , Pavel Petrushkov , Shahram Khadivi

Neural Machine Translation (NMT) has drawn much attention due to its promising translation performance recently. However, several studies indicate that NMT often generates fluent but unfaithful translations. In this paper, we propose a…

Computation and Language · Computer Science 2018-05-28 Yang Zhao , Yining Wang , Jiajun Zhang , Chengqing Zong

Data augmentation seeks to manipulate the available data for training to improve the generalization ability of models. We investigate two data augmentation proxies, permutation and flipping, for neural dialog response selection task on…

Computation and Language · Computer Science 2018-09-05 Wenchao Du , Alan W Black

In low resource settings, data augmentation strategies are commonly leveraged to improve performance. Numerous approaches have attempted document-level augmentation (e.g., text classification), but few studies have explored token-level…

Computation and Language · Computer Science 2022-10-04 Arie Pratama Sutiono , Gus Hahn-Powell

Data augmentation is an effective way to diversify corpora in machine translation, but previous methods may introduce semantic inconsistency between original and augmented data because of irreversible operations and random subword sampling…

Computation and Language · Computer Science 2025-02-21 Jiashu Yao , Heyan Huang , Zeming Liu , Yuhang Guo

Data augmentation is an essential technique in natural language processing (NLP) for enriching training datasets by generating diverse samples. This process is crucial for improving the robustness and generalization capabilities of NLP…

Computation and Language · Computer Science 2025-10-16 Zaitian Wang , Jinghan Zhang , Xinhao Zhang , Kunpeng Liu , Pengfei Wang , Yuanchun Zhou

Building conversational speech recognition systems for new languages is constrained by the availability of utterances that capture user-device interactions. Data collection is both expensive and limited by the speed of manual transcription.…

Computation and Language · Computer Science 2019-12-03 Surabhi Punjabi , Harish Arsikere , Sri Garimella

It's hard for neural MWP solvers to deal with tiny local variances. In MWP task, some local changes conserve the original semantic while the others may totally change the underlying logic. Currently, existing datasets for MWP task contain…

Computation and Language · Computer Science 2022-04-19 Ailisi Li , Jiaqing Liang , Yanghua Xiao

Sequence-to-sequence neural translation models learn semantic and syntactic relations between sentence pairs by optimizing the likelihood of the target given the source, i.e., $p(y|x)$, an objective that ignores other potentially useful…

Computation and Language · Computer Science 2016-03-24 Jiwei Li , Dan Jurafsky

Data sparsity is a main problem hindering the development of code-switching (CS) NLP systems. In this paper, we investigate data augmentation techniques for synthesizing dialectal Arabic-English CS text. We perform lexical replacements…

Computation and Language · Computer Science 2023-04-05 Injy Hamed , Nizar Habash , Slim Abdennadher , Ngoc Thang Vu

Math Word Problem (MWP) solving presents a challenging task in Natural Language Processing (NLP). This study aims to provide MWP solvers with a more diverse training set, ultimately improving their ability to solve various math problems. We…

Computation and Language · Computer Science 2024-05-02 Gulsum Yigit , Mehmet Fatih Amasyali

Existing data augmentation approaches for neural machine translation (NMT) have predominantly relied on back-translating in-domain (IND) monolingual corpora. These methods suffer from issues associated with a domain information gap, which…

Computation and Language · Computer Science 2020-04-07 Wei Peng , Chongxuan Huang , Tianhao Li , Yun Chen , Qun Liu

Text augmentation is a technique for constructing synthetic data from an under-resourced corpus to improve predictive performance. Synthetic data generation is common in numerous domains. However, recently text augmentation has emerged in…

Computation and Language · Computer Science 2023-09-12 Mosleh Mahamud , Zed Lee , Isak Samsten

In this work we investigate the impact of applying textual data augmentation tasks to low resource machine translation. There has been recent interest in investigating approaches for training systems for languages with limited resources and…

Computation and Language · Computer Science 2023-06-14 Catherine Gitau , VUkosi Marivate