English
Related papers

Related papers: Leveraging Sentence-oriented Augmentation and Tran…

200 papers

The non-autoregressive models have boosted the efficiency of neural machine translation through parallelized decoding at the cost of effectiveness when comparing with the autoregressive counterparts. In this paper, we claim that the…

Computation and Language · Computer Science 2021-01-25 Ye Liu , Yao Wan , Jian-Guo Zhang , Wenting Zhao , Philip S. Yu

Neural machine translation (NMT) has recently become popular in the field of machine translation. However, NMT suffers from the problem of repeating or missing words in the translation. To address this problem, Tu et al. (2017) proposed an…

Computation and Language · Computer Science 2017-06-27 Yukio Matsumura , Takayuki Sato , Mamoru Komachi

Non-autoregressive (NAR) language models are known for their low latency in neural machine translation (NMT). However, a performance gap exists between NAR and autoregressive models due to the large decoding space and difficulty in…

Computation and Language · Computer Science 2024-07-03 Hao Wang , Tetsuro Morimura , Ukyo Honda , Daisuke Kawahara

Neural Machine Translation (NMT) is known to suffer from a beam-search problem: after a certain point, increasing beam size causes an overall drop in translation quality. This effect is especially pronounced for long sentences. While much…

Computation and Language · Computer Science 2021-09-15 Ivan Provilkov , Andrey Malinin

Neural machine translation (NMT) becomes a new state-of-the-art and achieves promising translation results using a simple encoder-decoder neural network. This neural network is trained once on the parallel corpus and the fixed network is…

Computation and Language · Computer Science 2016-09-22 Xiaoqing Li , Jiajun Zhang , Chengqing Zong

Using a language model (LM) pretrained on two languages with large monolingual data in order to initialize an unsupervised neural machine translation (UNMT) system yields state-of-the-art results. When limited data is available for one…

Computation and Language · Computer Science 2020-10-07 Alexandra Chronopoulou , Dario Stojanovski , Alexander Fraser

Neural models have drastically advanced state of the art for machine translation (MT) between high-resource languages. Traditionally, these models rely on large amounts of training data, but many language pairs lack these resources.…

Computation and Language · Computer Science 2023-06-13 Manuel Mager , Rajat Bhatnagar , Graham Neubig , Ngoc Thang Vu , Katharina Kann

Although neural machine translation (NMT) models perform well in the general domain, it remains rather challenging to control their generation behavior to satisfy the requirement of different users. Given the expensive training cost and the…

Computation and Language · Computer Science 2024-03-22 Yuzhuang Xu , Shuo Wang , Peng Li , Xuebo Liu , Xiaolong Wang , Weidong Liu , Yang Liu

We present in this paper a novel scheme for multimodal learning named the Parallel Attention mechanism. In addition, to take into account the advantages of grammar and context in Vietnamese, we propose the Hierarchical Linguistic Features…

Computation and Language · Computer Science 2023-07-18 Nghia Hieu Nguyen , Kiet Van Nguyen

Out-of-Vocabulary (OOV) is a problem for Neural Machine Translation (NMT). OOV refers to words with a low occurrence in the training data, or to those that are absent from the training data. To alleviate this, word or phrase-based Data…

Computation and Language · Computer Science 2022-05-19 Aloka Fernando , Surangika Ranathunga

In Africa, and the world at large, there is an increasing focus on developing Neural Machine Translation (NMT) systems to overcome language barriers. NMT for Low-resource language is particularly compelling as it involves learning with…

Computation and Language · Computer Science 2023-08-28 Sakayo Toadoum Sari , Angela Fan , Lema Logamou Seknewna

In this paper, we study a new learning paradigm for Neural Machine Translation (NMT). Instead of maximizing the likelihood of the human translation as in previous works, we minimize the distinction between human translation and the…

Computation and Language · Computer Science 2018-10-02 Lijun Wu , Yingce Xia , Li Zhao , Fei Tian , Tao Qin , Jianhuang Lai , Tie-Yan Liu

Recent studies have shown that reinforcement learning (RL) is an effective approach for improving the performance of neural machine translation (NMT) system. However, due to its instability, successfully RL training is challenging,…

Machine Learning · Computer Science 2018-08-28 Lijun Wu , Fei Tian , Tao Qin , Jianhuang Lai , Tie-Yan Liu

Machine Translation (MT) is one of the most prominent tasks in Natural Language Processing (NLP) which involves the automatic conversion of texts from one natural language to another while preserving its meaning and fluency. Although the…

Computation and Language · Computer Science 2023-09-26 Kavit Gangar , Hardik Ruparel , Shreyas Lele

Advanced neural network models have penetrated Automatic Speech Recognition (ASR) in recent years, however, in language modeling many systems still rely on traditional Back-off N-gram Language Models (BNLM) partly or entirely. The reason…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-04 Balázs Tarján , György Szaszák , Tibor Fegyó , Péter Mihajlik

Document-level neural machine translation (DNMT) has shown promising results by incorporating more context information. However, this approach also introduces a length bias problem, whereby DNMT suffers from significant translation quality…

Computation and Language · Computer Science 2023-11-21 Zhuocheng Zhang , Shuhao Gu , Min Zhang , Yang Feng

Existing neural machine translation (NMT) studies mainly focus on developing dataset-specific models based on data from different tasks (e.g., document translation and chat translation). Although the dataset-specific models have achieved…

Computation and Language · Computer Science 2023-05-19 Yunlong Liang , Fandong Meng , Jinan Xu , Jiaan Wang , Yufeng Chen , Jie Zhou

This paper describes our systems that were submitted to the restricted translation task at WAT 2021. In this task, the systems are required to output translated sentences that contain all given word constraints. Our system combined input…

Computation and Language · Computer Science 2021-06-11 Katsuki Chousa , Makoto Morishita

Biomedical data and benchmarks are highly valuable yet very limited in low-resource languages other than English such as Vietnamese. In this paper, we make use of a state-of-the-art translation model in English-Vietnamese to translate and…

Computation and Language · Computer Science 2023-01-31 Long Phan , Tai Dang , Hieu Tran , Trieu H. Trinh , Vy Phan , Lam D. Chau , Minh-Thang Luong

RTE is a significant problem and is a reasonably active research community. The proposed research works on the approach to this problem are pretty diverse with many different directions. For Vietnamese, the RTE problem is moderately new,…

Computation and Language · Computer Science 2023-01-03 Quoc-Loc Duong , Duc-Vu Nguyen , Ngan Luu-Thuy Nguyen