English
Related papers

Related papers: Regularized Context Gates on Transformer for Machi…

200 papers

Large Language Models (LLMs) enhanced with external contexts, such as through retrieval-augmented generation (RAG), often face challenges in handling imperfect evidence. They tend to over-rely on external knowledge, making them vulnerable…

Computation and Language · Computer Science 2025-02-25 Shenglai Zeng , Pengfei He , Kai Guo , Tianqi Zheng , Hanqing Lu , Yue Xing , Hui Liu

A great proportion of sequence-to-sequence (Seq2Seq) models for Neural Machine Translation (NMT) adopt Recurrent Neural Network (RNN) to generate translation word by word following a sequential order. As the studies of linguistics have…

Computation and Language · Computer Science 2018-06-14 Junyang Lin , Xu Sun , Xuancheng Ren , Shuming Ma , Jinsong Su , Qi Su

Factored neural machine translation (FNMT) is founded on the idea of using the morphological and grammatical decomposition of the words (factors) at the output side of the neural network. This architecture addresses two well-known problems…

Computation and Language · Computer Science 2017-12-07 Mercedes García-Martínez , Loïc Barrault , Fethi Bougares

Context-aware neural machine translation involves leveraging information beyond sentence-level context to resolve inter-sentential discourse dependencies and improve document-level translation quality, and has given rise to a number of…

Computation and Language · Computer Science 2023-10-25 Linghao Jin , Jacqueline He , Jonathan May , Xuezhe Ma

The principal task in supervised neural machine translation (NMT) is to learn to generate target sentences conditioned on the source inputs from a set of parallel sentence pairs, and thus produce a model capable of generalizing to unseen…

Computation and Language · Computer Science 2022-04-15 Xiangpeng Wei , Heng Yu , Yue Hu , Rongxiang Weng , Weihua Luo , Jun Xie , Rong Jin

Machine translation (MT) is a technique that leverages computers to translate human languages automatically. Nowadays, neural machine translation (NMT) which models direct mapping between source and target languages with deep neural…

Computation and Language · Computer Science 2020-04-14 Jiajun Zhang , Chengqing Zong

There exists a token imbalance phenomenon in natural language as different tokens appear with different frequencies, which leads to different learning difficulties for tokens in Neural Machine Translation (NMT). The vanilla NMT model…

Computation and Language · Computer Science 2020-10-12 Shuhao Gu , Jinchao Zhang , Fandong Meng , Yang Feng , Wanying Xie , Jie Zhou , Dong Yu

Monolingual data has been demonstrated to be helpful in improving the translation quality of neural machine translation (NMT). The current methods stay at the usage of word-level knowledge, such as generating synthetic parallel data or…

Computation and Language · Computer Science 2019-08-22 Rongxiang Weng , Heng Yu , Shujian Huang , Weihua Luo , Jiajun Chen

Neural Language Models (NLM), when trained and evaluated with context spanning multiple utterances, have been shown to consistently outperform both conventional n-gram language models and NLMs that use limited context. In this paper, we…

Computation and Language · Computer Science 2021-09-14 Ashish Shenoy , Sravan Bodapati , Monica Sunkara , Srikanth Ronanki , Katrin Kirchhoff

In this paper, we propose an additionsubtraction twin-gated recurrent network (ATR) to simplify neural machine translation. The recurrent units of ATR are heavily simplified to have the smallest number of weight matrices among units of all…

Computation and Language · Computer Science 2018-10-31 Biao Zhang , Deyi Xiong , Jinsong Su , Qian Lin , Huiji Zhang

Discriminative translation models utilizing source context have been shown to help statistical machine translation performance. We propose a novel extension of this work using target context information. Surprisingly, we show that this…

Computation and Language · Computer Science 2016-07-06 Aleš Tamchyna , Alexander Fraser , Ondřej Bojar , Marcin Junczys-Dowmunt

Context-aware translation can be achieved by processing a concatenation of consecutive sentences with the standard Transformer architecture. This paper investigates the intuitive idea of providing the model with explicit information about…

Computation and Language · Computer Science 2023-04-06 Lorenzo Lupo , Marco Dinarelli , Laurent Besacier

Large language model (LLM) has achieved promising performance in multilingual machine translation tasks through zero/few-shot prompts or prompt-tuning. However, due to the mixture of multilingual data during the pre-training of LLM, the…

Computation and Language · Computer Science 2024-03-12 Shaojie Dai , Xin Liu , Ping Luo , Yue Yu

Token-level adaptive training approaches can alleviate the token imbalance problem and thus improve neural machine translation, through re-weighting the losses of different target tokens based on specific statistical metrics (e.g., token…

Computation and Language · Computer Science 2022-03-08 Songming Zhang , Yijin Liu , Fandong Meng , Yufeng Chen , Jinan Xu , Jian Liu , Jie Zhou

Building models that take advantage of the hierarchical structure of language without a priori annotation is a longstanding goal in natural language processing. We introduce such a model for the task of machine translation, pairing a…

Computation and Language · Computer Science 2017-09-07 James Bradbury , Richard Socher

Multi-modal machine translation aims at translating the source sentence into a different language in the presence of the paired image. Previous work suggests that additional visual information only provides dispensable help to translation,…

Computation and Language · Computer Science 2019-12-30 Pengcheng Yang , Boxing Chen , Pei Zhang , Xu Sun

The Transformer architecture has led to significant gains in machine translation. However, most studies focus on only sentence-level translation without considering the context dependency within documents, leading to the inadequacy of…

Artificial Intelligence · Computer Science 2022-10-21 Yukun Feng , Feng Li , Ziang Song , Boyuan Zheng , Philipp Koehn

We introduce Generative Neural Machine Translation (GNMT), a latent variable architecture which is designed to model the semantics of the source and target sentences. We modify an encoder-decoder translation model by adding a latent…

Computation and Language · Computer Science 2018-06-14 Harshil Shah , David Barber

For machine translation to tackle discourse phenomena, models must have access to extra-sentential linguistic context. There has been recent interest in modelling context in neural machine translation (NMT), but models have been principally…

Computation and Language · Computer Science 2018-04-23 Rachel Bawden , Rico Sennrich , Alexandra Birch , Barry Haddow

In this paper, we explore a simple solution to "Multi-Source Neural Machine Translation" (MSNMT) which only relies on preprocessing a N-way multilingual corpus without modifying the Neural Machine Translation (NMT) architecture or training…

Computation and Language · Computer Science 2019-03-05 Raj Dabre , Fabien Cromieres , Sadao Kurohashi