English
Related papers

Related papers: Document Sub-structure in Neural Machine Translati…

200 papers

Document-level machine translation incorporates inter-sentential dependencies into the translation of a source sentence. In this paper, we propose a new framework to model cross-sentence dependencies by training neural machine translation…

Computation and Language · Computer Science 2020-03-31 Pei Zhang , Xu Zhang , Wei Chen , Jian Yu , Yanfeng Wang , Deyi Xiong

While neural machine translation (NMT) has become the new paradigm, the parameter optimization requires large-scale parallel data which is scarce in many domains and language pairs. In this paper, we address a new translation scenario in…

Computation and Language · Computer Science 2017-11-06 Yining Wang , Yang Zhao , Jiajun Zhang , Chengqing Zong , Zhengshan Xue

Document-level context for neural machine translation (NMT) is crucial to improve the translation consistency and cohesion, the translation of ambiguous inputs, as well as several other linguistic phenomena. Many works have been published…

Computation and Language · Computer Science 2023-06-09 Christian Herold , Hermann Ney

Machine-translated text plays an important role in modern life by smoothing communication from various communities using different languages. However, unnatural translation may lead to misunderstanding, a detector is thus needed to avoid…

Computation and Language · Computer Science 2019-04-25 Hoang-Quoc Nguyen-Son , Tran Phuong Thao , Seira Hidano , Shinsaku Kiyomoto

Neural machine translation (NMT) models are typically trained with fixed-size input and output vocabularies, which creates an important bottleneck on their accuracy and generalization capability. As a solution, various studies proposed…

Computation and Language · Computer Science 2018-05-08 Duygu Ataman , Marcello Federico

Recently, document-level neural machine translation (NMT) has become a hot topic in the community of machine translation. Despite its success, most of existing studies ignored the discourse structure information of the input document to be…

Computation and Language · Computer Science 2020-06-23 Junxuan Chen , Xiang Li , Jiarui Zhang , Chulun Zhou , Jianwei Cui , Bin Wang , Jinsong Su

The field of machine translation (MT), the automatic translation of written text from one natural language into another, has experienced a major paradigm shift in recent years. Statistical MT, which mainly relies on various count-based…

Computation and Language · Computer Science 2020-10-01 Felix Stahlberg

Neural machine translation is a recently proposed approach to machine translation. Unlike the traditional statistical machine translation, the neural machine translation aims at building a single neural network that can be jointly tuned to…

Computation and Language · Computer Science 2016-05-23 Dzmitry Bahdanau , Kyunghyun Cho , Yoshua Bengio

Parallel texts are a relatively rare language resource, however, they constitute a very useful research material with a wide range of applications. This study presents and analyses new methodologies we developed for obtaining such data from…

Computation and Language · Computer Science 2016-03-23 Krzysztof Wołk , Emilia Rejmund , Krzysztof Marasek

Distributed representation learned with neural networks has recently shown to be effective in modeling natural languages at fine granularities such as words, phrases, and even sentences. Whether and how such an approach can be extended to…

Computation and Language · Computer Science 2016-10-27 Qian Chen , Xiaodan Zhu , Zhenhua Ling , Si Wei , Hui Jiang

Data-driven subword segmentation has become the default strategy for open-vocabulary machine translation and other NLP tasks, but may not be sufficiently generic for optimal learning of non-concatenative morphology. We design a test suite…

Computation and Language · Computer Science 2021-09-03 Chantal Amrhein , Rico Sennrich

Neural Machine Translation (NMT) can be improved by including document-level contextual information. For this purpose, we propose a hierarchical attention model to capture the context in a structured and dynamic manner. The model is…

Computation and Language · Computer Science 2018-10-02 Lesly Miculicich , Dhananjay Ram , Nikolaos Pappas , James Henderson

Monolingual data has been demonstrated to be helpful in improving the translation quality of neural machine translation (NMT). The current methods stay at the usage of word-level knowledge, such as generating synthetic parallel data or…

Computation and Language · Computer Science 2019-08-22 Rongxiang Weng , Heng Yu , Shujian Huang , Weihua Luo , Jiajun Chen

Representing structured text from complex documents typically calls for different machine learning techniques, such as language models for paragraphs and convolutional neural networks (CNNs) for table extraction, which prohibits drawing…

Computation and Language · Computer Science 2022-02-21 Thomas Roland Barillot , Jacob Saks , Polena Lilyanova , Edward Torgas , Yachen Hu , Yuanqing Liu , Varun Balupuri , Paul Gaskell

Sentences in a well-formed text are connected to each other via various links to form the cohesive structure of the text. Current neural machine translation (NMT) systems translate a text in a conventional sentence-by-sentence fashion,…

Computation and Language · Computer Science 2018-06-15 Shaohui Kuang , Deyi Xiong , Weihua Luo , Guodong Zhou

Although end-to-end Neural Machine Translation (NMT) has achieved remarkable progress in the past two years, it suffers from a major drawback: translations generated by NMT systems often lack of adequacy. It has been widely observed that…

Computation and Language · Computer Science 2016-11-22 Zhaopeng Tu , Yang Liu , Lifeng Shang , Xiaohua Liu , Hang Li

Most real-world document collections involve various types of metadata, such as author, source, and date, and yet the most commonly-used approaches to modeling text corpora ignore this information. While specialized models have been…

Machine Learning · Statistics 2018-10-25 Dallas Card , Chenhao Tan , Noah A. Smith

Document-level context has received lots of attention for compensating neural machine translation (NMT) of isolated sentences. However, recent advances in document-level NMT focus on sophisticated integration of the context, explaining its…

Computation and Language · Computer Science 2019-10-02 Yunsu Kim , Duc Thanh Tran , Hermann Ney

Neural Machine Translation (NMT) has become the new state-of-the-art in several language pairs. However, it remains a challenging problem how to integrate NMT with a bilingual dictionary which mainly contains words rarely or never seen in…

Computation and Language · Computer Science 2016-10-25 Jiajun Zhang , Chengqing Zong

The quality of machine translation is rapidly evolving. Today one can find several machine translation systems on the web that provide reasonable translations, although the systems are not perfect. In some specific domains, the quality may…

Computation and Language · Computer Science 2015-09-30 Krzysztof Wołk , Krzysztof Marasek