English
Related papers

Related papers: Discourse Centric Evaluation of Machine Translatio…

200 papers

Assessing the performance of interpreting services is a complex task, given the nuanced nature of spoken language translation, the strategies that interpreters apply, and the diverse expectations of users. The complexity of this task become…

Computation and Language · Computer Science 2024-06-17 Xiaoman Wang , Claudio Fantinuoli

Transformer architectures are increasingly effective at processing and generating very long chunks of texts, opening new perspectives for document-level machine translation (MT). In this work, we challenge the ability of MT systems to…

Computation and Language · Computer Science 2025-04-29 Ziqian Peng , Rachel Bawden , François Yvon

A major impediment to the transition to context-aware machine translation is the absence of good evaluation metrics and test sets. Sentences that require context to be translated correctly are rare in test sets, reducing the utility of…

Computation and Language · Computer Science 2023-11-07 Rachel Wicks , Matt Post

Lexical ambiguity is a challenging and pervasive problem in machine translation (\mt). We introduce a simple and scalable approach to resolve translation ambiguity by incorporating a small amount of extra-sentential context in neural \mt.…

Computation and Language · Computer Science 2023-11-28 Elijah Rippeth , Marine Carpuat , Kevin Duh , Matt Post

Robust state tracking for task-oriented dialogue systems currently remains restricted to a few popular languages. This paper shows that given a large-scale dialogue data set in one language, we can automatically produce an effective…

Computation and Language · Computer Science 2023-02-21 Mehrad Moradshahi , Victoria Tsai , Giovanni Campagna , Monica S. Lam

For machine translation to tackle discourse phenomena, models must have access to extra-sentential linguistic context. There has been recent interest in modelling context in neural machine translation (NMT), but models have been principally…

Computation and Language · Computer Science 2018-04-23 Rachel Bawden , Rico Sennrich , Alexandra Birch , Barry Haddow

In this paper, a novel approach is proposed to automatically construct parallel discourse corpus for dialogue machine translation. Firstly, the parallel subtitle data and its corresponding monolingual movie script data are crawled and…

Computation and Language · Computer Science 2016-05-24 Longyue Wang , Xiaojun Zhang , Zhaopeng Tu , Andy Way , Qun Liu

The construction of high-quality parallel corpora for translation research has increasingly evolved from simple sentence alignment to complex, multi-layered annotation tasks. This methodological shift presents significant challenges for…

Computation and Language · Computer Science 2026-02-12 Baorong Huang , Ali Asiri

Recent work in neural machine translation has demonstrated both the necessity and feasibility of using inter-sentential context -- context from sentences other than those currently being translated. However, while many current methods…

Computation and Language · Computer Science 2021-06-03 Patrick Fernandes , Kayo Yin , Graham Neubig , André F. T. Martins

Discourse coherence plays an important role in the translation of one text. However, the previous reported models most focus on improving performance over individual sentence while ignoring cross-sentence links and dependencies, which…

Computation and Language · Computer Science 2018-11-15 Hao Xiong , Zhongjun He , Hua Wu , Haifeng Wang

Recent studies in prompting large language model (LLM) for document-level machine translation (DMT) primarily focus on the inter-sentence context by flatting the source document into a long sequence. This approach relies solely on the…

Computation and Language · Computer Science 2025-03-18 Bin Liu , Xinglin Lyu , Junhui Li , Daimeng Wei , Min Zhang , Shimin Tao , Hao Yang

We reassess a recent study (Hassan et al., 2018) that claimed that machine translation (MT) has reached human parity for the translation of news from Chinese into English, using pairwise ranking and considering three variables that were not…

Computation and Language · Computer Science 2018-08-31 Antonio Toral , Sheila Castilho , Ke Hu , Andy Way

Neural machine translation (NMT) has progressed rapidly in the past few years, promising improvements and quality translations for different languages. Evaluation of this task is crucial to determine the quality of the translation. Overall,…

Computation and Language · Computer Science 2024-03-07 Carinne Cherf , Yuval Pinter

As the quality of machine translation rises and neural machine translation (NMT) is moving from sentence to document level translations, it is becoming increasingly difficult to evaluate the output of translation systems. We provide a test…

Computation and Language · Computer Science 2019-08-09 Kateřina Rysová , Magdaléna Rysová , Tomáš Musil , Lucie Poláková , Ondřej Bojar

Despite significant improvements in enhancing the quality of translation, context-aware machine translation (MT) models underperform in many cases. One of the main reasons is that they fail to utilize the correct features from context when…

Computation and Language · Computer Science 2024-05-01 Huy Hien Vu , Hidetaka Kamigaito , Taro Watanabe

The Parallel Meaning Bank is a corpus of translations annotated with shared, formal meaning representations comprising over 11 million words divided over four languages (English, German, Italian, and Dutch). Our approach is based on…

Computation and Language · Computer Science 2017-02-15 Lasha Abzianidze , Johannes Bjerva , Kilian Evang , Hessel Haagsma , Rik van Noord , Pierre Ludmann , Duc-Duy Nguyen , Johan Bos

Existing large language models (LLMs) for machine translation are typically fine-tuned on sentence-level translation instructions and achieve satisfactory performance at the sentence level. However, when applied to document-level…

Computation and Language · Computer Science 2024-01-17 Yachao Li , Junhui Li , Jing Jiang , Min Zhang

BOUQuET is a multi-way, multicentric and multi-register/domain dataset and benchmark, and a broader collaborative initiative. This dataset is handcrafted in 8 non-English languages. Each of these source languages are representative of the…

Multimodal neural machine translation (NMT) has become an increasingly important area of research over the years because additional modalities, such as image data, can provide more context to textual data. Furthermore, the viability of…

Computation and Language · Computer Science 2020-10-20 Andrew Merritt , Chenhui Chu , Yuki Arase

The high-quality translation results produced by machine translation (MT) systems still pose a huge challenge for automatic evaluation. Current MT evaluation pays the same attention to each sentence component, while the questions of…

Computation and Language · Computer Science 2021-08-02 Runzhe Zhan , Xuebo Liu , Derek F. Wong , Lidia S. Chao