English
Related papers

Related papers: Has Machine Translation Achieved Human Parity? A C…

200 papers

Existing research indicates that machine translations (MTs) of literary texts are often unsatisfactory. MTs are typically evaluated using automated metrics and subjective human ratings, with limited focus on stylistic features. Evidence is…

Computation and Language · Computer Science 2025-11-26 Xiaofang Yao , Yong-Bin Kang , Anthony McCosker

This paper does not aim at introducing a novel model for document-level neural machine translation. Instead, we head back to the original Transformer model and hope to answer the following question: Is the capacity of current models strong…

Computation and Language · Computer Science 2022-03-15 Zewei Sun , Mingxuan Wang , Hao Zhou , Chengqi Zhao , Shujian Huang , Jiajun Chen , Lei Li

There are many machine translation (MT) papers that propose novel approaches and show improvements over their self-defined baselines. The experimental setting in each paper often differs from one another. As such, it is hard to determine if…

Computation and Language · Computer Science 2018-05-07 Christian Hadiwinoto , Hwee Tou Ng

Objective: Today's neural machine translation (NMT) can achieve near human-level translation quality and greatly facilitates international communications, but the lack of parallel corpora poses a key problem to the development of…

Computation and Language · Computer Science 2022-02-08 Shengxuan Luo , Huaiyuan Ying , Jiao Li , Sheng Yu

Machine-translated text plays an important role in modern life by smoothing communication from various communities using different languages. However, unnatural translation may lead to misunderstanding, a detector is thus needed to avoid…

Computation and Language · Computer Science 2019-04-25 Hoang-Quoc Nguyen-Son , Tran Phuong Thao , Seira Hidano , Shinsaku Kiyomoto

Neural machine translation (NMT) is often criticized for failures that happen without awareness. The lack of competency awareness makes NMT untrustworthy. This is in sharp contrast to human translators who give feedback or conduct further…

Computation and Language · Computer Science 2022-11-28 Pei Zhang , Baosong Yang , Haoran Wei , Dayiheng Liu , Kai Fan , Luo Si , Jun Xie

Neural machine translation (NMT) becomes a new approach to machine translation and generates much more fluent results compared to statistical machine translation (SMT). However, SMT is usually better than NMT in translation adequacy. It is…

Computation and Language · Computer Science 2017-04-24 Long Zhou , Wenpeng Hu , Jiajun Zhang , Chengqing Zong

Document-level machine translation focuses on the translation of entire documents from a source to a target language. It is widely regarded as a challenging task since the translation of the individual sentences in the document needs to…

Computation and Language · Computer Science 2020-10-21 Inigo Jauregi Unanue , Nazanin Esmaili , Gholamreza Haffari , Massimo Piccardi

Annually, at the Conference of Machine Translation (WMT), the Metrics Shared Task organizers conduct the meta-evaluation of Machine Translation (MT) metrics, ranking them according to their correlation with human judgments. Their results…

Computation and Language · Computer Science 2024-08-27 Stefano Perrella , Lorenzo Proietti , Alessandro Scirè , Edoardo Barba , Roberto Navigli

Recent research has focused on literary machine translation (MT) as a new challenge in MT. However, the evaluation of literary MT remains an open problem. We contribute to this ongoing discussion by introducing LITEVAL-CORPUS, a…

Computation and Language · Computer Science 2025-02-26 Ran Zhang , Wei Zhao , Steffen Eger

Monolingual data has been demonstrated to be helpful in improving the translation quality of neural machine translation (NMT). The current methods stay at the usage of word-level knowledge, such as generating synthetic parallel data or…

Computation and Language · Computer Science 2019-08-22 Rongxiang Weng , Heng Yu , Shujian Huang , Weihua Luo , Jiajun Chen

While neural machine translation (NMT) has achieved state-of-the-art translation performance, it is unable to capture the alignment between the input and output during the translation process. The lack of alignment in NMT models leads to…

Computation and Language · Computer Science 2019-12-02 Jiacheng Zhang , Huanbo Luan , Maosong Sun , FeiFei Zhai , Jingfang Xu , Yang Liu

We test the natural expectation that using MT in professional translation saves human processing time. The last such study was carried out by Sanchez-Torron and Koehn (2016) with phrase-based MT, artificially reducing the translation…

Computation and Language · Computer Science 2021-09-13 Vilém Zouhar , Aleš Tamchyna , Martin Popel , Ondřej Bojar

Translating literary works has perennially stood as an elusive dream in machine translation (MT), a journey steeped in intricate challenges. To foster progress in this domain, we hold a new shared task at WMT 2023, the first edition of the…

Standard neural machine translation (NMT) is on the assumption of document-level context independent. Most existing document-level NMT methods are satisfied with a smattering sense of brief document-level information, while this work…

Computation and Language · Computer Science 2021-10-13 Shu Jiang , Hai Zhao , Zuchao Li , Bao-Liang Lu

Neural Machine Translation (NMT) is a new approach to machine translation that has made great progress in recent years. However, recent studies show that NMT generally produces fluent but inadequate translations (Tu et al. 2016b; Tu et al.…

Computation and Language · Computer Science 2017-01-02 Xing Wang , Zhengdong Lu , Zhaopeng Tu , Hang Li , Deyi Xiong , Min Zhang

Prior studies have shown that distinguishing text generated by Large Language Models (LLMs) from human-written one is highly challenging for humans, and often no better than random guessing. To verify the generalizability of this finding…

Several recent papers claim human parity at sentence-level Machine Translation (MT), especially in high-resource languages. Thus, in response, the MT community has, in part, shifted its focus to document-level translation. Translating…

Computation and Language · Computer Science 2023-05-19 Yuchen Eleanor Jiang , Tianyu Liu , Shuming Ma , Dongdong Zhang , Mrinmaya Sachan , Ryan Cotterell

Since the 1950s, machine translation (MT) has become one of the important tasks of AI and development, and has experienced several different periods and stages of development, including rule-based methods, statistical methods, and recently…

Computation and Language · Computer Science 2022-02-23 Lifeng Han

We aim to shed light on the strengths and weaknesses of the newly introduced neural machine translation paradigm. To that end, we conduct a multifaceted evaluation in which we compare outputs produced by state-of-the-art neural machine…

Computation and Language · Computer Science 2017-01-12 Antonio Toral , Víctor M. Sánchez-Cartagena