English
Related papers

Related papers: The JHU-Microsoft Submission for WMT21 Quality Est…

200 papers

Devising metrics to assess translation quality has always been at the core of machine translation (MT) research. Traditional automatic reference-based metrics, such as BLEU, have shown correlations with human judgements of adequacy and…

Computation and Language · Computer Science 2019-10-15 Carolina Scarton , Mikel L. Forcada , Miquel Esplà-Gomis , Lucia Specia

This work introduces a simple regressive ensemble for evaluating machine translation quality based on a set of novel and established metrics. We evaluate the ensemble using a correlation to expert-based MQM scores of the WMT 2021 Metrics…

Computation and Language · Computer Science 2021-09-16 Michal Štefánik , Vít Novotný , Petr Sojka

This paper describes the Stevens Institute of Technology's submission for the WMT 2022 Shared Task: Code-mixed Machine Translation (MixMT). The task consisted of two subtasks, subtask $1$ Hindi/English to Hinglish and subtask $2$ Hinglish…

Computation and Language · Computer Science 2022-11-18 Abdul Rafae Khan , Hrishikesh Kanade , Girish Amar Budhrani , Preet Jhanglani , Jia Xu

Translation quality evaluation plays a crucial role in machine translation. According to the input format, it is mainly separated into three tasks, i.e., reference-only, source-only and source-reference-combined. Recent methods, despite…

Computation and Language · Computer Science 2022-10-20 Yu Wan , Dayiheng Liu , Baosong Yang , Haibo Zhang , Boxing Chen , Derek F. Wong , Lidia S. Chao

This paper describes Tencent AI Lab - Shanghai Jiao Tong University (TAL-SJTU) Low-Resource Translation systems for the WMT22 shared task. We participate in the general translation task on English$\Leftrightarrow$Livonian. Our system is…

Computation and Language · Computer Science 2022-10-18 Zhiwei He , Xing Wang , Zhaopeng Tu , Shuming Shi , Rui Wang

This paper presents the open-system submission by the In2x research team for the WMT25 General Machine Translation Shared Task. Our submission focuses on Japanese-related translation tasks, aiming to explore a generalizable paradigm for…

Computation and Language · Computer Science 2025-08-21 Lei Pang , Hanyi Mao , Quanjia Xiao , HaiXiao Liu , Xiangyi Li

This paper describes Charles University submission for Multilingual Low-Resource Translation for Indo-European Languages shared task at WMT21. We competed in translation from Catalan into Romanian, Italian and Occitan. Our systems are based…

Computation and Language · Computer Science 2021-09-21 Josef Jon , Michal Novák , João Paulo Aires , Dušan Variš , Ondřej Bojar

In this paper, we present the MetricX-24 submissions to the WMT24 Metrics Shared Task and provide details on the improvements we made over the previous version of MetricX. Our primary submission is a hybrid reference-based/-free metric,…

Computation and Language · Computer Science 2024-10-08 Juraj Juraska , Daniel Deutsch , Mara Finkelstein , Markus Freitag

We present the joint contribution of IST and Unbabel to the WMT 2022 Shared Task on Quality Estimation (QE). Our team participated on all three subtasks: (i) Sentence and Word-level Quality Prediction; (ii) Explainable QE; and (iii)…

The University of Cambridge submission to the WMT18 news translation task focuses on the combination of diverse models of translation. We compare recurrent, convolutional, and self-attention-based neural models on German-English,…

Computation and Language · Computer Science 2018-08-30 Felix Stahlberg , Adria de Gispert , Bill Byrne

We report the result of the first edition of the WMT shared task on Translation Suggestion (TS). The task aims to provide alternatives for specific words or phrases given the entire documents generated by machine translation (MT). It…

Computation and Language · Computer Science 2022-12-01 Zhen Yang , Fandong Meng , Yingxue Zhang , Ernan Li , Jie Zhou

This paper presents the JGU Mainz submission to the WMT25 Shared Task on LLMs with Limited Resources for Slavic Languages: Machine Translation and Question Answering, focusing on Ukrainian, Upper Sorbian, and Lower Sorbian. For each…

Computation and Language · Computer Science 2025-09-29 Hossain Shaikh Saadi , Minh Duc Bui , Mario Sanz-Guerrero , Katharina von der Wense

This paper describes Netmarble's submission to WMT21 Automatic Post-Editing (APE) Shared Task for the English-German language pair. First, we propose a Curriculum Training Strategy in training stages. Facebook Fair's WMT19 news translation…

Computation and Language · Computer Science 2021-11-17 Shinhyeok Oh , Sion Jang , Hu Xu , Shounan An , Insoo Oh

This preliminary study investigates the usefulness of sentence-level Quality Estimation (QE) in English-Chinese Machine Translation Post-Editing (MTPE), focusing on its impact on post-editing speed and student translators' perceptions. It…

Computation and Language · Computer Science 2025-07-23 Siqi Liu , Guangrong Dai , Dechao Li

Current Machine Translation systems achieve very good results on a growing variety of language pairs and data sets. However, it is now well known that they produce fluent translation outputs that often can contain important meaning errors.…

Computation and Language · Computer Science 2023-06-28 Vibhuti Kumari , Narayana Murthy Kavi

In this paper, we introduce the Eval4NLP-2021shared task on explainable quality estimation. Given a source-translation pair, this shared task requires not only to provide a sentence-level score indicating the overall quality of the…

Computation and Language · Computer Science 2021-10-12 Marina Fomicheva , Piyawat Lertvittayakumjorn , Wei Zhao , Steffen Eger , Yang Gao

This paper describes the UvA-MT's submission to the WMT 2023 shared task on general machine translation. We participate in the constrained track in two directions: English <-> Hebrew. In this competition, we show that by using one model to…

Computation and Language · Computer Science 2023-10-17 Di Wu , Shaomu Tan , David Stap , Ali Araabi , Christof Monz

This paper describes the multimodal Neural Machine Translation systems developed by LIUM and CVC for WMT18 Shared Task on Multimodal Translation. This year we propose several modifications to our previous multimodal attention architecture…

Computation and Language · Computer Science 2018-09-05 Ozan Caglayan , Adrien Bardet , Fethi Bougares , Loïc Barrault , Kai Wang , Marc Masana , Luis Herranz , Joost van de Weijer

This paper presents the findings from the third edition of the Chat Translation Shared Task. As with previous editions, the task involved translating bilingual customer support conversations, specifically focusing on the impact of…

Computation and Language · Computer Science 2024-10-16 Wafaa Mohammed , Sweta Agrawal , M. Amin Farajian , Vera Cabarrão , Bryan Eikema , Ana C. Farinha , José G. C. de Souza

This paper describes the systems that we submitted to the WMT19 Machine Translation robustness task. This task aims to improve MT's robustness to noise found on social media, like informal language, spelling mistakes and other orthographic…

Computation and Language · Computer Science 2019-07-16 Alexandre Bérard , Ioan Calapodescu , Claude Roux