English
Related papers

Related papers: COMET: A Neural Framework for MT Evaluation

200 papers

Quality Estimation (QE) models for Neural Machine Translation (NMT) predict the quality of the hypothesis without having access to the reference. An emerging research direction in NMT involves the use of QE models, which have demonstrated…

Computation and Language · Computer Science 2025-06-03 Sai Koneru , Matthias Huck , Miriam Exel , Jan Niehues

Mathematical formulas are a fundamental and widely used component in various scientific fields, serving as a universal language for expressing complex concepts and relationships. While state-of-the-art transformer models excel in processing…

Computation and Language · Computer Science 2025-07-09 Jonathan Drechsel , Anja Reusch , Steffen Herbold

The use of language models for automatically evaluating long-form text (LLM-as-a-judge) is becoming increasingly common, yet most LLM judges are optimized exclusively for English, with strategies for enhancing their multilingual evaluation…

Computation and Language · Computer Science 2025-10-31 José Pombal , Dongkeun Yoon , Patrick Fernandes , Ian Wu , Seungone Kim , Ricardo Rei , Graham Neubig , André F. T. Martins

In this paper, we introduce DOCmT5, a multilingual sequence-to-sequence language model pretrained with large scale parallel documents. While previous approaches have focused on leveraging sentence-level parallel data, we try to build a…

Computation and Language · Computer Science 2022-05-06 Chia-Hsuan Lee , Aditya Siddhant , Viresh Ratnakar , Melvin Johnson

Machine-translated benchmark datasets reduce costs and offer scale, but noise, loss of structure, and uneven quality weaken confidence. What matters is not merely whether we can translate, but also whether we can measure and verify…

Computation and Language · Computer Science 2026-04-03 Klaudia Thellmann , Bernhard Stadler , Michael Färber

Neural machine translation (NMT) becomes a new approach to machine translation and generates much more fluent results compared to statistical machine translation (SMT). However, SMT is usually better than NMT in translation adequacy. It is…

Computation and Language · Computer Science 2017-04-24 Long Zhou , Wenpeng Hu , Jiajun Zhang , Chengqing Zong

Neural machine translation (NMT) models are conventionally trained with token-level negative log-likelihood (NLL), which does not guarantee that the generated translations will be optimized for a selected sequence-level evaluation metric.…

Computation and Language · Computer Science 2021-04-16 Raphael Shu , Kang Min Yoo , Jung-Woo Ha

A neural multimodal machine translation (MMT) system is one that aims to perform better translation by extending conventional text-only translation models with multimodal information. Many recent studies report improvements when equipping…

Computation and Language · Computer Science 2021-06-01 Zhiyong Wu , Lingpeng Kong , Wei Bi , Xiang Li , Ben Kao

Neural Machine Translation (NMT) has shown drastic improvement in its quality when translating clean input, such as text from the news domain. However, existing studies suggest that NMT still struggles with certain kinds of input with…

Computation and Language · Computer Science 2026-04-29 Ryo Fujii , Masato Mita , Kaori Abe , Kazuaki Hanawa , Makoto Morishita , Jun Suzuki , Kentaro Inui

Deep learning has witnessed significant advancements in recent years at the cost of increasing training, inference, and model storage overhead. While existing model compression methods strive to reduce the number of model parameters while…

Machine Learning · Computer Science 2024-01-12 Wujie Sun , Defang Chen , Jiawei Chen , Yan Feng , Chun Chen , Can Wang

We consider the problem of tracking an unknown small target from aerial videos of medium to high altitudes. This is a challenging problem, which is even more pronounced in unavoidable scenarios of drastic camera motion and high density. To…

Computer Vision and Pattern Recognition · Computer Science 2020-09-21 Seyed Mojtaba Marvasti-Zadeh , Javad Khaghani , Hossein Ghanei-Yakhdan , Shohreh Kasaei , Li Cheng

We present a survey on multilingual neural machine translation (MNMT), which has gained a lot of traction in the recent years. MNMT has been useful in improving translation quality as a result of knowledge transfer. MNMT is more promising…

Computation and Language · Computer Science 2020-01-08 Raj Dabre , Chenhui Chu , Anoop Kunchukuttan

While most neural machine translation (NMT) systems are still trained using maximum likelihood estimation, recent work has demonstrated that optimizing systems to directly improve evaluation metrics such as BLEU can substantially improve…

Computation and Language · Computer Science 2019-09-17 John Wieting , Taylor Berg-Kirkpatrick , Kevin Gimpel , Graham Neubig

Multilingual neural machine translation (MNMT) aims to translate multiple languages with a single model and has been proved successful thanks to effective knowledge transfer among different languages with shared parameters. However, it is…

Computation and Language · Computer Science 2021-12-28 Qian Wang , Jiajun Zhang

Large language models (LLMs) and multi-agent orchestration are touted as the next leap in machine translation (MT), but their benefits relative to conventional neural MT (NMT) remain unclear. This paper offers an empirical reality check. We…

Computation and Language · Computer Science 2025-05-06 Vicent Briva Iglesias , Gokhan Dogru

We present Neural Machine Translation (NMT) training using document-level metrics with batch-level documents. Previous sequence-objective approaches to NMT training focus exclusively on sentence-level metrics like sentence BLEU which do not…

Computation and Language · Computer Science 2020-05-05 Danielle Saunders , Felix Stahlberg , Bill Byrne

Multilingual NMT is a viable solution for translating low-resource languages (LRLs) when data from high-resource languages (HRLs) from the same language family is available. However, the training schedule, i.e. the order of presentation of…

Computation and Language · Computer Science 2025-06-03 Alexis Allemann , Àlex R. Atrio , Andrei Popescu-Belis

We introduce a new, extensive multidimensional quality metrics (MQM) annotated dataset covering 11 language pairs in the biomedical domain. We use this dataset to investigate whether machine translation (MT) metrics which are fine-tuned on…

Computation and Language · Computer Science 2024-06-05 Vilém Zouhar , Shuoyang Ding , Anna Currey , Tatyana Badeka , Jenyuan Wang , Brian Thompson

In this paper, we present our first attempts in building a multilingual Neural Machine Translation framework under a unified approach. We are then able to employ attention-based NMT for many-to-many multilingual translation tasks. Our…

Computation and Language · Computer Science 2016-11-16 Thanh-Le Ha , Jan Niehues , Alexander Waibel

Multi-domain machine translation (MDMT) aims to build a unified model capable of translating content across diverse domains. Despite the impressive machine translation capabilities demonstrated by large language models (LLMs), domain…

Computation and Language · Computer Science 2026-02-06 Shuting Jiang , Ran Song , Yuxin Huang , Yan Xiang , Yantuan Xian , Shengxiang Gao , Zhengtao Yu