English
Related papers

Related papers: COMET: A Neural Framework for MT Evaluation

200 papers

With the fast development of Machine Translation (MT) systems, especially the new boost from Neural MT (NMT) models, the MT output quality has reached a new level of accuracy. However, many researchers criticised that the current popular…

Computation and Language · Computer Science 2022-11-11 Lifeng Han

A key challenge in MT evaluation is the inherent noise and inconsistency of human ratings. Regression-based neural metrics struggle with this noise, while prompting LLMs shows promise at system-level evaluation but performs poorly at…

Computation and Language · Computer Science 2025-04-21 Shaomu Tan , Christof Monz

Improving neural machine translation (NMT) systems with prompting has achieved significant progress in recent years. In this work, we focus on how to integrate multi-knowledge, multiple types of knowledge, into NMT models to enhance the…

Computation and Language · Computer Science 2023-12-11 Ke Wang , Jun Xie , Yuqi Zhang , Yu Zhao

State-of-the-art machine translation models are still not on par with human translators. Previous work takes human interactions into the neural machine translation process to obtain improved results in target languages. However, not all…

Computation and Language · Computer Science 2019-08-14 Rongxiang Weng , Hao Zhou , Shujian Huang , Lei Li , Yifan Xia , Jiajun Chen

The recently proposed massively multilingual neural machine translation (NMT) system has been shown to be capable of translating over 100 languages to and from English within a single model. Its improved translation performance on low…

Computation and Language · Computer Science 2019-11-13 Aditya Siddhant , Melvin Johnson , Henry Tsai , Naveen Arivazhagan , Jason Riesa , Ankur Bapna , Orhan Firat , Karthik Raman

We introduce a novel continued pre-training method, MELT (MatEriaLs-aware continued pre-Training), specifically designed to efficiently adapt the pre-trained language models (PLMs) for materials science. Unlike previous adaptation…

Computation and Language · Computer Science 2024-10-22 Junho Kim , Yeachan Kim , Jun-Hyung Park , Yerim Oh , Suho Kim , SangKeun Lee

Machine translation (MT) was developed as one of the hottest research topics in the natural language processing (NLP) literature. One important issue in MT is that how to evaluate the MT system reasonably and tell us whether the translation…

Computation and Language · Computer Science 2022-01-25 Lifeng Han

Document-level machine translation manages to outperform sentence level models by a small margin, but have failed to be widely adopted. We argue that previous research did not make a clear use of the global context, and propose a new…

Computation and Language · Computer Science 2020-09-10 Zaixiang Zheng , Xiang Yue , Shujian Huang , Jiajun Chen , Alexandra Birch

Recent years have seen big advances in the field of sentence-level quality estimation (QE), largely as a result of using neural-based architectures. However, the majority of these methods work only on the language pair they are trained on…

Computation and Language · Computer Science 2020-11-05 Tharindu Ranasinghe , Constantin Orasan , Ruslan Mitkov

Contrastive representation learning is crucial in medical time series analysis as it alleviates dependency on labor-intensive, domain-specific, and scarce expert annotations. However, existing contrastive learning methods primarily focus on…

Machine Learning · Computer Science 2023-11-07 Yihe Wang , Yu Han , Haishuai Wang , Xiang Zhang

Multimodal machine translation (MMT) aims to improve translation quality by incorporating information from other modalities, such as vision. Previous MMT systems mainly focus on better access and use of visual information and tend to…

Computation and Language · Computer Science 2023-09-06 Yaoming Zhu , Zewei Sun , Shanbo Cheng , Luyang Huang , Liwei Wu , Mingxuan Wang

Data quality is crucial in machine learning (ML) applications, as errors in the data can significantly impact the prediction accuracy of the underlying ML model. Therefore, data cleaning is an integral component of any ML pipeline. However,…

Databases · Computer Science 2025-03-17 Sedir Mohammed , Felix Naumann , Hazar Harmouch

One of the major challenges of machine translation (MT) is ambiguity, which can in some cases be resolved by accompanying context such as images. However, recent work in multimodal MT (MMT) has shown that obtaining improvements from images…

Computation and Language · Computer Science 2023-05-29 Matthieu Futeral , Cordelia Schmid , Ivan Laptev , Benoît Sagot , Rachel Bawden

Multilingual neural machine translation (NMT) enables training a single model that supports translation from multiple source languages into multiple target languages. In this paper, we push the limits of multilingual NMT in terms of number…

Computation and Language · Computer Science 2019-07-03 Roee Aharoni , Melvin Johnson , Orhan Firat

It is expensive to evaluate the results of Machine Translation(MT), which usually requires manual translation as a reference. Machine Translation Quality Estimation (QE) is a task of predicting the quality of machine translations without…

Computation and Language · Computer Science 2022-04-19 Lei Lin

Multiple pre-training objectives fill the vacancy of the understanding capability of single-objective language modeling, which serves the ultimate purpose of pre-trained language models (PrLMs), generalizing well on a mass of scenarios.…

Computation and Language · Computer Science 2022-10-20 Hongqiu Wu , Ruixue Ding , Hai Zhao , Boli Chen , Pengjun Xie , Fei Huang , Min Zhang

We hypothesize that existing sentence-level machine translation (MT) metrics become less effective when the human reference contains ambiguities. To verify this hypothesis, we present a very simple method for extending pretrained metrics to…

Computation and Language · Computer Science 2022-09-29 Giorgos Vernikos , Brian Thompson , Prashant Mathur , Marcello Federico

The challenge of visual grounding and masking in multimodal machine translation (MMT) systems has encouraged varying approaches to the detection and selection of visually-grounded text tokens for masking. We introduce new methods for…

Computation and Language · Computer Science 2024-03-06 Braeden Bowen , Vipin Vijayan , Scott Grigsby , Timothy Anderson , Jeremy Gwinnup

This paper investigates the development and evaluation of machine translation models from Cantonese to English, where we propose a novel approach to tackle low-resource language translations. The main objectives of the study are to develop…

Computation and Language · Computer Science 2024-05-15 Kung Yin Hong , Lifeng Han , Riza Batista-Navarro , Goran Nenadic

Large language models have demonstrated the capability to perform on machine translation when the input is prompted with a few examples (in-context learning). Translation quality depends on various features of the selected examples, such as…

Computation and Language · Computer Science 2023-10-24 Aswanth Kumar , Ratish Puduppully , Raj Dabre , Anoop Kunchukuttan