English
Related papers

Related papers: Metric for Automatic Machine Translation Evaluatio…

200 papers

Machine Translation Quality Estimation is a notoriously difficult task, which lessens its usefulness in real-world translation environments. Such scenarios can be improved if quality predictions are accompanied by a measure of uncertainty.…

Computation and Language · Computer Science 2016-07-01 Daniel Beck , Lucia Specia , Trevor Cohn

End-to-end neural machine translation has overtaken statistical machine translation in terms of translation quality for some language pairs, specially those with large amounts of parallel data. Besides this palpable improvement, neural…

Computation and Language · Computer Science 2017-11-16 Cristina España-Bonet , Ádám Csaba Varga , Alberto Barrón-Cedeño , Josef van Genabith

Machine translation (MT) is an important task in natural language processing (NLP) as it automates the translation process and reduces the reliance on human translators. With the resurgence of neural networks, the translation quality…

Computation and Language · Computer Science 2021-01-14 Sameen Maruf , Fahimeh Saleh , Gholamreza Haffari

In this paper we provide the largest published comparison of translation quality for phrase-based SMT and neural machine translation across 30 translation directions. For ten directions we also include hierarchical phrase-based MT.…

Computation and Language · Computer Science 2016-12-01 Marcin Junczys-Dowmunt , Tomasz Dwojak , Hieu Hoang

Neural Machine Translation (NMT) is the task of translating a text from one language to another with the use of a trained neural network. Several existing works aim at incorporating external information into NMT models to improve or control…

Computation and Language · Computer Science 2024-04-30 Charles Brazier , Jean-Luc Rouas

Automatically creating the description of an image using any natural languages sentence like English is a very challenging task. It requires expertise of both image processing as well as natural language processing. This paper discuss about…

Computer Vision and Pattern Recognition · Computer Science 2018-10-03 Parth Shah , Vishvajit Bakarola , Supriya Pati

Automatic machine translation (MT) metrics are widely used to distinguish the translation qualities of machine translation systems across relatively large test sets (system-level evaluation). However, it is unclear if automatic metrics are…

Computation and Language · Computer Science 2023-06-21 Nikita Moghe , Tom Sherborne , Mark Steedman , Alexandra Birch

We propose a neural machine translation (NMT) approach that, instead of pursuing adequacy and fluency ("human-oriented" quality criteria), aims to generate translations that are best suited as input to a natural language processing…

Computation and Language · Computer Science 2019-10-02 Amirhossein Tebbifakhr , Luisa Bentivogli , Matteo Negri , Marco Turchi

Building conversational speech recognition systems for new languages is constrained by the availability of utterances that capture user-device interactions. Data collection is both expensive and limited by the speed of manual transcription.…

Computation and Language · Computer Science 2019-12-03 Surabhi Punjabi , Harish Arsikere , Sri Garimella

Neural machine translation (NMT), a new approach to machine translation, has achieved promising results comparable to those of traditional approaches such as statistical machine translation (SMT). Despite its recent success, NMT cannot…

Computation and Language · Computer Science 2017-07-21 Zi Long , Takehito Utsuro , Tomoharu Mitsuhashi , Mikio Yamamoto

Human evaluation of machine translation normally uses sentence-level measures such as relative ranking or adequacy scales. However, these provide no insight into possible errors, and do not scale well with sentence length. We argue for a…

Computation and Language · Computer Science 2016-09-28 Alexandra Birch , Omri Abend , Ondrej Bojar , Barry Haddow

This paper considers the problem for estimating the quality of machine translation outputs which are independent of human intervention and are generally addressed using machine learning techniques.There are various measures through which a…

Computation and Language · Computer Science 2013-09-05 Rashmi Gupta , Nisheeth Joshi , Iti Mathur

Despite its simplicity, bag-of-n-grams sen- tence representation has been found to excel in some NLP tasks. However, it has not re- ceived much attention in recent years and fur- ther analysis on its properties is necessary. We propose a…

Computation and Language · Computer Science 2018-09-19 Qi Huang , Zhanghao Chen , Zijie Lu , Yuan Ye

Machine Translation (MT) and automatic MT evaluation have improved dramatically in recent years, enabling numerous novel applications. Automatic evaluation techniques have evolved from producing scalar quality scores to precisely locating…

Computation and Language · Computer Science 2026-03-23 Stefano Perrella , Eric Morales Agostinho , Hugo Zaragoza

In view of the fact that most of the existing machine translation evaluation algorithms only consider the lexical and syntactic information, but ignore the deep semantic information contained in the sentence, this paper proposes a…

Computation and Language · Computer Science 2024-04-24 Kewei Yuan , Qiurong Zhao , Yang Xu , Xiao Zhang , Huansheng Ning

In Machine Translation, assessing the quality of a large amount of automatic translations can be challenging. Automatic metrics are not reliable when it comes to high performing systems. In addition, resorting to human evaluators can be…

Computation and Language · Computer Science 2021-05-31 Vânia Mendonça , Ricardo Rei , Luisa Coheur , Alberto Sardinha , Ana Lúcia Santos

Accurately evaluating machine-translated text remains a long-standing challenge, particularly for long documents. Recent work has shown that large language models (LLMs) can serve as reliable and interpretable sentence-level translation…

Computation and Language · Computer Science 2025-10-06 Tobias Domhan , Dawei Zhu

In order to capture rich language phenomena, neural machine translation models have to use a large vocabulary size, which requires high computing time and large memory usage. In this paper, we alleviate this issue by introducing a…

Computation and Language · Computer Science 2016-08-02 Haitao Mi , Zhiguo Wang , Abe Ittycheriah

Since long, research on machine translation has been ongoing. Still, we do not get good translations from MT engines so developed. Manual ranking of these outputs tends to be very time consuming and expensive. Identifying which one is…

Computation and Language · Computer Science 2013-11-25 Pooja Gupta , Nisheeth Joshi , Iti Mathur

Machine translation systems achieve near human-level performance on some languages, yet their effectiveness strongly relies on the availability of large amounts of parallel sentences, which hinders their applicability to the majority of…

Computation and Language · Computer Science 2018-08-15 Guillaume Lample , Myle Ott , Alexis Conneau , Ludovic Denoyer , Marc'Aurelio Ranzato
‹ Prev 1 3 4 5 6 7 10 Next ›