English
Related papers

Related papers: Context-Aware Monolingual Human Evaluation of Mach…

200 papers

Substantial improvements have been made in machine reading comprehension, where the machine answers questions based on a given context. Current state-of-the-art models even surpass human performance on several benchmarks. However, their…

Computation and Language · Computer Science 2021-05-11 Wei-Cheng Huang , Chien-yu Huang , Hung-yi Lee

Machine translation has an undesirable propensity to produce "translationese" artifacts, which can lead to higher BLEU scores while being liked less by human raters. Motivated by this, we model translationese and original (i.e. natural)…

Computation and Language · Computer Science 2020-07-13 Parker Riley , Isaac Caswell , Markus Freitag , David Grangier

This work presents our efforts to reproduce the results of the human evaluation experiment presented in the paper of Vamvas and Sennrich (2022), which evaluated an automatic system detecting over- and undertranslations (translations…

Computation and Language · Computer Science 2023-08-15 Ondřej Plátek , Mateusz Lango , Ondřej Dušek

Multilingual semantic parsing aims to leverage the knowledge from the high-resource languages to improve low-resource semantic parsing, yet commonly suffers from the data imbalance problem. Prior works propose to utilize the translations by…

Computation and Language · Computer Science 2023-05-23 Zhuang Li , Lizhen Qu , Philip R. Cohen , Raj V. Tumuluri , Gholamreza Haffari

Compared to sentence-level systems, document-level neural machine translation (NMT) models produce a more consistent output across a document and are able to better resolve ambiguities within the input. There are many works on…

Computation and Language · Computer Science 2023-06-09 Christian Herold , Hermann Ney

Automatic translation systems offer a powerful solution to bridge language barriers in scenarios where participants do not share a common language. However, these systems can introduce errors leading to misunderstandings and conversation…

Computation and Language · Computer Science 2025-07-01 José Pombal , Sweta Agrawal , Patrick Fernandes , Emmanouil Zaranis , André F. T. Martins

In document-level neural machine translation (DocNMT), multi-encoder approaches are common in encoding context and source sentences. Recent studies \cite{li-etal-2020-multi-encoder} have shown that the context encoder generates noise and…

Computation and Language · Computer Science 2024-07-04 Ramakrishna Appicharla , Baban Gain , Santanu Pal , Asif Ekbal , Pushpak Bhattacharyya

An all-too-present bottleneck for text classification model development is the need to annotate training data and this need is multiplied for multilingual classifiers. Fortunately, contemporary machine translation models are both easily…

Computation and Language · Computer Science 2024-05-10 Adam King

High-quality machine translation (MT) can scale to hundreds of languages, setting a high bar for multilingual systems. However, compared to the world's 7,000 languages, current systems still offer only limited coverage: about 200 languages…

One of the major challenges of machine translation (MT) is ambiguity, which can in some cases be resolved by accompanying context such as images. However, recent work in multimodal MT (MMT) has shown that obtaining improvements from images…

Computation and Language · Computer Science 2023-05-29 Matthieu Futeral , Cordelia Schmid , Ivan Laptev , Benoît Sagot , Rachel Bawden

Neural Machine Translation (NMT) approaches employing monolingual data are showing steady improvements in resource rich conditions. However, evaluations using real-world low-resource languages still result in unsatisfactory performance.…

Computation and Language · Computer Science 2021-03-11 Surafel M. Lakew , Matteo Negri , Marco Turchi

This paper proposes the use of ``pattern-based'' context-free grammars as a basis for building machine translation (MT) systems, which are now being adopted as personal tools by a broad range of users in the cyberspace society. We discuss…

cmp-lg · Computer Science 2008-02-03 Koichi Takeda

Machine translation (MT) has benefited from using synthetic training data originating from translating monolingual corpora, a technique known as backtranslation. Combining backtranslated data from different sources has led to better results…

Computation and Language · Computer Science 2020-05-04 Xabier Soto , Dimitar Shterionov , Alberto Poncelas , Andy Way

Sentiment classification has been crucial for many natural language processing (NLP) applications, such as the analysis of movie reviews, tweets, or customer feedback. A sufficiently large amount of data is required to build a robust…

Computation and Language · Computer Science 2020-08-27 Alberto Poncelas , Pintu Lohar , Andy Way , James Hadley

Machine learning algorithms are now capable of performing evaluations previously conducted by human experts (e.g., medical diagnoses). How should we conceptualize the difference between evaluation by humans and by algorithms, and when…

Theoretical Economics · Economics 2024-07-02 Andrei Iakovlev , Annie Liang

High-performing machine translation (MT) systems can help overcome language barriers while making it possible for everyone to communicate and use language technologies in the language of their choice. However, such systems require large…

Computation and Language · Computer Science 2021-06-15 Rajat Bhatnagar , Ananya Ganesh , Katharina Kann

Starting from the 1950s, Machine Translation (MT) was challenged by different scientific solutions, which included rule-based methods, example-based and statistical models (SMT), to hybrid models, and very recent years the neural models…

Computation and Language · Computer Science 2025-08-07 Lifeng Han , Serge Gladkoff

The ability of generative large language models (LLMs) to perform in-context learning has given rise to a large body of research into how best to prompt models for various natural language processing tasks. In this paper, we focus on…

Computation and Language · Computer Science 2024-08-02 Armel Zebaze , Benoît Sagot , Rachel Bawden

Neural machine translation (NMT) is often criticized for failures that happen without awareness. The lack of competency awareness makes NMT untrustworthy. This is in sharp contrast to human translators who give feedback or conduct further…

Computation and Language · Computer Science 2022-11-28 Pei Zhang , Baosong Yang , Haoran Wei , Dayiheng Liu , Kai Fan , Luo Si , Jun Xie

Large language models (LLMs) have showcased impressive multilingual machine translation ability. However, unlike encoder-decoder style models, decoder-only LLMs lack an explicit alignment between source and target contexts. Analyzing…

Computation and Language · Computer Science 2024-06-12 Hongbin Zhang , Kehai Chen , Xuefeng Bai , Yang Xiang , Min Zhang