中文
相关论文

相关论文: Automatic Machine Translation Evaluation in Many L…

200 篇论文

Paraphrases, the rewordings of the same semantic meaning, are useful for improving generalization and translation. However, prior works only explore paraphrases at the word or phrase level, not at the sentence or corpus level. Unlike…

计算与语言 · 计算机科学 2021-10-04 Zhong Zhou , Matthias Sperber , Alex Waibel

Leveraging large language models (LLMs) for various natural language processing tasks has led to superlative claims about their performance. For the evaluation of machine translation (MT), existing research shows that LLMs are able to…

Recent advances in statistical machine translation via the adoption of neural sequence-to-sequence models empower the end-to-end system to achieve state-of-the-art in many WMT benchmarks. The performance of such machine translation (MT)…

计算与语言 · 计算机科学 2018-11-20 Kai Fan , Jiayi Wang , Bo Li , Fengming Zhou , Boxing Chen , Luo Si

Paraphrasing exemplifies the ability to abstract semantic content from surface forms. Recent work on automatic paraphrasing is dominated by methods leveraging Machine Translation (MT) as an intermediate step. This contrasts with humans, who…

机器学习 · 计算机科学 2019-05-31 Aurko Roy , David Grangier

Non-autoregressive neural machine translation (NAT) models suffer from the multi-modality problem that there may exist multiple possible translations of a source sentence, so the reference sentence may be inappropriate for the training when…

计算与语言 · 计算机科学 2022-12-01 Chenze Shao , Jinchao Zhang , Jie Zhou , Yang Feng

We describe GEMBA, a GPT-based metric for assessment of translation quality, which works both with a reference translation and without. In our evaluation, we focus on zero-shot prompting, comparing four prompt variants in two modes, based…

计算与语言 · 计算机科学 2023-06-02 Tom Kocmi , Christian Federmann

We present ParaBank, a large-scale English paraphrase dataset that surpasses prior work in both quantity and quality. Following the approach of ParaNMT, we train a Czech-English neural machine translation (NMT) system to generate novel…

计算与语言 · 计算机科学 2019-01-14 J. Edward Hu , Rachel Rudinger , Matt Post , Benjamin Van Durme

As neural machine translation (NMT) systems become an important part of professional translator pipelines, a growing body of work focuses on combining NMT with terminologies. In many scenarios and particularly in cases of domain adaptation,…

In Machine Translation, assessing the quality of a large amount of automatic translations can be challenging. Automatic metrics are not reliable when it comes to high performing systems. In addition, resorting to human evaluators can be…

计算与语言 · 计算机科学 2021-05-31 Vânia Mendonça , Ricardo Rei , Luisa Coheur , Alberto Sardinha , Ana Lúcia Santos

The many-to-many multilingual neural machine translation can be regarded as the process of integrating semantic features from the source sentences and linguistic features from the target sentences. To enhance zero-shot translation, models…

计算与语言 · 计算机科学 2024-08-05 Mengyu Bu , Shuhao Gu , Yang Feng

This paper studies zero-shot cross-lingual transfer of vision-language models. Specifically, we focus on multilingual text-to-video search and propose a Transformer-based model that learns contextualized multilingual multimodal embeddings.…

计算机视觉与模式识别 · 计算机科学 2021-04-16 Po-Yao Huang , Mandela Patrick , Junjie Hu , Graham Neubig , Florian Metze , Alexander Hauptmann

Automatic machine translation metrics typically rely on human translations to determine the quality of system translations. Common wisdom in the field dictates that the human references should be of very high quality. However, there are no…

计算与语言 · 计算机科学 2024-04-11 Vilém Zouhar , Ondřej Bojar

When training multilingual machine translation (MT) models that can translate to/from multiple languages, we are faced with imbalanced training sets: some languages have much more training data than others. Standard practice is to up-sample…

计算与语言 · 计算机科学 2020-09-08 Xinyi Wang , Yulia Tsvetkov , Graham Neubig

Large language models trained primarily in a monolingual setting have demonstrated their ability to generalize to machine translation using zero- and few-shot examples with in-context learning. However, even though zero-shot translations…

计算与语言 · 计算机科学 2023-11-07 Weiting Tan , Haoran Xu , Lingfeng Shen , Shuyue Stella Li , Kenton Murray , Philipp Koehn , Benjamin Van Durme , Yunmo Chen

While multilingual language models (MLMs) have been trained on 100+ languages, they are typically only evaluated across a handful of them due to a lack of available test data in most languages. This is particularly problematic when…

计算与语言 · 计算机科学 2024-06-21 Rochelle Choenni , Sara Rajaee , Christof Monz , Ekaterina Shutova

Previous work mainly focuses on improving cross-lingual transfer for NLU tasks with a multilingual pretrained encoder (MPE), or improving the performance on supervised machine translation with BERT. However, it is under-explored that…

计算与语言 · 计算机科学 2021-11-08 Guanhua Chen , Shuming Ma , Yun Chen , Li Dong , Dongdong Zhang , Jia Pan , Wenping Wang , Furu Wei

Multilingual neural machine translation (MNMT) learns to translate multiple language pairs with a single model, potentially improving both the accuracy and the memory-efficiency of deployed models. However, the heavy data imbalance between…

计算与语言 · 计算机科学 2021-09-10 Chunting Zhou , Daniel Levy , Xian Li , Marjan Ghazvininejad , Graham Neubig

Neural Machine Translation (NMT) is a new approach for Machine Translation (MT), and due to its success, it has absorbed the attention of many researchers in the field. In this paper, we study NMT model on Persian-English language pairs, to…

计算与语言 · 计算机科学 2017-01-10 Mohaddeseh Bastan , Shahram Khadivi , Mohammad Mehdi Homayounpour

Evaluation of cross-lingual encoders is usually performed either via zero-shot cross-lingual transfer in supervised downstream tasks or via unsupervised cross-lingual textual similarity. In this paper, we concern ourselves with…

计算与语言 · 计算机科学 2020-06-09 Wei Zhao , Goran Glavaš , Maxime Peyrard , Yang Gao , Robert West , Steffen Eger

While a source sentence can be translated in many ways, most machine translation (MT) models are trained with only a single reference. Previous work has shown that using synthetic paraphrases can improve MT. This paper investigates best…

计算与语言 · 计算机科学 2025-02-27 Si Wu , John Wieting , David A. Smith