English
Related papers

Related papers: Using sentence connectors for evaluating MT output

200 papers

We present novel automatic metrics for machine translation evaluation that use discourse structure and convolution kernels to compare the discourse tree of an automatic translation with that of the human reference. We experiment with five…

Computation and Language · Computer Science 2019-12-02 Shafiq Joty , Francisco Guzman , Lluis Marquez , Preslav Nakov

Machine translation (MT) plays an important role in benefiting linguists, sociologists, computer scientists, etc. by processing natural language to translate it into some other natural language. And this demand has grown exponentially over…

Computation and Language · Computer Science 2019-01-07 Ankush Garg , Mayank Agarwal

The majority of research in computational psycholinguistics has concentrated on the processing of words. This study introduces innovative methods for computing sentence-level metrics using multilingual large language models. The metrics…

Computation and Language · Computer Science 2024-04-17 Kun Sun , Rong Wang

Monolingual data has been demonstrated to be helpful in improving the translation quality of neural machine translation (NMT). The current methods stay at the usage of word-level knowledge, such as generating synthetic parallel data or…

Computation and Language · Computer Science 2019-08-22 Rongxiang Weng , Heng Yu , Shujian Huang , Weihua Luo , Jiajun Chen

Previous works have shown that contextual information can improve the performance of neural machine translation (NMT). However, most existing document-level NMT methods only consider a few number of previous sentences. How to make use of…

Computation and Language · Computer Science 2021-09-15 Mingzhou Xu , Liangyou Li , Derek. F. Wong , Qun Liu , Lidia S. Chao

The high-quality translation results produced by machine translation (MT) systems still pose a huge challenge for automatic evaluation. Current MT evaluation pays the same attention to each sentence component, while the questions of…

Computation and Language · Computer Science 2021-08-02 Runzhe Zhan , Xuebo Liu , Derek F. Wong , Lidia S. Chao

The main purpose of relation extraction is to extract the semantic relationships between tagged pairs of entities in a sentence, which plays an important role in the semantic understanding of sentences and the construction of knowledge…

Computation and Language · Computer Science 2023-03-21 Chenghong Sun , Weidong Ji , Guohui Zhou , Hui Guo , Zengxiang Yin , Yuqi Yue

Traditionally, Machine Translation (MT) Evaluation has been treated as a regression problem -- producing an absolute translation-quality score. This approach has two limitations: i) the scores lack interpretability, and human annotators…

Computation and Language · Computer Science 2024-01-31 Ibraheem Muhammad Moosa , Rui Zhang , Wenpeng Yin

Machine Translation (MT) evaluation metrics assess translation quality automatically. Recently, researchers have employed MT metrics for various new use cases, such as data filtering and translation re-ranking. However, most MT metrics…

Computation and Language · Computer Science 2024-10-08 Stefano Perrella , Lorenzo Proietti , Pere-Lluís Huguet Cabot , Edoardo Barba , Roberto Navigli

We present an interactive machine translation (MT) system designed for users who are not proficient in the target language. It aims to improve trustworthiness and explainability by identifying potentially mistranslated words and allowing…

Computation and Language · Computer Science 2025-04-01 Kenneth J. Sible , David Chiang

We propose a novel method for translation selection in statistical machine translation, in which a convolutional neural network is employed to judge the similarity between a phrase pair in two languages. The specifically designed…

Computation and Language · Computer Science 2015-06-25 Zhaopeng Tu , Baotian Hu , Zhengdong Lu , Hang Li

Neural machine translation is a relatively new approach to statistical machine translation based purely on neural networks. The neural machine translation models often consist of an encoder and a decoder. The encoder extracts a fixed-length…

Computation and Language · Computer Science 2014-10-08 Kyunghyun Cho , Bart van Merrienboer , Dzmitry Bahdanau , Yoshua Bengio

We propose a process for investigating the extent to which sentence representations arising from neural machine translation (NMT) systems encode distinct semantic phenomena. We use these representations as features to train a natural…

Computation and Language · Computer Science 2018-05-08 Adam Poliak , Yonatan Belinkov , James Glass , Benjamin Van Durme

Unsupervised Neural Machine Translation (UNMT) focuses on improving NMT results under the assumption there is no human translated parallel data, yet little work has been done so far in highlighting its advantages compared to supervised…

Computation and Language · Computer Science 2023-12-21 Isidora Chara Tourni , Derry Wijaya

Pre-trained transformer models shine in many natural language processing tasks and therefore are expected to bear the representation of the input sentence or text meaning. These sentence-level embeddings are also important in…

Computation and Language · Computer Science 2025-02-21 Lukas Stankevičius , Mantas Lukoševičius

Different word embedding models capture different aspects of linguistic properties. This inspired us to propose a model (M-MaxLSTM-CNN) for employing multiple sets of word embeddings for evaluating sentence similarity/relation. Representing…

Computation and Language · Computer Science 2018-05-22 Huy Nguyen Tien , Minh Nguyen Le , Yamasaki Tomohiro , Izuha Tatsuya

Word-level Quality Estimation (QE) of Machine Translation (MT) aims to find out potential translation errors in the translated sentence without reference. Typically, conventional works on word-level QE are designed to predict the…

Computation and Language · Computer Science 2022-09-14 Zhen Yang , Fandong Meng , Yuanmeng Yan , Jie Zhou

Neural machine translation represents an exciting leap forward in translation quality. But what longstanding weaknesses does it resolve, and which remain? We address these questions with a challenge set approach to translation evaluation…

Computation and Language · Computer Science 2017-08-30 Pierre Isabelle , Colin Cherry , George Foster

Machine translation systems have been widely adopted in our daily life, making life easier and more convenient. Unfortunately, erroneous translations may result in severe consequences, such as financial losses. This requires to improve the…

Computation and Language · Computer Science 2024-01-02 Quanjun Zhang , Juan Zhai , Chunrong Fang , Jiawei Liu , Weisong Sun , Haichuan Hu , Qingyu Wang

In recent years, several studies on neural machine translation (NMT) have attempted to use document-level context by using a multi-encoder and two attention mechanisms to read the current and previous sentences to incorporate the context of…

Computation and Language · Computer Science 2019-09-04 Hayahide Yamagishi , Mamoru Komachi