English
Related papers

Related papers: Unsupervised Quality Estimation for Neural Machine…

200 papers

We present an ensemble-driven self-training framework for unsupervised neural machine translation (UNMT). Starting from a primary language pair, we train multiple UNMT models that share the same translation task but differ in an auxiliary…

Computation and Language · Computer Science 2026-03-19 Ido Aharon , Jonathan Shaki , Sarit Kraus

This paper outlines a theoretical framework using which different automatic metrics can be designed for evaluation of Machine Translation systems. It introduces the concept of {\em cognitive ease} which depends on {\em adequacy} and {\em…

Computation and Language · Computer Science 2022-02-14 Rajeev Sangal

Given a rough, word-by-word gloss of a source language sentence, target language natives can uncover the latent, fully-fluent rendering of the translation. In this work we explore this intuition by breaking translation into a two step…

Computation and Language · Computer Science 2019-06-14 Nima Pourdamghani , Nada Aldarrab , Marjan Ghazvininejad , Kevin Knight , Jonathan May

The past decade has witnessed significant advancements in quantum hardware, encompassing improvements in speed, qubit quantity, and quantum volume-a metric defining the maximum size of a quantum circuit effectively implementable on…

Quantum Physics · Physics 2024-06-11 Yaswitha Gujju , Atsushi Matsuo , Rudy Raymond

Translation Quality Assessment (TQA) is a process conducted by human translators and is widely used, both for estimating the performance of (increasingly used) Machine Translation, and for finding an agreement between translation providers…

Computation and Language · Computer Science 2022-04-13 Marco Miccheli , Andrej Leban , Andrea Tacchella , Andrea Zaccaria , Dario Mazzilli , Sébastien Bratières

To facilitate effective translation modeling and translation studies, one of the crucial questions to address is how to assess translation quality. From the perspectives of accuracy, reliability, repeatability and cost, translation quality…

Computation and Language · Computer Science 2021-05-10 Lifeng Han , Gareth J. F. Jones , Alan F. Smeaton

Quantization method plays a crucial role in improving model efficiency and reducing deployment costs, enabling the widespread application of deep learning models on resource-constrained devices. However, the quantization process inevitably…

Machine Learning · Computer Science 2025-09-30 Jinhao Zhang , Yunquan Zhang , Boyang Zhang , Zeyu Liu , Daning Cheng

With the rapid growth in the use of fine-tuning for large language models (LLMs), optimizing fine-tuning while keeping inference efficient has become highly important. However, this is a challenging task as it requires improvements in all…

Computation and Language · Computer Science 2024-10-14 Changhun Lee , Jun-gyu Jin , Younghyun Cho , Eunhyeok Park

We present IntelliCAT, an interactive translation interface with neural models that streamline the post-editing process on machine translation output. We leverage two quality estimation (QE) models at different granularities: sentence-level…

Computation and Language · Computer Science 2021-05-27 Dongjun Lee , Junhyeong Ahn , Heesoo Park , Jaemin Jo

Evaluation plays a vital role in checking the quality of MT output. It is done either manually or automatically. Manual evaluation is very time consuming and subjective, hence use of automatic metrics is done most of the times. This paper…

Computation and Language · Computer Science 2015-06-19 Aditi Kalyani , Hemant Kumud , Shashi Pal Singh , Ajai Kumar

Larger models often outperform smaller ones but come with high computational costs. Cascading offers a potential solution. By default, it uses smaller models and defers only some instances to larger, more powerful models. However, designing…

Computation and Language · Computer Science 2025-02-19 António Farinhas , Nuno M. Guerreiro , Sweta Agrawal , Ricardo Rei , André F. T. Martins

Traditionally, Machine Translation (MT) Evaluation has been treated as a regression problem -- producing an absolute translation-quality score. This approach has two limitations: i) the scores lack interpretability, and human annotators…

Computation and Language · Computer Science 2024-01-31 Ibraheem Muhammad Moosa , Rui Zhang , Wenpeng Yin

Deep learning based question answering (QA) on English documents has achieved success because there is a large amount of English training examples. However, for most languages, training examples for high-quality QA models are not available.…

Computation and Language · Computer Science 2019-07-16 Chia-Hsuan Lee , Hung-Yi Lee

With the advent of neural machine translation, there has been a marked shift towards leveraging and consuming the machine translation results. However, the gap between machine translation systems and human translators needs to be manually…

Computation and Language · Computer Science 2020-09-29 Jiayi Wang , Ke Wang , Niyu Ge , Yangbing Shi , Yu Zhao , Kai Fan

The use of large language models (LLMs) for evaluating outputs is becoming an increasingly effective and scalable approach. However, it remains uncertain whether this capability extends beyond task-specific evaluations to more general…

Computation and Language · Computer Science 2025-11-13 Rhitabrat Pokharel , Ameeta Agrawal

Speech quality estimation has recently undergone a paradigm shift from human-hearing expert designs to machine-learning models. However, current models rely mainly on supervised learning, which is time-consuming and expensive for label…

Sound · Computer Science 2024-02-27 Szu-Wei Fu , Kuo-Hsuan Hung , Yu Tsao , Yu-Chiang Frank Wang

Supervised Quantum Machine Learning (QML) represents an intersection of quantum computing and classical machine learning, aiming to use quantum resources to support model training and inference. This paper reviews recent developments in…

Quantum Physics · Physics 2025-06-26 Srikanth Thudumu , Jason Fisher , Hung Du

In this paper we present an approach for estimating the quality of machine translation system. There are various methods for estimating the quality of output sentences, but in this paper we focus on Na\"ive Bayes classifier to build model…

Computation and Language · Computer Science 2013-12-30 Rashmi Gupta , Nisheeth Joshi , Iti Mathur

Uncertainty quantification (UQ) provides a resource-efficient solution for on-device monitoring of tinyML models deployed without access to true labels. However, existing UQ methods impose significant memory and compute demands, making them…

Machine Learning · Computer Science 2024-11-19 Nikhil P Ghanathe , Steven J E Wilton

Pre-editing is the process of modifying the source text (ST) so that it can be translated by machine translation (MT) in a better quality. Despite the unpredictability of black-box neural MT (NMT), pre-editing has been deployed in various…

Computation and Language · Computer Science 2021-02-08 Rei Miyata , Atsushi Fujita