English
Related papers

Related papers: Automatic Testing and Improvement of Machine Trans…

200 papers

As people increasingly use AI systems in work and daily life, feedback mechanisms that help them use AI responsibly are urgently needed, particularly in settings where users are not equipped to assess the quality of AI predictions. We study…

Computation and Language · Computer Science 2025-10-03 Dayeon Ki , Kevin Duh , Marine Carpuat

Non-autoregressive approaches aim to improve the inference speed of translation models by only requiring a single forward pass to generate the output sequence instead of iteratively producing each predicted token. Consequently, their…

Computation and Language · Computer Science 2022-10-24 Robin M. Schmidt , Telmo Pires , Stephan Peitz , Jonas Lööf

With the wide application of machine translation, the testing of Machine Translation Systems (MTSs) has attracted much attention. Recent works apply Metamorphic Testing (MT) to address the oracle problem in MTS testing. Existing MT methods…

Software Engineering · Computer Science 2024-07-23 Xiaoyuan Xie , Shuo Jin , Songqiang Chen , Shing-Chi Cheung

With little to no parallel data available for programming languages, unsupervised methods are well-suited to source code translation. However, the majority of unsupervised machine translation approaches rely on back-translation, a method…

Software Engineering · Computer Science 2022-02-17 Baptiste Roziere , Jie M. Zhang , Francois Charton , Mark Harman , Gabriel Synnaeve , Guillaume Lample

Automatic metrics for evaluating translation quality are typically validated by measuring how well they correlate with human assessments. However, correlation methods tend to capture only the ability of metrics to differentiate between good…

Computation and Language · Computer Science 2024-10-11 Sweta Agrawal , António Farinhas , Ricardo Rei , André F. T. Martins

Machine-translated text plays a crucial role in the communication of people using different languages. However, adversaries can use such text for malicious purposes such as plagiarism and fake review. The existing methods detected a…

Computation and Language · Computer Science 2019-10-16 Hoang-Quoc Nguyen-Son , Tran Phuong Thao , Seira Hidano , Shinsaku Kiyomoto

The manuscript presents an experiment at implementation of a Machine Translation system in a MapReduce model. The empirical evaluation was done using fully implemented translation systems embedded into the MapReduce programming model. Two…

Computation and Language · Computer Science 2016-11-10 Jernej Vičič , Andrej Brodnik

We introduce translation error correction (TEC), the task of automatically correcting human-generated translations. Imperfections in machine translations (MT) have long motivated systems for improving translations post-hoc with automatic…

Computation and Language · Computer Science 2022-06-20 Jessy Lin , Geza Kovacs , Aditya Shastry , Joern Wuebker , John DeNero

We present a novel approach to detecting over and under translations (OT/UT) as part of adequacy error checks in translation evaluation. We do not restrict ourselves to machine translation (MT) outputs and specifically target applications…

Computation and Language · Computer Science 2021-04-02 Prabhakar Gupta , Ridha Juneja , Anil Nelakanti , Tamojit Chatterjee

In recent years, machine translation software has increasingly been integrated into our daily lives. People routinely use machine translation for various applications, such as describing symptoms to a foreign doctor and reading political…

Software Engineering · Computer Science 2020-07-15 Pinjia He , Clara Meister , Zhendong Su

We have implemented a machine translation system, the PolyMath Translator, for LaTeX documents containing mathematical text. The current implementation translates English LaTeX to French LaTeX, attaining a BLEU score of 53.5 on a held-out…

Computation and Language · Computer Science 2020-10-13 Aditya Ohri , Tanya Schmah

While machine translation (MT) systems are achieving increasingly strong performance on benchmarks, they often produce translations with errors and anomalies. Understanding these errors can potentially help improve the translation quality…

Neural machine translation (NMT) architectures have achieved promising results for automatic program repair. Yet, they have the limitation of generating low-quality patches (e.g., not compilable patches). This is because the existing works…

Software Engineering · Computer Science 2022-04-12 He Ye , Matias Martinez , Martin Monperrus

In this paper, we investigate the use of transformers for Neural Machine Translation of text-to-GLOSS for Deaf and Hard-of-Hearing communication. Due to the scarcity of available data and limited resources for text-to-GLOSS translation, we…

Computation and Language · Computer Science 2023-09-06 Younes Ouargani , Noussaima El Khattabi

We present TransClean, a method for detecting false positive predictions of entity matching algorithms under real-world conditions characterized by large-scale, noisy, and unlabeled multi-source datasets that undergo distributional shifts.…

Databases · Computer Science 2025-06-05 Fernando de Meer Pardo , Branka Hadji Misheva , Martin Braschler , Kurt Stockinger

The quality of machine translation has increased remarkably over the past years, to the degree that it was found to be indistinguishable from professional human translation in a number of empirical investigations. We reassess Hassan et…

Computation and Language · Computer Science 2020-04-06 Samuel Läubli , Sheila Castilho , Graham Neubig , Rico Sennrich , Qinlan Shen , Antonio Toral

Machine translation systems have been widely adopted in our daily life, making life easier and more convenient. Unfortunately, erroneous translations may result in severe consequences, such as financial losses. This requires to improve the…

Computation and Language · Computer Science 2024-01-02 Quanjun Zhang , Juan Zhai , Chunrong Fang , Jiawei Liu , Weisong Sun , Haichuan Hu , Qingyu Wang

Despite their practical success, modern seq2seq architectures are unable to generalize systematically on several SCAN tasks. Hence, it is not clear if SCAN-style compositional generalization is useful in realistic NLP tasks. In this work,…

Computation and Language · Computer Science 2021-09-17 Rahma Chaabouni , Roberto Dessì , Eugene Kharitonov

Automated program repair is the task of automatically repairing software bugs. A promising direction in this field is self-supervised learning, a learning paradigm in which repair models are trained without commits representing pairs of…

Software Engineering · Computer Science 2023-04-06 André Silva , João F. Ferreira , He Ye , Martin Monperrus

Recent advancements in machine learning have spurred growing interests in automated interpreting quality assessment. Nevertheless, existing research suffers from insufficient examination of language use quality, unsatisfactory modeling…

Computation and Language · Computer Science 2025-08-15 Zhaokun Jiang , Ziyin Zhang