English
Related papers

Related papers: Identifying Weaknesses in Machine Translation Metr…

200 papers

Neural machine translation systems typically are trained on curated corpora and break when faced with non-standard orthography or punctuation. Resilience to spelling mistakes and typos, however, is crucial as machine translation systems are…

Computation and Language · Computer Science 2020-09-15 Toms Bergmanis , Artūrs Stafanovičs , Mārcis Pinnis

Neural machine translation (NMT) systems operate primarily on words (or sub-words), ignoring lower-level patterns of morphology. We present a character-aware decoder designed to capture such patterns when translating into morphologically…

Computation and Language · Computer Science 2019-06-20 Adithya Renduchintala , Pamela Shapiro , Kevin Duh , Philipp Koehn

Neural Machine Translation (NMT) models generally perform translation using a fixed-size lexical vocabulary, which is an important bottleneck on their generalization capability and overall translation quality. The standard approach to…

Computation and Language · Computer Science 2019-10-22 Duygu Ataman , Orhan Firat , Mattia A. Di Gangi , Marcello Federico , Alexandra Birch

Error correction codes are an integral part of communication applications, boosting the reliability of transmission. The optimal decoding of transmitted codewords is the maximum likelihood rule, which is NP-hard due to the curse of…

Information Theory · Computer Science 2021-02-22 Nir Raviv , Avi Caciularu , Tomer Raviv , Jacob Goldberger , Yair Be'ery

Training data for NLP tasks often exhibits gender bias in that fewer sentences refer to women than to men. In Neural Machine Translation (NMT) gender bias has been shown to reduce translation quality, particularly when the target language…

Computation and Language · Computer Science 2020-07-10 Danielle Saunders , Bill Byrne

Hinging on ideas from physical-layer network coding, some promising proposals of coded random access systems seek to improve system performance (while preserving low complexity) by means of packet repetitions and decoding of linear…

Information Theory · Computer Science 2018-05-30 Adriano Pastore , Paul de Kerret , Monica Navarro , David Gregoratti , David Gesbert

Large language models (LLMs) are often equipped with multi-sample decoding strategies. An LLM implicitly defines an arithmetic code book, facilitating efficient and embarrassingly parallelizable \textbf{arithmetic sampling} to produce…

Artificial Intelligence · Computer Science 2025-04-29 Aditya Parashar , Aditya Vikram Singh , Avinash Amballa , Jinlin Lai , Benjamin Rozonoyer

The minimum weight perfect matching (MWPM) decoder is the standard decoding strategy for quantum surface codes. However, it suffers a harsh decrease in performance when subjected to biased or non-identical quantum noise. In this work, we…

The performance of neural machine translation systems is commonly evaluated in terms of BLEU. However, due to its reliance on target language properties and generation, the BLEU metric does not allow an assessment of which translation…

Computation and Language · Computer Science 2020-05-19 Emanuele Bugliarello , Sabrina J. Mielke , Antonios Anastasopoulos , Ryan Cotterell , Naoaki Okazaki

Being able to rank the similarity of short text segments is an interesting bonus feature of neural machine translation. Translation-based similarity measures include direct and pivot translation probability, as well as translation…

Computation and Language · Computer Science 2022-10-20 Jannis Vamvas , Rico Sennrich

Neural machine translation has significantly pushed forward the quality of the field. However, there are remaining big issues with the output translations and one of them is fairness. Neural models are trained on large text corpora which…

Computation and Language · Computer Science 2019-06-04 Joel Escudé Font , Marta R. Costa-jussà

Recent generative large language models (LLMs) show remarkable performance in non-English languages, but when prompted in those languages they tend to express higher harmful social biases and toxicity levels. Prior work has shown that…

Computation and Language · Computer Science 2025-06-03 Vera Neplenbroek , Arianna Bisazza , Raquel Fernández

Neural Machine Translation (NMT) models are sensitive to small perturbations in the input. Robustness to such perturbations is typically measured using translation quality metrics such as BLEU on the noisy input. This paper proposes…

Computation and Language · Computer Science 2020-05-05 Xing Niu , Prashant Mathur , Georgiana Dinu , Yaser Al-Onaizan

Large Language Models (LLMs) excel at evaluating machine translation (MT), but their scale and cost hinder deployment on edge devices and in privacy-sensitive workflows. We ask: how small can you get while still detecting meaning-altering…

Computation and Language · Computer Science 2025-11-14 Muskaan Chopra , Lorenz Sparrenberg , Sarthak Khanna , Rafet Sifa

Neural Machine Translation (NMT) is resource intensive. We design a quantization procedure to compress NMT models better for devices with limited hardware capability. Because most neural network parameters are near zero, we employ…

Computation and Language · Computer Science 2019-09-23 Alham Fikri Aji , Kenneth Heafield

Topological quantum error-correcting codes are a promising candidate for building fault-tolerant quantum computers. Decoding topological codes optimally, however, is known to be a computationally hard problem. Various decoders have been…

Quantum Physics · Physics 2020-04-01 Milap Sheth , Sara Zafar Jafarzadeh , Vlad Gheorghiu

Large Language Models (LLMs) have excelled at language understanding and generating human-level text. However, even with supervised training and human alignment, these LLMs are susceptible to adversarial attacks where malicious users can…

Computation and Language · Computer Science 2024-08-08 Shachi H Kumar , Saurav Sahay , Sahisnu Mazumder , Eda Okur , Ramesh Manuvinakurike , Nicole Beckage , Hsuan Su , Hung-yi Lee , Lama Nachman

Understanding how explicit theoretical features are encoded in opaque neural systems is a central challenge now common to neuroscience and AI. We introduce Metric Learning Encoding Models (MLEMs) to address this challenge most directly as a…

Computation and Language · Computer Science 2025-11-17 Louis Jalouzot , Christophe Pallier , Emmanuel Chemla , Yair Lakretz

An increasing body of work has leveraged multilingual language models for Natural Language Generation tasks such as summarization. A major empirical bottleneck in this area is the shortage of accurate and robust evaluation metrics for many…

Computation and Language · Computer Science 2026-01-23 Silvia Casola , Ryan Soh-Eun Shim , Felicia Körner , Yuchen Mao , Barbara Plank

Neural Machine Translation (NMT) systems face significant challenges when working with low-resource languages, particularly in domain adaptation tasks. These difficulties arise due to limited training data and suboptimal model…

Computation and Language · Computer Science 2025-05-22 Pratik Rakesh Singh , Kritarth Prasad , Mohammadi Zaki , Pankaj Wasnik