English
Related papers

Related papers: Learning Confidence for Transformer-based Neural M…

200 papers

The most common tools for word-alignment rely on a large amount of parallel sentences, which are then usually processed according to one of the IBM model algorithms. The training data is, however, the same as for machine translation (MT)…

Computation and Language · Computer Science 2021-04-01 Vilém Zouhar , Daria Pylypenko

Human translators linger on some words and phrases more than others, and predicting this variation is a step towards explaining the underlying cognitive processes. Using data from the CRITT Translation Process Research Database, we evaluate…

Computation and Language · Computer Science 2023-12-20 Zheng Wei Lim , Ekaterina Vylomova , Charles Kemp , Trevor Cohn

For various speech-related tasks, confidence scores from a speech recogniser are a useful measure to assess the quality of transcriptions. In traditional hidden Markov model-based automatic speech recognition (ASR) systems, confidence…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-27 Qiujia Li , David Qiu , Yu Zhang , Bo Li , Yanzhang He , Philip C. Woodland , Liangliang Cao , Trevor Strohman

In recent years, convolutional neural networks (CNNs) took over the field of document analysis and they became the predominant model for word spotting. Especially attribute CNNs, which learn the mapping between a word image and an attribute…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Fabian Wolf , Philipp Oberdiek , Gernot A. Fink

Neural Machine Translation has achieved state-of-the-art performance for several language pairs using a combination of parallel and synthetic data. Synthetic data is often generated by back-translating sentences randomly sampled from…

Computation and Language · Computer Science 2018-09-24 Marzieh Fadaee , Christof Monz

Pre-training models on vast quantities of unlabeled data has emerged as an effective approach to improving accuracy on many NLP tasks. On the other hand, traditional machine translation has a long history of leveraging unlabeled data…

Computation and Language · Computer Science 2020-11-17 Shruti Bhosale , Kyra Yee , Sergey Edunov , Michael Auli

Transformer based models are the modern work horses for neural machine translation (NMT), reaching state of the art across several benchmarks. Despite their impressive accuracy, we observe a systemic and rudimentary class of errors made by…

Computation and Language · Computer Science 2021-04-19 Adithya Renduchintala , Adina Williams

In Transformer-based neural machine translation (NMT), the positional encoding mechanism helps the self-attention networks to learn the source representation with order dependency, which makes the Transformer-based NMT achieve…

Computation and Language · Computer Science 2020-04-09 Kehai Chen , Rui Wang , Masao Utiyama , Eiichiro Sumita

Neural machine translation (NMT) has achieved remarkable success in producing high-quality translations. However, current NMT systems suffer from a lack of reliability, as their outputs that are often affected by lexical or syntactic…

Computation and Language · Computer Science 2023-09-20 Rongxiang Weng , Qiang Wang , Wensen Cheng , Changfeng Zhu , Min Zhang

Sentences in a well-formed text are connected to each other via various links to form the cohesive structure of the text. Current neural machine translation (NMT) systems translate a text in a conventional sentence-by-sentence fashion,…

Computation and Language · Computer Science 2018-06-15 Shaohui Kuang , Deyi Xiong , Weihua Luo , Guodong Zhou

Neural Machine Translation (NMT) has achieved significant breakthrough in performance but is known to suffer vulnerability to input perturbations. As real input noise is difficult to predict during training, robustness is a big issue for…

Computation and Language · Computer Science 2021-04-21 Weiwen Xu , Ai Ti Aw , Yang Ding , Kui Wu , Shafiq Joty

The integration of language models for neural machine translation has been extensively studied in the past. It has been shown that an external language model, trained on additional target-side monolingual data, can help improve translation…

Computation and Language · Computer Science 2023-06-09 Christian Herold , Yingbo Gao , Mohammad Zeineldeen , Hermann Ney

Neural machine translation (NMT) has become the de-facto standard in real-world machine translation applications. However, NMT models can unpredictably produce severely pathological translations, known as hallucinations, that seriously…

Computation and Language · Computer Science 2023-05-22 Nuno M. Guerreiro , Pierre Colombo , Pablo Piantanida , André F. T. Martins

Soft prompt tuning is a parameter-efficient method for adapting LLMs to specific tasks, but suffers from a lack of interpretability. Building on recent work on interpreting soft prompts (Ramati et al., 2024), we explore how training a…

Computation and Language · Computer Science 2026-05-28 Pitipat Kongsomjit , Suryansh Goyal , Jacob Whitehill

Attention-based Neural Machine Translation (NMT) models suffer from attention deficiency issues as has been observed in recent research. We propose a novel mechanism to address some of these limitations and improve the NMT attention.…

Computation and Language · Computer Science 2016-08-10 Baskaran Sankaran , Haitao Mi , Yaser Al-Onaizan , Abe Ittycheriah

Attention distributions of the generated translations are a useful bi-product of attention-based recurrent neural network translation models and can be treated as soft alignments between the input and output tokens. In this work, we use…

Computation and Language · Computer Science 2017-10-11 Matīss Rikters , Mark Fishel

Training efficiency is one of the main problems for Neural Machine Translation (NMT). Deep networks need for very large data as well as many training iterations to achieve state-of-the-art performance. This results in very high computation…

Computation and Language · Computer Science 2017-10-04 Dakun Zhang , Jungi Kim , Josep Crego , Jean Senellart

Existing neural machine translation (NMT) systems utilize sequence-to-sequence neural networks to generate target translation word by word, and then make the generated word at each time-step and the counterpart in the references as…

Computation and Language · Computer Science 2020-03-02 Chaoqun Duan , Kehai Chen , Rui Wang , Masao Utiyama , Eiichiro Sumita , Conghui Zhu , Tiejun Zhao

One of the key factors of enabling machine learning models to comprehend and solve real-world tasks is to leverage multimodal data. Unfortunately, annotation of multimodal data is challenging and expensive. Recently, self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Elad Amrani , Rami Ben-Ari , Daniel Rotman , Alex Bronstein

Structured classification tasks such as sequence labeling and dependency parsing have seen much interest by the Natural Language Processing and the machine learning communities. Several online learning algorithms were adapted for structured…

Machine Learning · Computer Science 2011-11-08 Avihai Mejer , Koby Crammer