English
Related papers

Related papers: Scheduled Sampling for Transformers

200 papers

Scheduled sampling is widely used to mitigate the exposure bias problem for neural machine translation. Its core motivation is to simulate the inference scene during training by replacing ground-truth tokens with predicted tokens, thus…

Computation and Language · Computer Science 2021-09-01 Yijin Liu , Fandong Meng , Yufeng Chen , Jinan Xu , Jie Zhou

Scheduled sampling is an effective method to alleviate the exposure bias problem of neural machine translation. It simulates the inference scene by randomly replacing ground-truth target input tokens with predicted ones during training.…

Computation and Language · Computer Science 2021-07-23 Yijin Liu , Fandong Meng , Yufeng Chen , Jinan Xu , Jie Zhou

State-of-the-art neural text generation models are typically trained to maximize the likelihood of each token in the ground-truth sequence conditioned on the previous target tokens. However, during inference, the model needs to make a…

Computation and Language · Computer Science 2023-02-01 Xiang Lin , Prathyusha Jwalapuram , Shafiq Joty

Auto-regressive models are widely used in sequence generation problems. The output sequence is typically generated in a predetermined order, one discrete unit (pixel or word or character) at a time. The models are trained by teacher-forcing…

Computation and Language · Computer Science 2019-10-23 Daniel Duckworth , Arvind Neelakantan , Ben Goodrich , Lukasz Kaiser , Samy Bengio

Despite strong performance in many sequence-to-sequence tasks, autoregressive models trained with maximum likelihood estimation suffer from exposure bias, i.e. the discrepancy between the ground-truth prefixes used during training and the…

Computation and Language · Computer Science 2023-01-11 Michalis Korakakis , Andreas Vlachos

Recurrent Neural Networks can be trained to produce sequences of tokens given some input, as exemplified by recent results in machine translation and image captioning. The current approach to training them consists of maximizing the…

Machine Learning · Computer Science 2015-09-24 Samy Bengio , Oriol Vinyals , Navdeep Jaitly , Noam Shazeer

Exposure bias poses a common challenge in numerous natural language processing tasks, particularly in the dialog generation. In response to this issue, researchers have devised various techniques, among which scheduled sampling has proven…

Computation and Language · Computer Science 2023-09-06 Jiawen Liu , Kan Li

Multi-step ahead prediction in language models is challenging due to the discrepancy between training and test time processes. At test time, a sequence predictor is required to make predictions given past predictions as the input, instead…

Computation and Language · Computer Science 2021-01-26 James O' Neill , Danushka Bollegala

The task of multi-step ahead prediction in language models is challenging considering the discrepancy between training and testing. At test time, a language model is required to make predictions given past predictions as input, instead of…

Machine Learning · Computer Science 2018-09-18 James O' Neill , Danushka Bollegala

Modern applications and progress in deep learning research have created renewed interest for generative models of text and of images. However, even today it is unclear what objective functions one should use to train and evaluate these…

Machine Learning · Statistics 2015-11-17 Ferenc Huszár

Despite some empirical success at correcting exposure bias in machine translation, scheduled sampling algorithms suffer from a major drawback: they incorrectly assume that words in the reference translations and in sampled sequences are…

Computation and Language · Computer Science 2019-05-07 Weijia Xu , Xing Niu , Marine Carpuat

The recurrent neural network-transducer (RNNT) is a promising approach for automatic speech recognition (ASR) with the introduction of a prediction network that autoregressively considers linguistic aspects. To train the autoregressive…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-26 Takafumi Moriya , Takanori Ashihara , Hiroshi Sato , Kohei Matsuura , Tomohiro Tanaka , Ryo Masumura

A popular strategy to train recurrent neural networks (RNNs), known as ``teacher forcing'' takes the ground truth as input at each time step and makes the later predictions partly conditioned on those inputs. Such training strategy impairs…

Computation and Language · Computer Science 2021-03-23 Liping Yuan , Jiangtao Feng , Xiaoqing Zheng , Xuanjing Huang

Adequate sampling space coverage is the keystone to effectively train trustworthy Machine Learning models. Unfortunately, real data do carry several inherent risks due to the many potential biases they exhibit when gathered without a proper…

Machine Learning · Computer Science 2025-03-27 Antonio Maratea , Rita Perna

To train neural machine translation models simultaneously on multiple tasks (languages), it is common to sample each task uniformly or in proportion to dataset sizes. As these methods offer little control over performance trade-offs, we…

Machine Learning · Computer Science 2019-09-17 Sébastien Jean , Orhan Firat , Melvin Johnson

Given a supervised machine learning problem where the training set has been subject to a known sampling bias, how can a model be trained to fit the original dataset? We achieve this through the Bayesian inference framework by altering the…

Machine Learning · Statistics 2022-03-16 Max Sklar

Auto-regressive sequence-to-sequence models with attention mechanism have achieved state-of-the-art performance in many tasks such as machine translation and speech synthesis. These models can be difficult to train. The standard approach,…

Machine Learning · Computer Science 2019-10-04 Qingyun Dou , Yiting Lu , Joshua Efiong , Mark J. F. Gales

Sequence-to-sequence models based on LSTM and GRU are a most popular choice for forecasting time series data reaching state-of-the-art performance. Training such models can be delicate though. The two most common training strategies within…

Machine Learning · Computer Science 2022-10-18 Philipp Teutsch , Patrick Mäder

The past several years have witnessed the rapid progress of end-to-end Neural Machine Translation (NMT). However, there exists discrepancy between training and inference in NMT when decoding, which may lead to serious problems since the…

Computation and Language · Computer Science 2017-10-18 Zi-Yi Dou , Hao Zhou , Shu-Jian Huang , Xin-Yu Dai , Jia-Jun Chen

Data sampling acts as a pivotal role in training deep learning models. However, an effective sampling schedule is difficult to learn due to the inherently high dimension of parameters in learning the sampling schedule. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2021-05-31 Ming Sun , Haoxuan Dou , Baopu Li , Lei Cui , Junjie Yan , Wanli Ouyang
‹ Prev 1 2 3 10 Next ›