English
Related papers

Related papers: Inference Strategies for Machine Translation with …

200 papers

This paper presents a novel training method, Conditional Masked Language Modeling (CMLM), to effectively learn sentence representations on large scale unlabeled corpora. CMLM integrates sentence representation learning into MLM training by…

Computation and Language · Computer Science 2021-09-13 Ziyi Yang , Yinfei Yang , Daniel Cer , Jax Law , Eric Darve

Transformer-based autoregressive (AR) methods have achieved appealing performance for varied sequence-to-sequence generation tasks, e.g., neural machine translation, summarization, and code generation, but suffer from low inference…

Computation and Language · Computer Science 2023-03-15 Yisheng Xiao , Ruiyang Xu , Lijun Wu , Juntao Li , Tao Qin , Yan-Tie Liu , Min Zhang

Being one of the IR-NAT (Iterative-refinemennt-based NAT) frameworks, the Conditional Masked Language Model (CMLM) adopts the mask-predict paradigm to re-predict the masked low-confidence tokens. However, CMLM suffers from the data…

Computation and Language · Computer Science 2024-02-16 Xinran Chen , Sufeng Duan , Gongshen Liu

Learning to predict masked tokens in a sequence has been shown to be a helpful pretraining objective for powerful language models such as PaLM2. After training, such masked language models (MLMs) can provide distributions of tokens in the…

Computation and Language · Computer Science 2024-02-26 Tom Young , Yunan Chen , Yang You

This paper introduces a new data augmentation method for neural machine translation that can enforce stronger semantic consistency both within and across languages. Our method is based on Conditional Masked Language Model (CMLM) which is…

Computation and Language · Computer Science 2022-09-23 Qiao Cheng , Jin Huang , Yitao Duan

Masked language modeling (MLM) is one of the key sub-tasks in vision-language pretraining. In the cross-modal setting, tokens in the sentence are masked at random, and the model predicts the masked tokens given the image and the text. In…

Computation and Language · Computer Science 2021-09-07 Yonatan Bitton , Gabriel Stanovsky , Michael Elhadad , Roy Schwartz

Pre-training has proven to be effective in unsupervised machine translation due to its ability to model deep context information in cross-lingual scenarios. However, the cross-lingual information obtained from shared BPE spaces is…

Computation and Language · Computer Science 2019-09-04 Shuo Ren , Yu Wu , Shujie Liu , Ming Zhou , Shuai Ma

Current NLP models are predominantly trained through a two-stage "pre-train then fine-tune" pipeline. Prior work has shown that inserting an intermediate pre-training stage, using heuristic masking policies for masked language modeling…

Computation and Language · Computer Science 2021-10-04 Qinyuan Ye , Belinda Z. Li , Sinong Wang , Benjamin Bolte , Hao Ma , Wen-tau Yih , Xiang Ren , Madian Khabsa

Masked language modeling (MLM) has been widely used for pre-training effective bidirectional representations, but incurs substantial training costs. In this paper, we propose a novel concept-based curriculum masking (CCM) method to…

Computation and Language · Computer Science 2022-12-16 Mingyu Lee , Jun-Hyung Park , Junho Kim , Kang-Min Kim , SangKeun Lee

Non-autoregressive models generate target words in a parallel way, which achieve a faster decoding speed but at the sacrifice of translation accuracy. To remedy a flawed translation by non-autoregressive models, a promising approach is to…

Computation and Language · Computer Science 2020-10-27 Pan Xie , Zhi Cui , Xiuyin Chen , Xiaohui Hu , Jianwei Cui , Bin Wang

Masked Language Modeling (MLM) has proven to be an essential component of Vision-Language (VL) pretraining. To implement MLM, the researcher must make two design choices: the masking strategy, which determines which tokens to mask, and the…

Machine Learning · Computer Science 2022-12-13 Siddharth Verma , Yuchen Lu , Rui Hou , Hanchao Yu , Nicolas Ballas , Madian Khabsa , Amjad Almahairi

Most machine translation systems generate text autoregressively from left to right. We, instead, use a masked language modeling objective to train a model to predict any subset of the target words, conditioned on both the input text and a…

Computation and Language · Computer Science 2019-09-05 Marjan Ghazvininejad , Omer Levy , Yinhan Liu , Luke Zettlemoyer

Masked language modeling (MLM) plays a key role in pretraining large language models. But the MLM objective is often dominated by high-frequency words that are sub-optimal for learning factual knowledge. In this work, we propose an approach…

Computation and Language · Computer Science 2023-04-05 Nafis Sadeq , Byungkyu Kang , Prarit Lamba , Julian McAuley

Masked Language Modeling (MLM) has been widely used as the denoising objective in pre-training language models (PrLMs). Existing PrLMs commonly adopt a Random-Token Masking strategy where a fixed masking ratio is applied and different…

Computation and Language · Computer Science 2023-05-26 Dongjie Yang , Zhuosheng Zhang , Hai Zhao

We describe our strategy for the 2025 edition of the BabyLM Challenge. Our main contribution is that of an improved form of Masked Language Modeling (MLM), which adapts the probabilities of the tokens masked according to the model's ability…

Computation and Language · Computer Science 2025-10-24 Lukas Edman , Alexander Fraser

Large language models (LLMs) have shown strong results on a range of applications, including regression and scoring tasks. Typically, one obtains outputs from an LLM via autoregressive sampling from the model's output distribution. We show…

Computation and Language · Computer Science 2024-11-04 Michal Lukasik , Harikrishna Narasimhan , Aditya Krishna Menon , Felix Yu , Sanjiv Kumar

We study how masking and predicting tokens in an unsupervised fashion can give rise to linguistic structures and downstream performance gains. Recent theories have suggested that pretrained language models acquire useful inductive biases…

Computation and Language · Computer Science 2021-04-13 Tianyi Zhang , Tatsunori Hashimoto

Masked Language Model (MLM) framework has been widely adopted for self-supervised language pre-training. In this paper, we argue that randomly sampled masks in MLM would lead to undesirably large gradient variance. Thus, we theoretically…

Computation and Language · Computer Science 2020-10-15 Mingzhi Zheng , Dinghan Shen , Yelong Shen , Weizhu Chen , Lin Xiao

This thesis provides methods and analysis of models which make progress on this goal. The techniques outlined are task agnostic, and should provide benefit when used with nearly any transformer LM. We introduce two new finetuning methods…

Computation and Language · Computer Science 2024-08-30 Davis Yoshida

Learning high-quality text representations is fundamental to a wide range of NLP tasks. While encoder pretraining has traditionally relied on Masked Language Modeling (MLM), recent evidence suggests that decoder models pretrained with…

‹ Prev 1 2 3 10 Next ›