English
Related papers

Related papers: Improving Maximum Likelihood Training for Text Gen…

200 papers

Neural autoregressive sequence models are used to generate sequences in a variety of natural language processing (NLP) tasks, where they are evaluated according to sequence-level task losses. These models are typically trained with maximum…

Machine Learning · Computer Science 2020-10-07 Sean Welleck , Kyunghyun Cho

In many domains, autoregressive models can attain high likelihood on the task of predicting the next observation. However, this maximum-likelihood (MLE) objective does not necessarily match a downstream use-case of autoregressively…

Machine Learning · Computer Science 2024-05-07 Chris Cundy , Stefano Ermon

Generating high-quality text with sufficient diversity is essential for a wide range of Natural Language Generation (NLG) tasks. Maximum-Likelihood (MLE) models trained with teacher forcing have consistently been reported as weak baselines,…

Computation and Language · Computer Science 2020-02-21 Massimo Caccia , Lucas Caccia , William Fedus , Hugo Larochelle , Joelle Pineau , Laurent Charlin

Text generation is a crucial task in NLP. Recently, several adversarial generative models have been proposed to improve the exposure bias problem in text generation. Though these models gain great success, they still suffer from the…

Computation and Language · Computer Science 2018-06-08 Zhan Shi , Xinchi Chen , Xipeng Qiu , Xuanjing Huang

While large language models (LLMs) have demonstrated remarkable performance across diverse tasks, they fundamentally lack self-awareness and frequently exhibit overconfidence, assigning high confidence scores to incorrect predictions.…

Computation and Language · Computer Science 2025-08-19 Jinyi Han , Tingyun Li , Shisong Chen , Jie Shi , Xinyi Wang , Guanglei Yue , Jiaqing Liang , Xin Lin , Liqian Wen , Zulong Chen , Yanghua Xiao

Personalized text generation is an emerging research area that has attracted much attention in recent years. Most studies in this direction focus on a particular domain by designing bespoke features or models. In this work, we propose a…

Computation and Language · Computer Science 2023-08-17 Cheng Li , Mingyang Zhang , Qiaozhu Mei , Yaqing Wang , Spurthi Amba Hombaiah , Yi Liang , Michael Bendersky

Retrieval augmentation has become an effective solution to empower large language models (LLMs) with external and verified knowledge sources from the database, which overcomes the limitations and hallucinations of LLMs in handling…

Information Retrieval · Computer Science 2023-11-21 Tong Wu , Yulei Qin , Enwei Zhang , Zihan Xu , Yuting Gao , Ke Li , Xing Sun

Recently, there has been a surge in the use of generated data to enhance the performance of downstream models, largely due to the advancements in pre-trained language models. However, most prevailing methods trained generative and…

Computation and Language · Computer Science 2023-09-26 Tong Wu , Hao Wang , Zhongshen Zeng , Wei Wang , Hai-Tao Zheng , Jiaxing Zhang

Retraining a model using its own predictions together with the original, potentially noisy labels is a well-known strategy for improving the model performance. While prior works have demonstrated the benefits of specific heuristic…

Machine Learning · Computer Science 2025-05-22 Adel Javanmard , Rudrajit Das , Alessandro Epasto , Vahab Mirrokni

Heatmap-based methods dominate in the field of human pose estimation by modelling the output distribution through likelihood heatmaps. In contrast, regression-based methods are more efficient but suffer from inferior performance. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Jiefeng Li , Siyuan Bian , Ailing Zeng , Can Wang , Bo Pang , Wentao Liu , Cewu Lu

The autoregressive decoding for text generation in large language models (LLMs), while widely used, is inherently suboptimal due to the lack of a built-in mechanism to perform refinement and/or correction of the generated content. In this…

Computation and Language · Computer Science 2025-06-03 Zeyu Tang , Zhenhao Chen , Xiangchen Song , Loka Li , Yunlong Deng , Yifan Shen , Guangyi Chen , Peter Spirtes , Kun Zhang

Prototype-driven text generation uses non-parametric models that first choose from a library of sentence "prototypes" and then modify the prototype to generate the output text. While effective, these methods are inefficient at test time as…

Computation and Language · Computer Science 2020-11-05 Junxian He , Taylor Berg-Kirkpatrick , Graham Neubig

Large Language Models (LLMs) are widely used to evaluate natural language generation tasks as automated metrics. However, the likelihood, a measure of LLM's plausibility for a sentence, can vary due to superficial differences in sentences,…

Computation and Language · Computer Science 2025-11-11 Masanari Oi , Masahiro Kaneko , Ryuto Koike , Mengsay Loem , Naoaki Okazaki

The standard approach to fitting an autoregressive spike train model is to maximize the likelihood for one-step prediction. This maximum likelihood estimation (MLE) often leads to models that perform poorly when generating samples…

Machine Learning · Statistics 2020-10-26 Diego M. Arribas , Yuan Zhao , Il Memming Park

Large language models (LLMs) have demonstrated remarkable capabilities in generating high-quality texts across diverse domains. However, the potential misuse of LLMs has raised significant concerns, underscoring the urgent need for reliable…

Computation and Language · Computer Science 2024-10-10 Yihuai Xu , Yongwei Wang , Yifei Bi , Huangsen Cao , Zhouhan Lin , Yu Zhao , Fei Wu

Topic models provide a useful text-mining tool for learning, extracting, and discovering latent structures in large text corpora. Although a plethora of methods have been proposed for topic modeling, lacking in the literature is a formal…

Machine Learning · Statistics 2022-08-12 Yinyin Chen , Shishuang He , Yun Yang , Feng Liang

We present TraDE, a self-attention-based architecture for auto-regressive density estimation with continuous and discrete valued data. Our model is trained using a penalized maximum likelihood objective, which ensures that samples from the…

Machine Learning · Computer Science 2020-10-16 Rasool Fakoor , Pratik Chaudhari , Jonas Mueller , Alexander J. Smola

Fine-tuning large language models (LLMs) typically relies on producing large sets of input-output pairs. Yet for a given question, there can be many valid outputs. In practice, these outputs are often derived by distilling knowledge from…

Computation and Language · Computer Science 2025-08-28 Xuan Ren , Qi Chen , Lingqiao Liu

Finite mixture models are widely used in econometric analyses to capture unobserved heterogeneity. This paper shows that maximum likelihood estimation of finite mixtures of parametric densities can suffer from substantial finite-sample bias…

Methodology · Statistics 2026-02-04 Raphaël Langevin

The generative large language models (LLMs) are increasingly used for data augmentation tasks, where text samples are paraphrased (or generated anew) and then used for classifier fine-tuning. Existing works on augmentation leverage the…

Computation and Language · Computer Science 2024-10-15 Jan Cegin , Branislav Pecher , Jakub Simko , Ivan Srba , Maria Bielikova , Peter Brusilovsky