English
Related papers

Related papers: Likelihood-Based Diffusion Language Models

200 papers

Diffusion models have gained traction as powerful algorithms for synthesizing high-quality images. Central to these algorithms is the diffusion process, a set of equations which maps data to noise in a way that can significantly affect…

Machine Learning · Computer Science 2024-11-12 Subham Sekhar Sahoo , Aaron Gokaslan , Chris De Sa , Volodymyr Kuleshov

Reasoning with large language models often benefits from generating multiple chains-of-thought, but existing aggregation strategies are typically trajectory-level (e.g., selecting the best trace or voting on the final answer), discarding…

Computation and Language · Computer Science 2026-02-27 Roy Miles , Aysim Toker , Andreea-Maria Oncescu , Songcen Xu , Jiankang Deng , Ismail Elezi

While energy-based models (EBMs) exhibit a number of desirable properties, training and sampling on high-dimensional datasets remains challenging. Inspired by recent progress on diffusion probabilistic models, we present a diffusion…

Machine Learning · Computer Science 2021-03-30 Ruiqi Gao , Yang Song , Ben Poole , Ying Nian Wu , Diederik P. Kingma

Diffusion models, a family of generative models based on deep learning, have become increasingly prominent in cutting-edge machine learning research. With a distinguished performance in generating samples that resemble the observed data,…

Machine Learning · Computer Science 2023-05-02 Lequan Lin , Zhengkun Li , Ruikun Li , Xuliang Li , Junbin Gao

In this work, we propose \texttt{TimeGrad}, an autoregressive model for multivariate probabilistic time series forecasting which samples from the data distribution at each time step by estimating its gradient. To this end, we use diffusion…

Machine Learning · Computer Science 2021-07-09 Kashif Rasul , Calvin Seward , Ingmar Schuster , Roland Vollgraf

Large language models (LLMs) exhibit probabilistic output characteristics, yet conventional evaluation frameworks rely on deterministic scalar metrics. This study introduces a Bayesian approach for LLM capability assessment that integrates…

Computation and Language · Computer Science 2025-05-01 Xiao Xiao , Yu Su , Sijing Zhang , Zhang Chen , Yadong Chen , Tian Liu

Diffusion models have become a powerful family of deep generative models, with record-breaking performance in many applications. This paper first gives an overview and derivation of the basic theory of diffusion models, then reviews the…

Computation and Language · Computer Science 2023-03-15 Yuansong Zhu , Yu Zhao

Language models (LMs) are machine learning models designed to predict linguistic patterns by estimating the probability of word sequences based on large-scale datasets, such as text. LMs have a wide range of applications in natural language…

Diffusion models recently proved to be remarkable priors for Bayesian inverse problems. However, training these models typically requires access to large amounts of clean data, which could prove difficult in some settings. In this work, we…

Machine Learning · Computer Science 2025-11-04 François Rozet , Gérôme Andry , François Lanusse , Gilles Louppe

Large language models (LLMs) have become increasingly prevalent in our daily lives, leading to an expectation for LLMs to be trustworthy -- - both accurate and well-calibrated (the prediction confidence should align with its ground truth…

Computation and Language · Computer Science 2024-10-04 KaShun Shum , Minrui Xu , Jianshu Zhang , Zixin Chen , Shizhe Diao , Hanze Dong , Jipeng Zhang , Muhammad Omer Raza

Preference optimization for diffusion models aims to align them with human preferences for images. Previous methods typically use Vision-Language Models (VLMs) as pixel-level reward models to approximate human preferences. However, when…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Tao Zhang , Cheng Da , Kun Ding , Huan Yang , Kun Jin , Yan Li , Tingting Gao , Di Zhang , Shiming Xiang , Chunhong Pan

Diffusion models have become a central paradigm for image and multimodal generation, yet their deployment raises persistent questions about alignment, safety, preference satisfaction, and robustness to misuse. This survey reviews recent…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Preeti Lamba , Kiran Ravish , Ankita Kushwaha , Pawan Kumar

Diffusion probabilistic models have demonstrated an outstanding capability to model natural images and raw audio waveforms through a paired diffusion and reverse processes. The unique property of the reverse process (namely, eliminating…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-23 Yen-Ju Lu , Yu Tsao , Shinji Watanabe

Diffusion models have seen immense success in modelling continuous data across a range of domains such as vision and audio. Despite the challenges of adapting diffusion models to discrete data, recent work explores their application to text…

Computation and Language · Computer Science 2025-03-17 Zak Buzzard

In this report, we explore the potential for text diffusion to replace autoregressive (AR) decoding for the training and deployment of large language models (LLMs). We are particularly interested to see whether pretrained AR models can be…

Computation and Language · Computer Science 2024-01-31 Kehang Han , Kathleen Kenealy , Aditya Barua , Noah Fiedel , Noah Constant

Discrete diffusion language models have emerged as a competitive alternative to auto-regressive language models, but training them efficiently under limited parameter and memory budgets remains challenging. Modern architectures are…

Computation and Language · Computer Science 2026-04-07 Zihao Wu , Haoming Yang , Juncheng Dong , Vahid Tarokh

Recent progress in Quality Diversity Reinforcement Learning (QD-RL) has enabled learning a collection of behaviorally diverse, high performing policies. However, these methods typically involve storing thousands of policies, which results…

Machine Learning · Computer Science 2023-06-27 Shashank Hegde , Sumeet Batra , K. R. Zentner , Gaurav S. Sukhatme

Discrete Diffusion Language Models progressed rapidly as an alternative to autoregressive (AR) models, motivated by their parallel generation abilities. However, for tractability, discrete diffusion models sample from a factorized…

Machine Learning · Computer Science 2026-05-19 Justin Deschenaux , Caglar Gulcehre

Large Language Models (LLMs) have recently been successfully applied to regression tasks -- such as time series forecasting and tabular prediction -- by leveraging their in-context learning abilities. However, their autoregressive decoding…

Machine Learning · Computer Science 2026-03-04 Julianna Piskorz , Katarzyna Kobalczyk , Mihaela van der Schaar

Uniform-state discrete diffusion models excel at few-step generation and guidance due to their ability to self-correct, making them preferred over autoregressive or Masked diffusion models in these settings. However, their sampling quality…

Machine Learning · Computer Science 2026-05-19 Justin Deschenaux , Caglar Gulcehre , Subham Sekhar Sahoo