English
Related papers

Related papers: Lazy Diffusion: Mitigating spectral collapse in ge…

200 papers

Continuous diffusion is a natural framework for non-autoregressive generation but has generally lagged behind masked discrete diffusion models (MDMs) on discrete sequence generation. We argue that the bottleneck is not continuity itself,…

Machine Learning · Computer Science 2026-05-22 Yunshu Wu , Jiayi Cheng , Longxuan Yu , Partha Thakuria , Rob Brekelmans , Evangelos E. Papalexakis , Greg Ver Steeg

Denoising diffusion models have become ubiquitous for generative modeling. The core idea is to transport the data distribution to a Gaussian by using a diffusion. Approximate samples from the data distribution are then obtained by…

Diffusion models (DMs) have revolutionized generative learning. They utilize a diffusion process to encode data into a simple Gaussian distribution. However, encoding a complex, potentially multimodal data distribution into a single…

Machine Learning · Computer Science 2024-07-04 Yilun Xu , Gabriele Corso , Tommi Jaakkola , Arash Vahdat , Karsten Kreis

Diffusion models have emerged as a powerful framework for generative tasks in deep learning. They decompose generative modeling into two computational primitives: deterministic neural-network evaluation and stochastic sampling. Current…

Machine Learning · Computer Science 2026-03-31 Nihal Sanjay Singh , Mazdak Mohseni-Rajaee , Shaila Niazi , Kerem Y. Camsari

Deep Generative Models (DGMs), including Energy-Based Models (EBMs) and Score-based Generative Models (SGMs), have advanced high-fidelity data generation and complex continuous distribution approximation. However, their application in…

Machine Learning · Computer Science 2024-10-03 Yangming Li , Chieh-Hsin Lai , Carola-Bibiane Schönlieb , Yuki Mitsufuji , Stefano Ermon

Diffusion models show promise for dynamic scene deblurring; however, existing studies often fail to leverage the intrinsic nature of the blurring process within diffusion models, limiting their full potential. To address it, we present a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Jin-Ting He , Fu-Jen Tsai , Yan-Tsung Peng , Min-Hung Chen , Chia-Wen Lin , Yen-Yu Lin

We study a discrete denoising diffusion framework that integrates a sample-efficient estimator of single-site conditionals with round-robin noising and denoising dynamics for generative modeling over discrete state spaces. Rather than…

Machine Learning · Computer Science 2026-03-02 Karthik Elamvazhuthi , Abhijith Jayakumar , Andrey Y. Lokhov

Diffusion models generate high-dimensional data such as images by learning a process that gradually removes noise from corrupted data. Recent studies have shown that the backward dynamics of diffusion models exhibit two characteristic…

Statistical Mechanics · Physics 2026-04-14 Tomoei Takahashi , Takashi Takahashi , Yoshiyuki Kabashima

The finite symmetric group S_n provides a natural domain for permutations, yet learning probability distributions on S_n is challenging due to its factorially growing size and discrete, non-Euclidean structure. Recent permutation diffusion…

Machine Learning · Computer Science 2026-03-19 Sizhuang He , Yangtian Zhang , Shiyang Zhang , David van Dijk

Originating from the diffusion phenomenon in physics, which describes the random movement and collisions of particles, diffusion generative models simulate a random walk in the data space along the denoising trajectory. This allows…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Yuhan Pei , Ruoyu Wang , Yongqi Yang , Ye Zhu , Olga Russakovsky , Yu Wu

Inferring seabed topography from wave height observations is fundamental to tsunami hazard assessment, coastal planning, and large scale ocean circulation modeling. Classical inversion models typically rely on direct sensing or optimization…

Atmospheric and Oceanic Physics · Physics 2025-09-03 Aoming Liang , Qi Liu , Weicheng Cui

Exploring noise distributions beyond Gaussian in diffusion models remains an open challenge. While Gaussian-based models succeed within a unified SDE framework, recent studies suggest that heavy-tailed noise distributions, like…

Machine Learning · Computer Science 2025-06-18 Dario Shariatian , Umut Simsekli , Alain Durmus

Diffusion-based models have shown great promise in molecular generation but often require a large number of sampling steps to generate valid samples. In this paper, we introduce a novel Straight-Line Diffusion Model (SLDM) to tackle this…

Machine Learning · Computer Science 2025-06-10 Yuyan Ni , Shikun Feng , Haohan Chi , Bowen Zheng , Huan-ang Gao , Wei-Ying Ma , Zhi-Ming Ma , Yanyan Lan

We survey continuous-time generative modeling methods based on transporting a simple reference distribution to a data distribution via stochastic or deterministic dynamics. We present a unified framework in which diffusion models,…

Machine Learning · Computer Science 2026-05-11 Aditya Ranganath , Mukesh Singhal

We introduce Generalized Discrete Diffusion from Snapshots (GDDS), a unified framework for discrete diffusion modeling that supports arbitrary noising processes over large discrete state spaces. Our formulation encompasses all existing…

Machine Learning · Statistics 2026-03-24 Oussama Zekri , Théo Uscidda , Nicolas Boullé , Anna Korba

The stochastic formation of defects during Laser Powder Bed Fusion (L-PBF) negatively impacts its adoption for high-precision use cases. Optical monitoring techniques can be used to identify defects based on layer-wise imaging, but these…

Image and Video Processing · Electrical Eng. & Systems 2024-09-23 Francis Ogoke , Sumesh Kalambettu Suresh , Jesse Adamczyk , Dan Bolintineanu , Anthony Garland , Michael Heiden , Amir Barati Farimani

Diffusive dynamics abound in nature and have been especially studied in physical, biological, and financial systems. These dynamics are characterised by a linear growth of the mean squared displacement (MSD) with time. Often, the conditions…

Statistical Mechanics · Physics 2025-11-14 Alvaro Lanza , Xiang Qu , Stefano Bo

Score-based diffusion models have emerged as a powerful class of generative methods, achieving state-of-the-art performance across diverse domains. Despite their empirical success, the mathematical foundations of those models remain only…

Optimization and Control · Mathematics 2026-05-13 Kang Liu , Enrique Zuazua

Diffusion-based posterior samplers use pretrained diffusion priors to sample from measurement- or reward-conditioned posteriors, and are widely used for inverse problems. Yet their theoretical behavior remains poorly understood: even with…

Machine Learning · Computer Science 2026-05-08 Matias G. Delgadino , Sebastien Motsch , Advait Parulekar , William Porteous , Sanjay Shakkottai

Many approaches to modelling reaction-diffusion systems with anomalous transport rely on deterministic equations and ignore fluctuations arising due to finite particle numbers. Starting from an individual-based model we use a…

Statistical Mechanics · Physics 2019-05-29 Joseph W. Baron , Tobias Galla