中文
相关论文

相关论文: Non-Asymptotic Convergence of Discrete Diffusion M…

200 篇论文

Reversing a diffusion process by learning its score forms the heart of diffusion-based generative modeling and for estimating properties of scientific systems. The diffusion processes that are tractable center on linear processes with a…

机器学习 · 计算机科学 2024-07-12 Raghav Singhal , Mark Goldstein , Rajesh Ranganath

We introduce and study a class of probabilistic generative models, where the latent object is a finite-dimensional diffusion process on a finite time interval and the observed variable is drawn conditionally on the terminal point of the…

概率论 · 数学 2019-06-03 Belinda Tzen , Maxim Raginsky

Diffusion models have demonstrated remarkable performance in generating high-dimensional samples across domains such as vision, language, and the sciences. Although continuous-state diffusion models have been extensively studied both…

机器学习 · 计算机科学 2026-02-17 Aadithya Srikanth , Mudit Gaur , Vaneet Aggarwal

Diffusion models are recent state-of-the-art methods for image generation and likelihood estimation. In this work, we generalize continuous-time diffusion models to arbitrary Riemannian manifolds and derive a variational framework for…

机器学习 · 计算机科学 2022-08-18 Chin-Wei Huang , Milad Aghajohari , Avishek Joey Bose , Prakash Panangaden , Aaron Courville

We propose a new semiparametric approach for modelling nonlinear univariate diffusions, where the observed process is a nonparametric transformation of an underlying parametric diffusion (UPD). This modelling strategy yields a general class…

计量经济学 · 经济学 2020-05-08 Ruijun Bu , Kaddour Hadri , Dennis Kristensen

We consider nonparametric invariant density and drift estimation for a class of multidimensional degenerate resp. hypoelliptic diffusion processes, so-called stochastic damping Hamiltonian systems or kinetic diffusions, under anisotropic…

统计理论 · 数学 2022-05-24 Niklas Dexheimer , Claudia Strauch

We prove that a denoising diffusion sampler equipped with a sequential bias across the batch dimension is exactly an Euler-Maruyama integrator for overdamped Langevin dynamics. Each reverse denoising step, with its associated spring…

机器学习 · 计算机科学 2025-12-01 Justin Diamond , Markus Lill

Part of the success of diffusion models stems from their ability to perform iterative refinement, i.e., repeatedly correcting outputs during generation. However, modern masked discrete diffusion lacks this capability: when a token is…

机器学习 · 计算机科学 2026-02-10 Guanghan Wang , Yair Schiff , Subham Sekhar Sahoo , Volodymyr Kuleshov

Despite Flow Matching and diffusion models having emerged as powerful generative paradigms for continuous variables such as images and videos, their application to high-dimensional discrete data, such as language, is still limited. In this…

机器学习 · 计算机科学 2024-11-06 Itai Gat , Tal Remez , Neta Shaul , Felix Kreuk , Ricky T. Q. Chen , Gabriel Synnaeve , Yossi Adi , Yaron Lipman

We suggest an explanation of typical incubation times statistical features based on the universal behavior of exit times for diffusion models. We give a mathematically rigorous proof of the characteristic right skewness of the incubation…

定量方法 · 定量生物学 2018-04-18 Yuri Bakhtin

Recently, a series of papers proposed deep learning-based approaches to sample from target distributions using controlled diffusion processes, being trained only on the unnormalized target densities without access to samples. Building on…

机器学习 · 计算机科学 2024-05-24 Lorenz Richter , Julius Berner

Diffusion-based models decompose sampling into many small Gaussian denoising steps -- an assumption that breaks down when generation is compressed to a few coarse transitions. Existing few-step methods address this through distillation,…

计算机视觉与模式识别 · 计算机科学 2026-05-14 Jiatao Gu , Tianrong Chen , Ying Shen , David Berthelot , Shuangfei Zhai , Josh Susskind

A finite dimensional abstract approximation and convergence theory is developed for estimation of the distribution of random parameters in infinite dimensional discrete time linear systems with dynamics described by regularly dissipative…

最优化与控制 · 数学 2019-03-15 Melike Sirlanci , Susan E. Luczak , I. Gary Rosen

Diffusion models, typically formulated as discretizations of stochastic differential equations (SDEs), have achieved state-of-the-art performance in generative tasks. However, their theoretical analysis often involves complex proofs. In…

机器学习 · 计算机科学 2026-02-02 Juhyeok Choi , Chenglin Fan

Diffusion generative models have emerged as powerful tools for producing synthetic data from an empirically observed distribution. A common approach involves simulating the time-reversal of an Ornstein-Uhlenbeck (OU) process initialized at…

机器学习 · 统计学 2025-12-02 Valentin de Bortoli , Romuald Elie , Anna Kazeykina , Zhenjie Ren , Jiacheng Zhang

The denoising diffusion probabilistic model (DDPM) has emerged as a mainstream generative model in generative AI. While sharp convergence guarantees have been established for the DDPM, the iteration complexity is, in general, proportional…

机器学习 · 计算机科学 2026-02-17 Zhihan Huang , Yuting Wei , Yuxin Chen

Highly evolved animals continuously update their knowledge of social factors, refining movement decisions based on both historical and real-time observations. Despite its significance, research on the underlying mechanisms remains limited.…

种群与进化 · 定量生物学 2024-12-31 Tianxu Wang , Kyunghan Choi , Hao Wang

Denoising diffusion models have recently emerged as the predominant paradigm for generative modelling on image domains. In addition, their extension to Riemannian manifolds has facilitated a range of applications across the natural…

机器学习 · 计算机科学 2023-11-10 Nic Fishman , Leo Klarner , Emile Mathieu , Michael Hutchinson , Valentin de Bortoli

Continuous diffusion is a natural framework for non-autoregressive generation but has generally lagged behind masked discrete diffusion models (MDMs) on discrete sequence generation. We argue that the bottleneck is not continuity itself,…

Continuous diffusion is a natural framework for non-autoregressive generation but has generally lagged behind masked discrete diffusion models (MDMs) on discrete sequence generation. We argue that the bottleneck is not continuity itself,…