English
Related papers

Related papers: The Cosine Schedule is Fisher-Rao-Optimal for Mask…

200 papers

Denoising diffusion models (DDMs) offer a flexible framework for sampling from high dimensional data distributions. DDMs generate a path of probability distributions interpolating between a reference Gaussian distribution and a data…

Machine Learning · Statistics 2024-12-12 Christopher Williams , Andrew Campbell , Arnaud Doucet , Saifuddin Syed

A new discretization approach is presented for the simulation of flow in complex poro-fractured media described by means of the Discrete Fracture and Matrix Model. The method is based on the numerical optimization of a properly defined…

Numerical Analysis · Mathematics 2020-04-10 Stefano Berrone , Alessandro D'Auria , Stefano Scialo'

Recently proposed generative models for discrete data, such as Masked Diffusion Models (MDMs), exploit conditional independence approximations to reduce the computational cost of popular Auto-Regressive Models (ARMs), at the price of some…

Machine Learning · Statistics 2025-12-18 Hugo Lavenant , Giacomo Zanella

We develop a principled framework for analyzing and designing noise schedules in diffusion models. We show that one can recast this design problem as an optimal control problem, whose state is the Fisher information of the diffusion process…

Machine Learning · Computer Science 2026-05-22 Seo Taek Kong , Weina Wang , R. Srikant

Discrete diffusion models, like continuous diffusion models, generate high-quality samples by gradually undoing noise applied to datapoints with a Markov process. Gradual generation in theory comes with many conceptual benefits; for…

Machine Learning · Computer Science 2025-09-30 Alan N. Amin , Nate Gruver , Andrew Gordon Wilson

Practical diffusion sampling is a numerical approximation problem: under a fixed inference budget, one must simulate a reverse-time ODE or SDE using only a limited number of denoising steps, so discretization error is often the dominant…

Machine Learning · Computer Science 2026-05-12 Samuel Hurault , Thomas Moreau , Gabriel Peyré

Reflected diffusions in polyhedral domains are commonly used as approximate models for stochastic processing networks in heavy traffic. Stationary distributions of such models give useful information on the steady state performance of the…

Probability · Mathematics 2012-05-24 Amarjit Budhiraja , Jiang Chen , Sylvain Rubenthaler

Diffusion Probabilistic Models (DPMs) have demonstrated exceptional capability of generating high-quality and diverse images, but their practical application is hindered by the intensive computational cost during inference. The DPM…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Jen-Yuan Huang

We present a methodology for clustering N objects which are described by multivariate time series, i.e. several sequences of real-valued random variables. This clustering methodology leverages copulas which are distributions encoding the…

Machine Learning · Statistics 2016-11-15 Gautier Marti , Sébastien Andler , Frank Nielsen , Philippe Donnat

The design space of discrete-space diffusion or flow generative models are significantly less well-understood than their continuous-space counterparts, with many works focusing only on a simple masked construction. In this work, we aim to…

We study discretizations of Hamiltonian systems on the probability density manifold equipped with the $L^2$-Wasserstein metric. Based on discrete optimal transport theory, several Hamiltonian systems on graph (lattice) with different…

Numerical Analysis · Mathematics 2020-06-17 Jianbo Cui , Luca Dieci , Haomin Zhou

We present a systematic theoretical framework that interprets masked diffusion models (MDMs) as solutions to energy minimization problems in discrete optimal transport. Specifically, we prove that three distinct energy…

Machine Learning · Computer Science 2026-03-24 Sitong Chen , Shen Nie , Jiacheng Sun , Zijin Feng , Zhenguo Li , Ji-Rong Wen , Chongxuan Li

We present discrete-time approximation of optimal control policies for infinite horizon discounted/ergodic control problems for controlled diffusions in $\Rd$\,. In particular, our objective is to show near optimality of optimal policies…

Optimization and Control · Mathematics 2025-02-11 Somnath Pradhan , Serdar Yuksel

Continuous diffusion models are commonly acknowledged to display a deterministic probability flow, whereas discrete diffusion models do not. In this paper, we aim to establish the fundamental theory for the probability flow of discrete…

Machine Learning · Computer Science 2023-11-08 Pengze Zhang , Hubery Yin , Chen Li , Xiaohua Xie

This paper addresses a problem in experimental design: We consider It\^o diffusions specified by some $\theta \in \mathbb{R}$ and assume that we are allowed to observe their sample paths only $n$ times before a terminal time $\tau <…

Methodology · Statistics 2017-09-05 Aurya Javeed , Giles Hooker

Translational diffusion coefficients are routinely estimated from molecular dynamics simulations. Linear fits to mean squared displacement (MSD) curves have become the de facto standard, from simple liquids to complex biomacromolecules.…

Computational Physics · Physics 2020-11-20 Jakob Tómas Bullerjahn , Sören von Bülow , Gerhard Hummer

Learning to sample from complex unnormalized distributions over discrete domains emerged as a promising research direction with applications in statistical physics, variational inference, and combinatorial optimization. Recent work has…

Conditional Diffusion Models are powerful surrogates for emulating complex spatiotemporal dynamics, yet they often fail to match the accuracy of deterministic neural emulators for high-precision tasks. In this work, we address two critical…

Machine Learning · Computer Science 2026-04-13 Constantin Le Cleï , Nils Thuerey , Xiaoxiang Zhu

Discrete diffusion models have recently emerged as a promising alternative to the autoregressive approach for generating discrete sequences. Sample generation via gradual denoising or demasking processes allows them to capture hierarchical…

This work presents a probabilistic scheme for solving semilinear nonlocal diffusion equations with volume constraints and integrable kernels. The nonlocal model of interest is defined by a time-dependent semilinear partial…

Numerical Analysis · Mathematics 2022-05-03 Minglei Yang , Guannan Zhang , Diego Del-Castillo-Negrete , Yanzhao Cao
‹ Prev 1 2 3 10 Next ›