English
Related papers

Related papers: Martingale Posteriors for Discretely Observed Diff…

200 papers

Ordinary differential equations (ODEs) are widely used to describe dynamical systems in science, but identifying parameters that explain experimental measurements is challenging. In particular, although ODEs are differentiable and would…

Machine Learning · Computer Science 2024-07-22 Jonas Beck , Nathanael Bosch , Michael Deistler , Kyra L. Kadhim , Jakob H. Macke , Philipp Hennig , Philipp Berens

There has been substantial interest in developing Markov chain Monte Carlo algorithms based on piecewise-deterministic Markov processes. However existing algorithms can only be used if the target distribution of interest is differentiable…

Statistics Theory · Mathematics 2021-11-12 Augustin Chevallier , Sam Power , Andi Q. Wang , Paul Fearnhead

Sequential Monte Carlo (SMC), or particle filtering, is widely used in nonlinear state-space systems, but its performance often suffers from poorly approximated proposal and state-transition distributions. This work introduces a…

Machine Learning · Computer Science 2026-05-14 Wessel L. van Nierop , Nir Shlezinger , Ruud J. G. van Sloun

This paper provides an elementary, self-contained analysis of diffusion-based sampling methods for generative modeling. In contrast to existing approaches that rely on continuous-time processes and then discretize, our treatment works…

Machine Learning · Statistics 2025-06-25 Galen Reeves , Henry D. Pfister

We propose a novel sequential Monte Carlo (SMC) method for sampling from unnormalized target distributions based on a reverse denoising diffusion process. While recent diffusion-based samplers simulate the reverse diffusion using…

Computation · Statistics 2025-11-06 Luhuan Wu , Yi Han , Christian A. Naesseth , John P. Cunningham

We develop a Markov process viewpoint for discrete circular distributions motivated by directional-statistics settings where angles are observed on a finite grid and evolve over time. On the $m$-point discrete circle, the cycle graph, we…

Statistics Theory · Mathematics 2026-03-04 Sourav Majumdar

Discrete diffusion models have become highly effective across various domains. However, real-world applications often require the generative process to adhere to certain constraints. To this end, we propose a Sequential Monte Carlo (SMC)…

Machine Learning · Computer Science 2026-03-17 Zijing Ou , Chinmay Pani , Yingzhen Li

This paper presents a Markov-based system model for microfluidic molecular communication (MC) channels. By discretizing the advection-diffusion dynamics, the proposed model establishes a physically consistent state-space formulation. The…

Emerging Technologies · Computer Science 2025-11-11 Ruifeng Zheng , Pengjie Zhou , Pit Hofmann , Fatima Rani , Juan A. Cabrera , Frank H. P. Fitzek

Discrete diffusion has recently emerged as a promising paradigm in discrete data modeling. However, existing methods typically rely on a fixed rate transition matrix during training, which not only limits the expressiveness of latent…

Machine Learning · Computer Science 2025-05-27 Hengli Li , Yuxuan Wang , Song-Chun Zhu , Ying Nian Wu , Zilong Zheng

In this paper, we provide a multiscale perspective on the problem of maximum marginal likelihood estimation. We consider and analyse a diffusion-based maximum marginal likelihood estimation scheme using ideas from multiscale dynamics. Our…

Computation · Statistics 2024-06-11 O. Deniz Akyildiz , Michela Ottobre , Iain Souttar

We present a new algorithm to optimize distributions defined implicitly by parameterized stochastic diffusions. Doing so allows us to modify the outcome distribution of sampling processes by optimizing over their parameters. We introduce a…

We develop Bayesian models for density regression with emphasis on discrete outcomes. The problem of density regression is approached by considering methods for multivariate density estimation of mixed scale variables, and obtaining…

Methodology · Statistics 2019-08-14 Georgios Papageorgiou

Despite Flow Matching and diffusion models having emerged as powerful generative paradigms for continuous variables such as images and videos, their application to high-dimensional discrete data, such as language, is still limited. In this…

Machine Learning · Computer Science 2024-11-06 Itai Gat , Tal Remez , Neta Shaul , Felix Kreuk , Ricky T. Q. Chen , Gabriel Synnaeve , Yossi Adi , Yaron Lipman

We describe a new MCMC method optimized for the sampling of probability measures on Hilbert space which have a density with respect to a Gaussian; such measures arise in the Bayesian approach to inverse problems, and in conditioned…

Probability · Mathematics 2014-04-04 Michela Ottobre , Natesh S. Pillai , Frank J. Pinski , Andrew M. Stuart

We prove concentration inequalities and associated PAC bounds for continuous- and discrete-time additive functionals for possibly unbounded functions of multivariate, nonreversible diffusion processes. Our analysis relies on an approach via…

Probability · Mathematics 2024-10-15 Cathrine Aeckerle-Willems , Claudia Strauch , Lukas Trottner

Markov Chain Monte Carlo (MCMC) methods are a powerful tool for computation with complex probability distributions. However the performance of such methods is critically dependant on properly tuned parameters, most of which are difficult if…

Computation · Statistics 2021-10-27 James A. Brofos , Marylou Gabrié , Marcus A. Brubaker , Roy R. Lederman

Sequential Monte Carlo techniques are useful for state estimation in non-linear, non-Gaussian dynamic models. These methods allow us to approximate the joint posterior distribution using sequential importance sampling. In this framework,…

Computation · Statistics 2012-07-09 Mike Klaas , Nando de Freitas , Arnaud Doucet

This paper studies the original discrete-time denoising diffusion probabilistic model (DDPM) from a probabilistic point of view. We present three main theoretical results. First, we show that the time-dependent score function associated…

Probability · Mathematics 2026-01-13 Yumiharu Nakano

We introduce an inferential framework for a wide class of semi-linear stochastic differential equations (SDEs). Recent work has shown that numerical splitting schemes can preserve critical properties of such types of SDEs, give rise to…

Computation · Statistics 2025-07-22 Shu Huang , Richard G. Everitt , Massimiliano Tamborrino , Adam M. Johansen

This paper concerns the use of the expectation-maximisation (EM) algorithm for inference in partially observed diffusion processes. In this context, a well known problem is that all except a few diffusion processes lack closed-form…

Statistics Theory · Mathematics 2010-08-18 Jimmy Olsson , Jonas Ströjby