English
Related papers

Related papers: General diffusions on metric graphs as limits of t…

200 papers

We connect known results about diffusion limits of Markov chain Monte Carlo (MCMC) algorithms to the Computer Science notion of algorithm complexity. Our main result states that any diffusion limit of a Markov process implies a…

Probability · Mathematics 2014-11-05 Gareth O. Roberts , Jeffrey S. Rosenthal

We study the estimation of the value function for continuous-time Markov diffusion processes using a single, discretely observed ergodic trajectory. Our work provides non-asymptotic statistical guarantees for the least-squares…

Machine Learning · Computer Science 2025-02-07 Wenlong Mou

In this paper, we are interested in investigating the perturbation bounds for the stationary distributions for discrete-time or continuous-time Markov chains on a countable state space. For discrete-time Markov chains, two new norm-wise…

Probability · Mathematics 2012-08-27 Yuanyuan Liu

Modelling random dynamical systems in continuous time, diffusion processes are a powerful tool in many areas of science. Model parameters can be estimated from time-discretely observed processes using Markov chain Monte Carlo (MCMC) methods…

Computation · Statistics 2020-10-12 Susanne Pieschner , Christiane Fuchs

Random walks on the circle group $\mathbb{R}/\mathbb{Z}$ whose elementary steps are lattice variables with span $\alpha \not\in \mathbb{Q}$ or $p/q \in \mathbb{Q}$ taken mod $\mathbb{Z}$ exhibit delicate behavior. In the rational case we…

Probability · Mathematics 2024-02-20 Istvan Berkes , Bence Borda

We consider a discrete time random walk in one dimension. At each time step the walker jumps by a random distance, independent from step to step, drawn from an arbitrary symmetric density function. We show that the expected positive maximum…

Statistical Mechanics · Physics 2009-11-11 Alain Comtet , Satya N. Majumdar

We study a variation of vanilla stochastic gradient descent where the optimizer only has access to a Markovian sampling scheme. These schemes encompass applications that range from decentralized optimization with a random walker (token…

Optimization and Control · Mathematics 2023-06-26 Mathieu Even

This paper provides an introduction to the Stein method framework in the context of steady-state diffusion approximations. The framework consists of three components: the Poisson equation and gradient bounds, generator coupling, and moment…

Probability · Mathematics 2017-02-21 Anton Braverman , J. G. Dai , Jiekun Feng

We study asymptotic limits of reversible random walks on tessellations via a variational approach, which relies on a specific generalized-gradient-flow formulation of the corresponding forward Kolmogorov equation. We establish sufficient…

Analysis of PDEs · Mathematics 2022-02-15 Anastasiia Hraivoronska , Oliver Tse

Discrete diffusion models based on continuous-time Markov chains (CTMCs) have shown strong performance on language and discrete data generation, yet existing approaches typically parameterize the reverse rate matrix monolithically --…

Machine Learning · Computer Science 2026-05-11 Jingyuan Li , Xiaoyi Jiang , Fukang Wen , Wei Liu , Renqian Luo , Yi Zhu , Zuoqiang Shi , Pipi Hu

We present a novel method for computing reachability probabilities of parametric discrete-time Markov chains whose transition probabilities are fractions of polynomials over a set of parameters. Our algorithm is based on two key…

Software Engineering · Computer Science 2014-03-28 Nils Jansen , Florian Corzilius , Matthias Volk , Ralf Wimmer , Erika Ábrahám , Joost-Pieter Katoen , Bernd Becker

In this paper, we develop and analyze a stochastic algorithm for solving space-time fractional diffusion models, which are widely used to describe anomalous diffusion dynamics. These models pose substantial numerical challenges due to the…

Numerical Analysis · Mathematics 2025-08-29 Tengteng Cui , Chengtao Sheng , Bihao Su , Zhi Zhou

We introduce a Markov chain for sampling from the uniform distribution on a Riemannian manifold $\mathcal{M}$, which we call the $\textit{geodesic walk}$. We prove that the mixing time of this walk on any manifold with positive sectional…

Probability · Mathematics 2017-11-28 Oren Mangoubi , Aaron Smith

We consider the continuous-time quantum walk defined on the adjacency matrix of a graph. At each instant, the walk defines a mixing matrix which is doubly-stochastic. The average of the mixing matrices contains relevant information about…

Combinatorics · Mathematics 2017-09-13 Gabriel Coutinho , Chris Godsil , Krystal Guo , Hanmeng Zhan

In this paper we consider parameter estimation for discretely observed diffusion processes. In particular, we focus on data that are observed at low frequency and methodology that can estimate parameters with uncertainty quantification.…

Computation · Statistics 2026-05-01 Jingning Yao , Ajay Jasra , Sheng Jiang

A space fractional diffusion-like equation is introduced, which embodies the nonlocality in time, represented by the memory kernel and the non-locality in space. A specific example of the nonlocal term is considered in combination with…

Statistical Mechanics · Physics 2026-01-06 Pece Trajanovski , Irina Petreska , Katarzyna Gorska , Ljupco Kocarev , Trifce Sandev

The shortest-path, commute time, and diffusion distances on undirected graphs have been widely employed in applications such as dimensionality reduction, link prediction, and trip planning. Increasingly, there is interest in using…

Social and Information Networks · Computer Science 2023-07-27 Zachary M. Boyd , Nicolas Fraiman , Jeremy L. Marzuola , Peter J. Mucha , Braxton Osting , Jonathan Weare

We investigate the hitting times of random walks on graphs, where a hitting time is defined as the number of steps required for a random walker to move from one node to another. While much of the existing literature focuses on calculating…

Probability · Mathematics 2025-11-10 Anuraag Kumar

We prove an averaging principle which asserts convergence of diffusion processes on domains separated by semi-permeable membranes, when diffusion coefficients tend to infinity while the flux through the membranes remains constant. In the…

Functional Analysis · Mathematics 2019-08-08 Adam Bobrowski , Bogdan Kazmierczak , Markus Kunze

Variance-Gamma distributions are widely used in financial modelling and contain as special cases the normal, Gamma and Laplace distributions. In this paper we extend Stein's method to this class of distributions. In particular, we obtain a…

Probability · Mathematics 2014-04-01 Robert E. Gaunt