Related papers: Markov processes with darning and their approximat…
In this work we introduce new approximate similarity relations that are shown to be key for policy (or control) synthesis over general Markov decision processes. The models of interest are discrete-time Markov decision processes, endowed…
A universal method for the concatenation of a sequence of Markov right processes is established. It is then applied to the continued pasting of two Markov right processes, which can be used for pathwise constructions of locally defined…
Probabilistic generative models based on measure transport, such as diffusion and flow-based models, are often formulated in the language of Markovian stochastic dynamics, where the choice of the underlying process impacts both algorithmic…
Diffusion models have achieved huge empirical success in data generation tasks. Recently, some efforts have been made to adapt the framework of diffusion models to discrete state space, providing a more natural approach for modeling…
We provide a mathematical study of the modified Diffusion Monte Carlo (DMC) algorithm introduced in the companion article \cite{DMC}. DMC is a simulation technique that uses branching particle systems to represent expectations associated…
We construct a system of interacting two-sided Bessel processes on the unit interval and show that the associated empirical measure process converges to the Wasserstein Diffusion, assuming that Markov uniqueness holds for the generating…
In two phase materials, each phase having a non-local response in time, it has been found that for some driving fields the response somehow untangles at specific times, and allows one to directly infer useful information about the geometry…
Let $(S,\rho)$ be an ultrametric space with certain conditions and $S^k$ be the quotient space of $S$ with respect to the partition by balls with a fixed radius $\phi(k)$. We prove that, for a Hunt process $X$ on $S$ associated with a…
For each $n$ let $Y^n_t$ be a continuous time symmetric Markov chain with state space $n^{-1} \Z^d$. A condition in terms of the conductances is given for the convergence of the $Y^n_t$ to a symmetric Markov process $Y_t$ on $\R^d$. We have…
The recent study by B. De Bruyne, S. N. Majumdar, H. Orland and G. Schehr [arXiv:2110.07573], concerning the conditioning of the Brownian motion and of random walks on global dynamical constraints over a finite time-window $T$, is…
Zabrodin recently proposed a generalization of Dyson Brownian motion to a setting where the particles are confined to a smooth Jordan curve in the plane. In this paper, we discuss a rigorous construction of such a process on a rectifiable…
The construction presented in this paper can be briefly described as follows: starting from any "finite-dimensional" Markov transition function p_t, on a measurable state space (E,B), we construct a strong Markov process on a certain…
The design space of discrete-space diffusion or flow generative models are significantly less well-understood than their continuous-space counterparts, with many works focusing only on a simple masked construction. In this work, we aim to…
In this paper we investigate three discrete or semi-discrete approximation schemes for reflected Brownian motion on bounded Euclidean domains. For a class of bounded domains $D$ in $\mathbb{R}^n$ that includes all bounded Lipschitz domains…
Selected theoretical developments in modeling of deposition of submicrometer size (submicron) particles on solid surfaces, with and without surface diffusion, of interest in colloid, polymer, and certain biological systems, are surveyed. We…
A dynamical system may be defined by a simple transition law - such as a map or a vector field. The objective of most learning techniques is to reconstruct this dynamic transition law. This is a major shortcoming, as most dynamic properties…
We consider Brownian motions with one-sided collisions, meaning that each particle is reflected at its right neighbour. For a finite number of particles a Sch\"{u}tz-type formula is derived for the transition probability. We investigate an…
For a class of stochastic differential equations with reflection for which a certain ${\mathbb{L}}^p$ continuity condition holds with $p>1$, it is shown that any weak solution that is a strong Markov process can be decomposed into the sum…
In this paper, we are interested in the self-similar growth-fragmentation process that shows up when slicing half-space excursions of a $d$-dimensional Brownian motion from hyperplanes. Such a family of processes turns out to be a spatial…
Fluid approximations have seen great success in approximating the macro-scale behaviour of Markov systems with a large number of discrete states. However, these methods rely on the continuous-time Markov chain (CTMC) having a particular…