Related papers: A Markov process for an infinite interacting parti…
We consider an infinite locally finite system (configuration) $\gamma$ of particles distributed over a Euclidean space $X$. Each particle located at $x\in X$ carries an internal parameter (mark, or ``spin'') $\sigma_{x}\in S=\mathbb{R}.$…
We study infinite-horizon robust Markov decision processes (MDPs) on continuous state spaces with structured rectangular ambiguity set. The proposed ambiguity set falls within the convex hull of unknown generating kernels. We utilize the…
We continue the analysis of nontrivial examples of quantum Markov processes. This is done by applying the construction of entangled Markov chains obtained from classical Markov chains with infinite state--space. The formula giving the joint…
We construct and study branching Markov processes on the space of finite configurations of the state space of a given standard process, controlled by a branching kernel and a killing one. In particular, we may start with a superprocess,…
Let $\Gamma$ denote the space of all locally finite subsets (configurations) in $R^d$. A stochastic dynamics of binary jumps in continuum is a Markov process on $\Gamma$ in which pairs of particles simultaneously hop over $R^d$. In this…
Let $\sigma$ be a non-atomic, infinite Radon measure on $\mathbb R^d$, for example, $d\sigma(x)=z\,dx$ where $z>0$. We consider a system of freely independent particles $x_1,\dots,x_N$ in a bounded set $\Lambda\subset\mathbb R^d$, where…
Large ensembles of stochastically evolving interacting particles describe phenomena in diverse fields including statistical physics, neuroscience, biology, and engineering. In such systems, the infinitesimal evolution of each particle…
Firstly we consider a finite dimensional Markov semigroup generated by Dunkl laplacian with drift terms. Using gradient bounds we show that for small coefficients this semigroup has an invariant measure. We then extend this analysis to an…
Piecewise-deterministic Markov processes form a general class of non-diffusion stochastic models that involve both deterministic trajectories and random jumps at random times. In this paper, we state a new characterization of the jump rate…
We consider a certain sequence of random walks. The state space of the n-th random walk is the set of all strict partitions of n (that is, partitions without equal parts). We prove that, as n goes to infinity, these random walks converge to…
We study the existence and the exponential ergodicity of a general interacting particle system, whose components are driven by independent diffusion processes with values in an open subset of $\mathds{R}^d$, $d\geq 1$. The interaction…
Markovian diffusion processes yield a system of conservation laws which couple various conditional expectation values (local moments). Solutions of that closed system of deterministic partial differential equations stand for a regular…
The dynamics of an infinite system of point particles in $\mathbb{R}^d$, which hop and interact with each other, is described at both micro- and mesoscopic levels. The states of the system are probability measures on the space of…
Introduced is the notion of minimality for spectral representations of sum- and max-infinitely divisible processes and it is shown that the minimal spectral representation on a Borel space exists and is unique. This fact is used to show…
We introduce a stochastic dynamics related to the measures that arise in harmonic analysis on the infinite-dimensional unitary group. Our dynamics is obtained as a limit of a sequence of natural Markov chains on Gelfand-Tsetlin graph. We…
We define and study a family of Markov processes with state space the compact set of all partitions of N that we call exchangeable fragmentation-coalescence processes. They can be viewed as a combination of exchangeable fragmentation as…
We present an explicit construction of a Markovian random growth process on integer partitions such that given it visits some level $n$, it passes through any partition $\lambda$ of $n$ with equal probabilities. The construction has…
Macdonald processes are certain probability measures on two-dimensional arrays of interlacing particles introduced by Borodin and Corwin (arXiv:1111.4408 [math.PR]). They are defined in terms of nonnegative specializations of the Macdonald…
In this work, we study dynamic programming (DP) algorithms for partially observable Markov decision processes with jointly continuous and discrete state-spaces. We consider a class of stochastic systems which have coupled discrete and…
Piecewise-deterministic Markov processes (PDMPs) offer a powerful stochastic modeling framework that combines deterministic trajectories with random perturbations at random times. Estimating their local characteristics (particularly the…