Related papers: Kolmogorov's Equations for Jump Markov Processes a…

We study a family of continuous time Markov jump processes on strict partitions (partitions with distinct parts) preserving the distributions introduced by Borodin (1997) in connection with projective representations of the infinite…

This paper presents a numerical method to calculate the value function for a general discounted impulse control problem for piecewise deterministic Markov processes. Our approach is based on a quantization technique for the underlying…

Jump Markov linear systems (JMLS) are a useful class which can be used to model processes which exhibit random changes in behavior during operation. This paper presents a numerically stable method for learning the parameters of jump Markov…

We study a general non-homogeneous Skellam-type process with jumps of arbitrary fixed size. We express this process in terms of a linear combination of Poisson processes and study several properties, including the summation of independent…

Among various rare events, the effective computation of transition paths connecting metastable states in a stochastic model is an important problem. This paper proposes a stochastic optimal control formulation for transition path problems…

Every exchangeable Feller process taking values in a suitably nice combinatorial state space can be constructed by a system of iterated random Lipschitz functions. In discrete time, the construction proceeds by iterated application of…

The paper by A.N. Kolmogorov 1934 "Random Moves", hereinafter ANK34, uses a Fokker-Planck-type equation for a 6-dimensional vector with a total rather than a partial derivative with respect to time, and with a Laplacian in the space of…

We study the dispersion of a particle whose motion dynamics can be described by a forced velocity jump process. To investigate large deviations results, we study the Chapman-Kolmogorov equation of this process in the hyperbolic scaling…

This paper investigates almost sure exponential stabilization of continuous-time Markov jump linear systems (MJLSs) under communication data-rate constraints by introducing sampling and quantization into the feedback control. Different from…

Both stochastic and PDE modeling approaches have been used and compared in various context in biology. Typically, stochastic models are easier to parameterize, can be used to integrate underlying biological phenomena, but hard to analyze…

This paper addresses the problem of robust stabilization for linear hyperbolic Partial Differential Equations (PDEs) with Markov-jumping parameter uncertainty. We consider a 2 x 2 heterogeneous hyperbolic PDE and propose a control law using…

100 years after Smoluchowski introduces his approach to stochastic processes, they are now at the basis of mathematical and physical modeling in cellular biology: they are used for example to analyse and to extract features from large…

Continuity equations associated to continuous-time Markov processes can be considered as Euclidean Schr\"odinger equations, where the non-hermitian quantum Hamiltonian $\bold{H}={\bold{div}}{\bold J}$ is naturally factorized into the…

We propose a method for describing stationary Markov processes on the class of ultrametric spaces $\mathbb{U}$ isometrically embeddable in the field $\mathbb{Q}_{p}$ of $p$-adic numbers. This method is capable of reducing the study of such…

In this paper, we study state-feedback control of Markov jump linear systems with partial information. In particular, we assume that the controller can only access the mode signals according to a hidden-Markov observation process. Our…

We study the solution $V$ of the Poisson equation $LV + f=0$ where $L$ is the backward generator of an irreducible (finite) Markov jump process and $f$ is a given centered state function. Bounds on $V$ are obtained using a graphical…

We study a random process on R n moving in straight lines and changing randomly its velocity at random exponential times. We focus more precisely on the Kolmogorov equation in the hyperbolic scale (t, x, v) $\to$ t $\epsilon$, x $\epsilon$,…

In this paper we introduce non-decreasing jump processes with independent and time non-homogeneous increments. Although they are not L\'evy processes, they somehow generalize subordinators in the sense that their Laplace exponents are…

Extreme events are ubiquitous in a wide range of dynamical systems, including turbulent fluid flows, nonlinear waves, large scale networks and biological systems. Here, we propose a variational framework for probing conditions that trigger…

At the beginning of 1930-s A. N. Kolmogorov has published three papers on analytical methods for the probability theory. The two-page work had the essence of the approach started by A. Einstein and developed further by Fokker and Planck. He…