Related papers: On the Poisson equation for nonreversible Markov j…
In this paper, we solve exit problems for a L\'evy process that resets proportionally to its current position at independent Poisson epochs times. This resetting causes an additional (proportional to its current level) downward (upward)…
The theory of nonlinear response for Markov processes obeying a master equation is formulated in terms of time-dependent perturbation theory for the Green's functions and general expressions for the response functions up to third order in…
The production of molecules in a chemical reaction network is modelled as a Poisson process with a Markov-modulated arrival rate and an exponential decay rate. We analyze the distributional properties of $M$, the number of molecules, under…
We present a statistical physics framework for description of nonlinear non-equilibrium stochastic processes, modeled via chemical master equation, in the weak-noise limit. Using the Poisson representation approach and applying the…
We introduce and study renewal processes defined by means of extensions of the standard relaxation equation through ``stretched" non-local operators (of order $\alpha$ and with parameter $\gamma$). In a first case we obtain a generalization…
We study a family of memory-based persistent random walks and we prove weak convergences after space-time rescaling. The limit processes are not only Brownian motions with drift. We have obtained a continuous but non-Markov process $(Z_t)$…
We study finite horizon optimal switching problems for hidden Markov chain models under partially observable Poisson processes. The controller possesses a finite range of strategies and attempts to track the state of the unobserved state…
The aim of this paper is to prove stability of traveling waves for integro-differential equations connected with branching Markov processes. In other words, the limiting law of the left-most particle of a (time-continuous) branching Markov…
In this paper we prove the Poisson Hypothesis for the limiting behavior of the large queueing systems in some simple ("mean-field") cases. We show in particular that the corresponding dynamical systems, defined by the non-linear Markov…
We study the nonparametric estimation of the jump density of a compound Poisson process from the discrete observation of one trajectory over $[0,T]$. We consider the microscopic regime when the sampling rate $\Delta=\Delta_T\rightarrow0$ as…
In this paper we consider the problem of parameter inference for Markov jump process (MJP) representations of stochastic kinetic models. Since transition probabilities are intractable for most processes of interest yet forward simulation is…
We compute the stationary distribution of a continuous-time Markov chain which is constructed by gluing together two finite, irreducible Markov chains by identifying a pair of states of one chain with a pair of states of the other and…
Systems out of equilibrium, in stationary as well as in nonstationary regimes, display a linear response to energy impulses simply expressed as the sum of two specific temporal correlation functions. There is a natural interpretation of…
In the context of nonparametric Bayesian estimation a Markov chain Monte Carlo algorithm is devised and implemented to sample from the posterior distribution of the drift function of a continuously or discretely observed one-dimensional…
We consider a stochastic process driven by a diffusion and jumps. We devise a technique, which is based on a discrete record of observations, for identifying the times when jumps larger than a suitably defined threshold occurred. The…
This paper considers differential problems with random switching, with specific applications to the motion of cells and centrally coordinated motion. Starting with a differential-equation model of cell motion that was proposed previously,…
Through a Metropolis-like algorithm with single step computational cost of order one, we build a Markov chain that relaxes to the canonical Fermi statistics for k non-interacting particles among m energy levels. Uniformly over the…
We study Poisson's equation in the context of general state space Markov chains. For chains satisfying a contraction assumption w.r.t. a Wasserstein distance, we show that a solution exists for Lipschitz functions and investigate its…
In this paper we discuss weak convergence of continuous-time Markov chains to a non-symmetric pure jump process. We approach this problem using Dirichlet forms as well as semimartingales. As an application, we discuss how to approximate a…
For a given Markov process $X$ and survival function $\overline{H}$ on $\mathbb{R}^+$, the inverse first-passage time problem (IFPT) is to find a barrier function $b:\mathbb{R}^+\to[-\infty,+\infty]$ such that the survival function of the…