Related papers: Foundations of locally-balanced Markov processes

This work focuses on a class of regime-switching jump diffusion processes, which is a two component Markov processes $(X(t),\Lambda(t))$, where $\Lambda(t)$ is a component representing discrete events taking values in a countably infinite…

In this paper, we explore lifting Markov Decision Processes (MDPs) to the space of probability measures and consider the so-called measurized MDPs: deterministic processes where states are probability measures on the original state space,…

In recent work, Baez, Fong and the author introduced a framework for describing Markov processes equipped with a detailed balanced equilibrium as open systems of a certain type. These `open Markov processes' serve as the building blocks for…

Moderate deviation principles for empirical measure processes associated with weakly interacting Markov processes are established. Two families of models are considered: the first corresponds to a system of interacting diffusions whereas…

We consider importance sampling as well as other properly weighted samples with respect to a target distribution $\pi$ from a different point of view. By considering the associated weights as sojourn times until the next jump, we define…

Let $\Gamma$ denote the space of all locally finite subsets (configurations) in $R^d$. A stochastic dynamics of binary jumps in continuum is a Markov process on $\Gamma$ in which pairs of particles simultaneously hop over $R^d$. In this…

We analyze a specific class of random systems that are driven by a symmetric L\'{e}vy stable noise. In view of the L\'{e}vy noise sensitivity to the confining "potential landscape" where jumps take place (in other words, to environmental…

We consider Markov processes that alternate continuous motions and jumps in a general locally compact polish space. Starting from a mechanistic construction, a first contribution of this article is to provide conditions on the dynamics so…

In recent years, various interacting particle samplers have been developed to sample from complex target distributions, such as those found in Bayesian inverse problems. These samplers are motivated by the mean-field limit perspective and…

Markovian projections arise in problems where we aim to mimic the one-dimensional marginal laws of an It\^o semimartingale by using another It\^o process with Markovian dynamics. In applications, Markovian projections are useful in…

This paper studies the stochastic optimal control of jump-diffusion processes and the associated fully nonlinear backward stochastic Hamilton--Jacobi--Bellman (BSHJB) equations. We establish the dynamic programming principle (DPP) via…

We study the fluctuations of systems modeled by Markov jump processes with periodic generators. We focus on observables defined through time-periodic functions of the system's states or transitions. Using large deviation theory, canonical…

In the analysis of Markov chains and processes, it is sometimes convenient to replace an unbounded state space with a "truncated" bounded state space. When such a replacement is made, one often wants to know whether the equilibrium behavior…

In this paper we introduce non-decreasing jump processes with independent and time non-homogeneous increments. Although they are not L\'evy processes, they somehow generalize subordinators in the sense that their Laplace exponents are…

Markov jump process models have many applications across science. Often, these models are defined on a state-space of product form and only one of the components of the process is of direct interest. In this paper, we extend the marginal…

We introduce a class of continuous-state branching processes with immigration, predation and competition, which can be viewed as a combination of the classical Lotka-Volterra model and continuous-state branching processes with competition…

We consider a solution to a generic Markovian jump diffusion and show that for positive times the law of the solution process has a smooth density with respect to Lebesgue measure under a uniform version of Hoermander's conditions. Unlike…

We consider continuous-time, finite-horizon, optimal quadratic control of semi-Markov jump linear systems (S-MJLS), and develop principled approximations through Markov-like representations for the holding-time distributions. We adopt a…

We consider non-standard Markov Decision Processes (MDPs) where the target function is not only a simple expectation of the accumulated reward. Instead, we consider rather general functionals of the joint distribution of terminal state and…

We present a learning model predictive control (MPC) scheme for chance-constrained Markov jump systems with unknown switching probabilities. Using samples of the underlying Markov chain, ambiguity sets of transition probabilities are…