Related papers: Levy Approximation of Impulsive Recurrent Process …

In the continuity of a recent paper ([6]), dealing with finite Markov chains, this paper proposes and analyzes a recursive algorithm for the approximation of the quasi-stationary distribution of a general Markov chain living on a compact…

This paper analyzes reinforcement learning (RL) algorithms for Markov decision processes (MDPs) under the average-reward criterion. We focus on Q-learning algorithms based on relative value iteration (RVI), which are model-free stochastic…

The time at which a one-dimensional continuous strong Markov process attains a boundary point of its state space is a discontinuous path functional and it is, therefore, unclear whether the exit time can be approximated by hitting times of…

Substantial progress has recently been made in the understanding of the cutoff phenomenon for Markov processes, using an information-theoretic statistics known as varentropy [Sal23; Sal24; Sal25a; PS25]. In the present paper, we propose an…

This article develops general conditions for weak convergence of adaptive Markov chain Monte Carlo processes and is shown to imply a weak law of large numbers for bounded Lipschitz continuous functions. This allows an estimation theory for…

We provide necessary and sufficient conditions for convergence of exponential integrals of Markov additive processes. Other than in the classical L\'evy case studied by Erickson and Maller we have to distinguish between almost sure…

This paper introduces a periodic multivariate Poisson autoregression with potentially infinite memory, with a special focus on the network setting. Using contraction techniques, we study the stability of such a process and provide upper…

This note provides several recent progresses in the study of long time behavior of Markov processes. The examples presented below are related to other scientific fields as PDE's, physics or biology. The involved mathematical tools as…

We consider a coefficient inverse problem for the dielectric permittivity in Maxwell's equations, with data consisting of boundary measurements of one or two backscattered or transmitted waves. The problem is treated using a Lagrangian…

Conditioning Markov processes to avoid a set is a classical problem that has been studied in many settings. In the present article we study the question if a Levy process can be conditioned to avoid an interval and, if so, the path behavior…

I propose a large class of stochastic Markov processes associated with probability distributions analogous to that of lattice gauge theory with dynamical fermions. The construction incorporates the idea of approximate spectral split of the…

In this paper, we study the distributionally robust joint chance constrained Markov decision process. {Utilizing the logarithmic transformation technique,} we derive its deterministic reformulation with bi-convex terms under the…

In this paper, we are concerned with a operator splitting scheme for linear fractional and fractional degenerate stochastic conservation laws driven by multiplicative Levy noise. More specifically, using a variant of classical Kruzkov's…

A random Lie group action on a compact manifold generates a discrete time Markov process. The main object of this paper is the evaluation of associated Birkhoff sums in a regime of weak, but sufficiently effective coupling of the…

We formulate gradient-based Markov chain Monte Carlo (MCMC) sampling as optimization on the space of probability measures, with Kullback-Leibler (KL) divergence as the objective functional. We show that an underdamped form of the Langevin…

In this paper we survey and further study partial sums of a stationary process via approximation with a martingale with stationary differences. Such an approximation is useful for transferring from the martingale to the original process the…

In this paper, the three-dimensional stochastic nonhomogeneous incompressible Navier-Stokes equations driven by L\'evy process consisting of the Brownian motion, the compensated Poisson random measure and the Poisson random measure are…

Consider a Markov chain $\{X_n\}_{n\ge 0}$ with an ergodic probability measure $\pi$. Let $\Psi$ a function on the state space of the chain, with $\alpha$-tails with respect to $\pi$, $\alpha\in (0,2)$. We find sufficient conditions on the…

Parameter estimation in Markov random fields (MRFs) is a difficult task, in which inference over the network is run in the inner loop of a gradient descent procedure. Replacing exact inference with approximate methods such as loopy belief…

We present two different approaches towards the Landau-Zener problem: (i) The Markov approximation in the integro-differential equation for one of the two probability amplitudes, and (ii) an amplitude-and-phase analysis of the linear second…