Related papers: Ergodic Risk Sensitive Control of Diffusions under…
The purpose of this paper is to study the time average behavior of Markov chains with transition probabilities being kernels of completely continuous operators, and therefore to provide a sufficient condition for a class of Markov chains…
In this paper, we investigate the exact controllability properties of an advection-diffusion equation on a bounded domain, using time- and space-dependent velocity fields as the control parameters. This partial differential equation (PDE)…
The paper considers an Euler discretization based numerical scheme for approximating functionals of invariant distribution of an ergodic diffusion. Convergence of the numerical scheme is shown for suitably chosen discretization step, and a…
We consider the problem of estimating the joint distribution of a continuous-time perpetuity and the underlying factors which govern the cash flow rate, in an ergodic Markov model. Two approaches are used to obtain the distribution. The…
We study the limit behaviour of a generally non-linear ordinary differential equation whose solution is a superadditive generalisation of a stochastic matrix, and provide necessary and sufficient conditions for this solution to be ergodic,…
Brownian yet non-Gaussian phenomenon has recently been observed in many biological and active matter systems. The main idea of explaining this phenomenon is to introduce a random diffusivity for particles moving in inhomogeneous…
This paper studies continuous-time Markov decision processes under the risk-sensitive average cost criterion. The state space is a finite set, the action space is a Borel space, the cost and transition rates are bounded, and the…
Ergodic coverage effectively generates exploratory behaviors for embodied agents by aligning the spatial distribution of the agent's trajectory with a target distribution, where the difference between these two distributions is measured by…
In this paper, we introduce a modification of the free boundary problem related to optimal stopping problems for diffusion processes. This modification allows the application of this PDE method in cases where the usual regularity…
We study optimal control of Markov processes with age-dependent transition rates. The control policy is chosen continuously over time based on the state of the process and its age. We study infinite horizon discounted cost and infinite…
In this paper, a general stochastic model with controls applied at the moments when the random process hits the boundary of a given subset of the state set is proposed and studied. The general concept of the model is formulated and its…
The objective of this work is to study continuous-time Markov decision processes on a general Borel state space with both impulsive and continuous controls for the infinite-time horizon discounted cost. The continuous-time controlled…
We a controlled system driven by a coupled forward-backward stochastic differential equation (FBSDE) with a non degenerate diffusion matrix. The cost functional is defined by the solution of the controlled backward stochastic differential…
Diffusion with stochastic resetting is a paradigm of resetting processes. Standard renewal or master equation approach are typically used to study steady state and other transport properties such as average, mean squared displacement etc.…
In this paper, we study optimal control problems for multiclass GI/M/n+M queues in an alternating renewal (up-down) random environment in the Halfin-Whitt regime. Assuming that the downtimes are asymptotically negligible and only the…
The long time behavior of an absorbed Markov process is well described by the limiting distribution of the process conditioned to not be killed when it is observed. Our aim is to give an approximation's method of this limit, when the…
In this paper we consider the Skorokhod embedding problem for target distributions with non-zero mean. In the zero-mean case, uniform integrability provides a natural restriction on the class of embeddings, but this is no longer suitable…
This paper is concerned with optimal control problems for systems governed by mean-field stochastic differential equation, in which the control enters both the drift and the diffusion coefficient. We prove that the relaxed state process,…
This paper is concerned with the distributed control and stabilization problems for linear discrete-time large scale systems with imposed constraints. The main contributions of this paper are: Firstly, by using the maximum principle…
Let $X$ be a one dimensional positive recurrent diffusion with initial distribution $\nu$ and invariant probability $\mu$. Suppose that for some $p> 1$, $\exists a\in\R$ such that $\forall x\in\R, \E_x T_a^p<\infty$ and $\E_\nu…