Related papers: Ergodic Risk-Sensitive Control for Regime-Switchin…
In this work, we investigate the optimal control problem for continuous-time Markov decision processes with the random impact of the environment. We provide conditions to show the existence of optimal controls under finite-horizon criteria.…
In this paper, we consider a discrete-time Markov Decision Process (MDP) on a finite state-action space with a long-run risk-sensitive criterion used as the objective function. We discuss the concept of Blackwell optimality and comment on…
This paper investigates the stochastic linear quadratic (LQ, for short) optimal control problem of Markov regime switching system. The representation of the cost functional for the stochastic LQ optimal control problem of Markov regime…
Let Y be an Ornstein-Uhlenbeck diffusion governed by a stationary and ergodic Markov jump process X: dY_t=a(X_t)Y_t dt+\sigma(X_t) dW_t, Y_0=y_0. Ergodicity conditions for Y have been obtained. Here we investigate the tail propriety of the…
This paper investigates the near optimal control for a kind of linear stochastic control systems governed by the forward backward stochastic differential equations, where both the drift and diffusion terms are allowed to depend on controls…
The global estimation problem of the drift function is considered for a large class of ergodic diffusion processes. The unknown drift $S(\cdot)$ is supposed to belong to a nonparametric class of smooth functions of order $k\geq1$, but the…
This paper considers the problem of stabilizing a discrete-time non-linear stochastic system over a finite capacity noiseless channel. Our focus is on systems which decompose into a stable and unstable component, and the stability notion…
In the first part of this work, we analyzed a Dirichlet boundary control problem for an elliptic convection diffusion PDE and proposed a new hybridizable discontinuous Galerkin (HDG) method to approximate the solution. For the case of a 2D…
We study the limit behaviour of a generally non-linear ordinary differential equation whose solution is a superadditive generalisation of a stochastic matrix, and provide necessary and sufficient conditions for this solution to be ergodic,…
Consider a stochastic process $\{X(t)\}$ on a finite state space $ {\sf X}=\{1,\dots, d\}$. It is conditionally Markov, given a real-valued `input process' $\{\zeta(t)\}$. This is assumed to be small, which is modeled through the scaling,…
Motivated by the possibility of electrochemical control of phase separation, a variational theory of thermodynamic stability is developed for driven reactive mixtures, based on a nonlinear generalization of the Cahn-Hilliard and Allen-Cahn…
This paper is devoted to solving a time-inconsistent risk-sensitive control problem with parameter $\e$ and its limit case ($\e\rightarrow0^+$) for countable-stated Markov decision processes (MDPs for short). Since the cost functional is…
This work addresses a switching control problem under which the cost associated with the changes of regimes is allowed to have discontinuities in time. Our main contribution is to show several characterizations of the optimal cost function…
We study small perturbations of diffusion processes in $\mathbb{R}^d$ that leave invariant a finite collection of hypersurfaces. Each surface is assumed to be repelling for the unperturbed process, and the unperturbed motion on each of the…
In this paper, we consider the adaptive linear quadratic Gaussian control problem, where both the linear transformation matrix of the state $A$ and the control gain matrix $B$ are unknown. The proposed adaptive optimal control only assumes…
In the past the study of reaction-diffusion systems has greatly contributed to our understanding of the behavior of many-body systems far from equilibrium. In this paper we aim at characterizing the properties of diffusion limited reactions…
A novel probabilistic framework for modelling anomalous diffusion is presented. The resulting process is Markovian, non-homogeneous, non-stationary, non-ergodic, and state-dependent. The fundamental law governing this process is driven by…
Dynamic phenomena in social and biological sciences can often be modeled by employing reaction-diffusion equations. When addressing the control of these modes, from a mathematical viewpoint one of the main challenges is that, because of the…
We address the variational formulation of the risk-sensitive reward problem for non-degenerate diffusions on $\mathbb{R}^d$ controlled through the drift. We establish a variational formula on the whole space and also show that the…
We provide a large deviations analysis of deadlock phenomena occurring in distributed systems sharing common resources. In our model transition probabilities of resource allocation and deallocation are time and space dependent. The process…