Related papers: Quasistationary Distributions and Ergodic Control …
In this article we consider the ergodic risk-sensitive control problem for a large class of multidimensional controlled diffusions on the whole space. We study the minimization and maximization problems under either a blanket stability…
Out-of-equilibrium quasistationary states (QSSs) are one of the signatures of a broken ergodicity in long-range interacting systems. For the widely studied Hamiltonian Mean-Field model, the lifetime of some QSSs has been shown to diverge…
In this article we study ergodic problems in the whole space $\mathbb{R}^N$ for weakly coupled systems of viscous Hamilton-Jacobi equations with coercive right-hand sides. The Hamiltonians are assumed to have a fairly general structure and…
In this paper we introduce a new kind of Backward Stochastic Differential Equations, called ergodic BSDEs, which arise naturally in the study of optimal ergodic control. We study the existence, uniqueness and regularity of solution to…
In this paper, we study quasi-ergodicity for one-dimensional diffusion $X$ killed at 0, when 0 is an exit boundary and $+\infty$ is an entrance boundary. Using the spectral theory tool, we show that if the killed semigroup is intrinsically…
AM/M/N+Mqueueingnetworkisconsideredwithdindependentcustomerclasses and d server pools in Halfin-Whitt regime. Class i customers has priority for service in pool i for i = 1, . . . , d, and may access some other pool if the pool has an idle…
This work addresses the optimal covariance control problem for stochastic discrete-time linear time-varying systems subject to chance constraints. Covariance steering is a stochastic control problem to steer the system state Gaussian…
In this paper, we study ergodic backward stochastic differential equations (EBSDEs for short), for which the underlying diffusion is assumed to be multiplicative and of at most linear growth. The fact that the forward process has an…
We introduce the notion of a quasistatic dynamical system, which generalizes that of an ordinary dynamical system. Quasistatic dynamical systems are inspired by the namesake processes in thermodynamics, which are idealized processes where…
In this paper, we study an optimal control problem for a coupled non-linear system of reaction-diffusion equations with degenerate diffusion, consisting of two partial differential equations representing the density of cells and the…
In this paper we study stochastic optimal control problems of general fully coupled forward-backward stochastic differential equations (FBSDEs). In Li and Wei [8] the authors studied two cases of diffusion coefficients $\sigma$ of FSDEs, in…
In this paper, we develop a theoretical framework for nonlinear stochastic optimal control problems with optimal stopping by establishing a density-based deterministic representation of the underlying diffusion. For state-independent…
This paper develops a quantized Q-learning algorithm for the optimal control of controlled diffusion processes on $\mathbb{R}^d$ under both discounted and ergodic (average) cost criteria. We first establish near-optimality of finite-state…
We present a formulation of an optimal control problem for a two-dimensional diffusion process governed by a Fokker-Planck equation to achieve a nonequilibrium steady state with a desired circulation while accelerating convergence toward…
Dynamic phenomena in social and biological sciences can often be modeled by employing reaction-diffusion equations. When addressing the control of these modes, from a mathematical viewpoint one of the main challenges is that, because of the…
The present paper is devoted to the study of the asymptotic behavior of the value functions of both finite and infinite horizon stochastic control problems and to the investigation of their relation with suitable stochastic ergodic control…
This paper studies computational methods for quasi-stationary distributions (QSDs). We first proposed a data-driven solver that solves Fokker-Planck equations for QSDs. Similar as the case of Fokker-Planck equations for invariant…
Quasi-stationary distributions, as discussed by Darroch & Seneta (1965), have been used in biology to describe the steady state behaviour of population models which, while eventually certain to become extinct, nevertheless maintain an…
In this paper we consider non convex control problems of stochastic differential equations driven by relaxed controls. We present existence of optimal controls and then develop necessary conditions of optimality. We cover both continuous…
In a mean field game of controls, players seek to minimize a cost that depends on the joint distribution of players' states and controls. We consider an ergodic problem for second-order mean field games of controls with state constraints,…