Related papers: Diffusion Approximations for Controlled Weakly Int…
This paper studies the approximation of optimal control policies by quantized (discretized) policies for a very general class of Markov decision processes (MDPs). The problem is motivated by applications in networked control systems,…
We prove the existence of weak solutions of a class of multi-species cross-diffusion systems as well as the propagation of chaos result by means of nonlocal approximation of the nonlinear diffusion terms, coupling methods and compactness…
This paper investigates a class of optimal control problems associated with Markov processes with local state information. The decision-maker has only local access to a subset of a state vector information as often encountered in…
This paper studies the diffusion limit for a network of infinite-server queues operating under Markov modulation (meaning that the system's parameters depend on an autonomously evolving background process). In previous papers on (primarily…
We consider the optimal stopping of a class of spectrally negative jump diffusions. We state a set of conditions under which the value is shown to have a representation in terms of an ordinary nonlinear programming problem. We establish a…
Motivated by several applications, including neuronal models, we consider the McKean-Vlasov limit for mean-field systems of interacting diffusions with simultaneous jumps. We prove propagation of chaos via a coupling technique that involves…
Timeout control is a simple mechanism used when direct feedback is either impossible, unreliable, or too costly, as is often the case in distributed systems. Its effectiveness is determined by a timeout threshold parameter and our goal is…
There has long been interest to control the transfer of population between specified quantum states. Recent work has optimized the control law for closed system population transfer by using a gradient ascent pulse engineer- ing algorithm…
We study a microscopic limit order book model, in which the order dynamics depend on the current best bid and ask price and the current volume density functions, simultaneously, and derive its macroscopic high-frequency dynamics. As opposed…
We investigate the convergence to (quasi--)equilibrium of a density dependent Markov chain in~${\mathbb Z}^d$, whose drift satisfies a system of ordinary differential equations having an attractive fixed point. For a sequence of such…
We consider a system of $N$ interacting particles, described by SDEs driven by Poisson random measures, where the coefficients depend on the empirical measure of the system. Every particle jumps with a jump rate depending on its position.…
Switching dynamical systems provide a powerful, interpretable modeling framework for inference in time-series data in, e.g., the natural sciences or engineering applications. Since many areas, such as biology or discrete-event systems, are…
We study the controllability of a coupled system of linear parabolic equations, with non-negativity constraint on the state. We establish two results of controllability to trajectories in large time: one for diagonal diffusion matrices with…
In this paper we study model reduction of linear and bilinear quadratic stochastic control problems with parameter uncertainties. Specifically, we consider slow-fast systems with unknown diffusion coefficient and study the convergence of…
The diffusion of finite-size hard-core interacting particles in two- or three-dimensional confined domains is considered in the limit that the confinement dimensions become comparable to the particle's dimensions. The result is a nonlinear…
We study reaction-diffusion systems where diffusion is by jumps whose sizes are distributed exponentially. We first study the Fisher-like problem of propagation of a front into an unstable state, as typified by the A+B $\to$ 2A reaction. We…
In this paper, we study the diffusion approximation for singularly perturbed stochastic reaction-diffusion equation with a fast oscillating term. The asymptotic limit for the original system is obtained, where an extra Gaussian term…
This paper investigates state feedback control laws for Markov jump linear systems with state and mode-observation delays. An assumption in this study is that the delay of mode observation obeys an exponential distribution. Also, we raise…
Moderate deviation principles for empirical measure processes associated with weakly interacting Markov processes are established. Two families of models are considered: the first corresponds to a system of interacting diffusions whereas…
We combine conditional state density construction with an extension of the Scenario Approach for stochastic Model Predictive Control to nonlinear systems to yield a novel particle-based formulation of stochastic nonlinear output-feedback…