Related papers: Detecting the Most Probable High Dimensional Trans…
We study a continuous time stochastic optimal control problem under partial observations that are available only at discrete time instants. This hybrid setting, with continuous dynamics and intermittent noisy measurements, arises in…
We investigate the asymptotic properties of a finite-time horizon linear-quadratic optimal control problem driven by a multiscale stochastic process with multiplicative Brownian noise. We approach the problem by considering the associated…
We consider a stochastic process with long-range dependence perturbed by multiplicative noise. The marginal distributions of both the original process and the noise have regularly-varying tails, with tail indices $\alpha,\alpha'>0$,…
This work establishes two versions of the Pontryagin-type maximum principles for partially observed optimal control of coupled forward stochastic partial differential equations (FSPDEs) and backward stochastic differential equations (BSDEs)…
We propose a neural network approach to model general interaction dynamics and an adjoint based stochastic gradient descent algorithm to calibrate its parameters. The parameter calibration problem is considered as optimal control problem…
We study the Pontryagin maximum principle by deriving necessary and sufficient conditions for a class of optimal control problems arising in non exchangeable mean field systems, where agents interact through heterogeneous and asymmetric…
We address the problem of controlling a stochastic version of a Dubins vehicle such that the probability of satisfying a temporal logic specification over a set of properties at the regions in a partitioned environment is maximized. We…
A Markovian master equation describing the evolution of open quantum systems in the presence of a time-dependent external field is derived within the Bloch-Redfield formalism. It leads to a system--bath interaction which depends on the…
The main purpose of this paper is to establish the first and second order necessary optimality conditions for stochastic optimal controls using the classical variational analysis approach. The control system is governed by a stochastic…
We prove a Pontryagin Maximum Principle for optimal control problems in the space of probability measures, where the dynamics is given by a transport equation with non-local velocity. We formulate this first-order optimality condition using…
We demonstrate the possibility to systematically steer the most probable escape paths (MPEPs) by adjusting relative noise intensities in dynamical systems that exhibit noise-induced escape from a metastable point via a saddle point. Using a…
This paper investigates the optimal control problem for a class of discrete-time stochastic systems subject to additive and multiplicative noises. A stochastic Lyapunov equation and a stochastic algebra Riccati equation are established for…
A Cahn-Hilliard equation with stochastic multiplicative noise and a random convection term is considered. The model describes isothermal phase-separation occurring in a moving fluid, and accounts for the randomness appearing at the…
The most frequently used in physical application diffusive (based on the Fokker-Planck equation) model leans upon the assumption of small jumps of a macroscopic variable for each given realization of the stochastic process. This imposes…
In this paper, a model of a pair of Dubins vehicles is considered. The vehicles move from an initial position and orientation to final position and orientation. A long the motion, the two vehicles are not allowed to collide however the two…
This paper studies the stochastic optimal control problem for systems with unknown dynamics. A novel decoupled data based control (D2C) approach is proposed, which solves the problem in a decoupled "open loop-closed loop" fashion that is…
Dual control denotes a class of control problems where the parameters governing the system are imperfectly known. The challenge is to find the optimal balance between probing, i.e. exciting the system to understand it more, and caution,…
From economics point of view, we investigate a new optimal control problem driven by a stochastic differential equation with a multi-time states cost functional. By constructing a series of first-order adjoint equations, we establish the…
We consider piecewise-deterministic optimal control problems in which the environment randomly switches among several deterministic modes, and the goal is to optimize the expected cost up to the termination while taking the likelihood of…
This thesis is concerned with the stochastic filtering problem for a hidden Markov model (HMM) with the white noise observation model. For this filtering problem, we make three types of original contributions: (1) dual controllability…