Related papers: Singular Control of (Reflected) Brownian Motion: A…
We identify an issue in recent approaches to learning-based control that reformulate systems with uncertain dynamics using a stochastic differential equation. Specifically, we discuss the approximation that replaces a model with fixed but…
Schr\"{o}dinger bridge is a stochastic optimal control problem to steer a given initial state density to another, subject to controlled diffusion and deadline constraints. A popular method to numerically solve the Schr\"{o}dinger bridge…
This paper develops a generalization of Brownian motion with stationary, autocorrelated increments as a tractable model for problems in business and finance. We show that any real continuous Gaussian Markov process with stationary…
A model of Brownian particles with the ability to take up energy from the environment, to store it in an internal depot, and to convert internal energy into kinetic energy of motion, is discussed. The general dynamics outlined in Sect. 2 is…
This work contributes a systematic survey and complementary insights of reflecting Brownian motion and its properties. Extension of the Skorohod problem's solution to more general cases is investigated, based on which a discussion is…
A finite horizon linear quadratic(LQ) optimal control problem is studied for a class of discrete-time linear fractional systems (LFSs) affected by multiplicative, independent random perturbations. Based on the dynamic programming technique,…
We study a signature-driven numerical scheme to solve multi-dimensional linear-quadratic (LQ) stochastic control problems. Using that linear signature functionals are dense in the natural class of admissible controls, we show that our…
We present a novel control variate technique for enhancing the efficiency of Monte Carlo (MC) estimation of expectations involving solutions to stochastic differential equations (SDEs). Our method integrates a primary fine-time-step…
In this paper we study a reflected Markov-modulated Brownian motion with a two sided reflection in which the drift, diffusion coefficient and the two boundaries are (jointly) modulated by a finite state space irreducible continuous time…
This paper studies a class of non$-$Markovian singular stochastic control problems, for which we provide a novel probabilistic representation. The solution of such control problem is proved to identify with the solution of a $Z-$constrained…
It is well-known that Brownian ratchets can exhibit current reversals, wherein the sign of the current switches as a function of the driving frequency. We introduce a spatial discretization of such a two-dimensional Brownian ratchet to…
In this work, we study the control constrained distributed optimal control of a stationary doubly diffusive flow model. For the control problem, we use a well-posedness analysis based on minimal assumptions on data and domain. We show the…
We provide a probabilistic solution of a not necessarily Markovian control problem with a state constraint by means of a Backward Stochastic Differential Equation (BSDE). The novelty of our solution approach is that the BSDE possesses a…
We propose new copulae to model the dependence between two Brownian motions and to control the distribution of their difference. Our approach is based on the copula between the Brownian motion and its reflection. We show that the class of…
Inverse problems in scientific computing often require optimization over infinite-dimensional Hilbert spaces. A commonly used solver in such settings is stochastic gradient descent (SGD), where gradients are approximated using randomly…
In this paper, we study the stochastic optimal control problem for control system with time-varying delay. The corresponding stochastic differential equation is a kind of stochastic differential delay equation. We prove the existence and…
A singular stochastic control problem with state constraints in two-dimensions is studied. We show that the value function is $C^1$ and its directional derivatives are the value functions of certain optimal stopping problems. Guided by the…
This paper is concerned with the problem of Model Predictive Control and Rolling Horizon Control of discrete-time systems subject to possibly unbounded random noise inputs, while satisfying hard bounds on the control inputs. We use a…
This work considers the problem of approximating initial condition and time-dependent optimal control and trajectory surfaces using multivariable Fourier series. A modified Augmented Lagrangian algorithm for translating the optimal control…
We consider the Stochastic Differential Equation $X_t = X_0 + \int_0^t b(s,X_s) ds + B_t$, in $\mathbb{R}^d$. We give an example of a drift $b$ such that there does not exist a weak solution, but there exists a solution for almost every…