Related papers: Sequential tracking of an unobservable two-state M…
This paper considers the problem of partially observed optimal control for forward stochastic systems which are driven by Brownian motions and an independent Poisson random measure with a feature that the cost functional is of mean-field…
We consider an infinite horizon optimal control problem for a continuous-time Markov chain $X$ in a finite set $I$ with noise-free partial observation. The observation process is defined as $Y_t = h(X_t)$, $t \geq 0$, where $h$ is a given…
IIn this paper, we study a partially observed progressive optimal control problem of forward-backward stochastic differential equations with random jumps, where the control domain is not necessarily convex, and the control variable enter…
We consider a singular control problem that aims to maximize the expected cumulative rewards, where the instantaneous returns depend on the state of a controlled process. The contributions of this paper are twofold. Firstly, to establish…
Motivated by wide-ranging applications such as video delivery over networks using Multiple Description Codes, congestion control, and inventory management, we study the state-tracking of a Markovian random process with a known transition…
We study the problem of parametric estimation for continuously observed stochastic processes driven by additive small fractional Brownian motion with Hurst index 0<H<1/2 and 1/2<H<1. Under some assumptions on the drift coefficient, we…
Brownian motion whose infinitesimal variance changes according to a three-state continuous time Markov Chain is studied. This Markov Chain can be viewed as a telegraph process with one on state and two off states. We first derive the…
This paper studies a problem of Bayesian parameter estimation for a sequence of scaled counting processes whose weak limit is a Brownian motion with an unknown drift. The main result of the paper is that the limit of the posterior…
The problem of detection and possible estimation of a signal generated by a dynamic system when a variable number of noisy measurements can be taken is here considered. Assuming a Markov evolution of the system (in particular, the pair…
Consider the motion of a Brownian particle in three dimensions, whose two spatial coordinates are standard Brownian motions with zero drift, and the remaining (unknown) spatial coordinate is a standard Brownian motion with a non-zero drift.…
We consider a problem of stochastic optimal control with separable drift uncertainty in strong formulation on a finite horizon. The drift coefficient of the state $Y^{u}$ is multiplicatively influenced by an unknown random variable…
We solve an optimal stopping problem where the underlying diffusion is Brownian motion on $\bf R$ with a positive drift changing at zero. It is assumed that the drift $\mu_1$ on the negative side is smaller than the drift $\mu_2$ on the…
We study the maximum of a Brownian motion with a parabolic drift; this is a random variable that often occurs as a limit of the maximum of discrete processes whose expectations have a maximum at an interior point. We give series expansions…
We consider optimal stopping problems for a Brownian motion and a geometric Brownian motion with a "disorder", assuming that the moment of a disorder is uniformly distributed on a finite interval. Optimal stopping rules are found as the…
In this article, we present a general methodology for stochastic control problems driven by the Brownian motion filtration including non-Markovian and non-semimartingale state processes controlled by mutually singular measures. The main…
In this paper, we consider stochastic optimal control of Markov Jump Linear Systems with state feedback but without observation of the jumping parameter. The proposed control law is assumed to be linear with constant gains that can be…
We construct a stochastic process whose drift is a function of the process's local time at a reflecting barrier. The process arose as a model of the interactions of a Brownian particle and an inert particle in (Knight, 2001). Interesting…
We study a finite-dimensional continuous-time optimal control problem on finite horizon for a controlled diffusion driven by Brownian motion, in the linear-quadratic case. We admit stochastic coefficients, possibly depending on an…
We consider the maximum process of a random walk with additive independent noise in form of $\max_{i=1,\dots,n}(S_i+Y_i)$. The random walk may have dependent increments, but its sample path is assumed to converge weakly to a fractional…
In this paper, we study a class of stochastic optimal control problem with jumps under partial information. More precisely, the controlled systems are described by a fully coupled nonlinear multi- dimensional forward-backward stochastic…