Related papers: Feedback control: two-sided Markov-modulated Brown…
In this paper we study a reflected Markov-modulated Brownian motion with a two sided reflection in which the drift, diffusion coefficient and the two boundaries are (jointly) modulated by a finite state space irreducible continuous time…
We analyze the stationary distribution of regulated Markov modulated Brownian motions (MMBM) modified so that their evolution is slowed down when the process reaches level zero --- level zero is said to be {\em sticky}. To determine the…
We extend to Markov-modulated Brownian motion (MMBM) the renewal approach which has been successfully applied to the analysis of Markov-modulated fluid models. It has recently been shown that MMBM may be expressed as the limit of a…
We consider a Markov-modulated Brownian motion reflected to stay in a strip [0,B]. The stationary distribution of this process is known to have a simple form under some assumptions. We provide a short probabilistic argument leading to this…
Ramaswami showed recently that standard Brownian motion arises as the limit of a family of Markov-modulated linear fluid processes. We pursue this analysis with a fluid approximation for Markov-modulated Brownian motion. Furthermore, we…
We consider a class of optimal control problems, with finite or infinite horizon, for a continuous-time Markov chain with finite state space. In this case, the control process affects the transition rates. We suppose that the controlled…
We consider a gas of independent Brownian particles on a bounded interval in contact with two particle reservoirs at the endpoints. Due to the Brownian nature of the particles, infinitely many particles enter and leave the system in each…
We study a space-time Brownian motion with drift B(t)=(t_0+t,y_0+W(t)+t) killed at the moving boundary of the cone {(t,x):0<x<t}. This article determines the parabolic Martin boundary and all harmonic functions associated with this process.…
Local perturbations of a Brownian motion are considered. As a limit we obtain a non-Markov process that behaves as a reflected Brownian motion on the positive half line until its local time at zero reaches some exponential level, then…
In this work, we focus on the stationary analysis of a specific class of continuous time Markov-modulated reflected random walks in the quarter plane with applications in the modelling of two-node Markov-modulated queueing networks with…
In this paper we study the stochastic control problem of partially observed (multi-dimensional) stochastic system driven by both Brownian motions and fractional Brownian motions. In the absence of the powerful tool of Girsanov…
The trace of a Markov process is the time changed process of the original process on the support of the Revuz measure used in the time change. In this paper, we will concentrate on the reflecting Brownian motions on certain closed strips.…
Circular Dyson Brownian motion describes the Brownian dynamics of particles on a circle (periodic boundary conditions), interacting through a logarithmic, long-range two-body potential. Within the log-gas picture of random matrix theory, it…
We consider the Skorokhod problem in a time-varying interval. We prove existence and uniqueness for the solution. We also express the solution in terms of an explicit formula. Moving boundaries may generate singularities when they touch. We…
In this paper we consider the controllability of certain class of non-autonomous neutral evolution stochastic functional differential equations, with time varying delays, driven by a fractional Brownian motion in a separable real Hilbert…
Fractional Brownian motion is a Gaussian process x(t) with zero mean and two-time correlations <x(t)x(s)> ~ t^{2H} + s^{2H} - |t-s|^{2H}, where H, with 0<H<1 is called the Hurst exponent. For H = 1/2, x(t) is a Brownian motion, while for H…
We study a generalized geometric Brownian motion framework that incorporates both entries of new units and exit mechanisms for the current population, extending earlier stochastic resetting models where these rates are treated as identical.…
The authors consider stochastic aspects of the stabilization problem for two and three-dimensional Oseen equations with help of feedback control defined on a part of the fluid boundary. Stochastic issues arise when inevitable unpredictable…
For a random walk defined for a doubly infinite sequence of times, we let the time parameter itself be an integer-valued process, and call the orginal process a random walk at random time. We find the scaling limit which generalizes the…
We consider optimal stopping problems for a Brownian motion and a geometric Brownian motion with a "disorder", assuming that the moment of a disorder is uniformly distributed on a finite interval. Optimal stopping rules are found as the…