Related papers: Conditioning two diffusion processes with respect …
The verification theorem serving as an optimality condition for the optimal control problem, has been expected and studied for a long time. The purpose of this paper is to establish this theorem for control systems governed by stochastic…
This paper deals with the unconstrained and constrained cases for continuous-time Markov decision processes under the finite-horizon expected total cost criterion. The state space is denumerable and the transition and cost rates are allowed…
We derive expressions for the first three moments of the decision time (DT) distribution produced via first threshold crossings by sample paths of a drift-diffusion equation. The "pure" and "extended" diffusion processes are widely used to…
We consider finite and infinite systems of particles on the real line and half-line evolving in continuous time. Hereby, the particles are driven by i.i.d. L\'{e}vy processes endowed with rank-dependent drift and diffusion coefficients. In…
The problem of eliminating fast-relaxing variables to obtain an effective drift-diffusion process in position is solved in a uniform and straightforward way for models with velocity a function jointly of position and fast variables. A more…
In this paper we study the randomized heat equation with homogeneous boundary conditions. The diffusion coeffcient is assumed to be a random variable and the initial condition is treated as a stochastic process. The solution of this…
We consider the problem of minimum energy steering of a linear stochastic system to a final prescribed distribution over a finite horizon and to maintain a stationary distribution over an infinite horizon. We present sufficient conditions…
We assume that we observe $N$ independent copies of a diffusion process on a time-interval $[0,2T]$. For a given time $t$, we estimate the transition density $p_t(x,y)$, namely the conditional density of $X_{t + s}$ given $X_s = x$, under…
A family of m independent identically distributed random variables indexed by a chemical potential \phi\in[0,\gamma] represents piles of particles. As \phi increases to \gamma, the mean number of particles per site converges to a maximal…
I formulate an entropy-rate maximization problem at the observable level for stochastic processes observed through an information-reducing observation map. For a visible stationary law, the map determines an observational fiber of hidden…
Consider a one dimensional diffusion process on the diffusion interval $I$ originated in $x_0\in I$. Let $a(t)$ and $b(t)$ be two continuous functions of $t$, $t>t_0$ with bounded derivatives and with $a(t)<b(t)$ and $a(t),b(t)\in I$,…
We provide simple necessary and sufficient conditions under which a path constitutes a solution to an infinite-horizon, continuous-time optimal control problem. We prove transversality conditions under standard assumptions. We also present…
We consider a process in which there are two types of particles, A and B, on an infinite one-dimensional lattice. The particles hop to their adjacent sites, like the totally asymmetric exclusion process (ASEP), and have also the following…
Evaluating the completion time of a random algorithm or a running stochastic process is a valuable tip not only from a purely theoretical, but also pragmatic point of view. In the formal sense, this kind of a task is specified in terms of…
In the paper we consider the infinite horizon control problems on the interval with free right-hand endpoint. We obtain the necessary conditions of strict optimality. The method of the proof actually follows the classic paper by Halkin, and…
Consider a system performing a continuous-time random walk on the integers, subject to catastrophes occurring at constant rate, and followed by exponentially-distributed repair times. After any repair the system starts anew from state zero.…
We consider the well-known problem of the computation of the (limiting) time-dependent performance characteristics of one-dimensional continuous-time birth and death processes on $\mathbb{Z}$ with time varying and possible state-dependent…
Noncolliding diffusion processes reported in the present paper are $N$-particle systems of diffusion processes in one-dimension, which are conditioned so that all particles start from the origin and never collide with each other in a finite…
We consider diffusion of independent molecules in an insulated Euclidean domain with unknown diffusivity parameter. At a random time and position, the molecules may bind and stop diffusing in dependence of a given `binding potential'. The…
The fast diffusion equation is analyzed on a bounded domain with Dirichlet boundary conditions, for which solutions are known to extinct in finite time. We construct invariant manifolds that provide a finite-dimensional approximation near…