Related papers: On the asymptotic of exit problems for controlled …
We study the infinite-horizon average (ergodic) risk sensitive control problem for diffusion processes under a general structural hypothesis: there is a partition of state space into two subsets, where the controlled diffusion process…
This paper studies the asymptotic behavior of processes with switching. More precisely, the stability under fast switching for diffusion processes and discrete state space Markovian processes is considered. The proofs are based on…
The problem of noise-induced escape from a metastable state arises in physics, chemistry, biology, systems engineering, and other areas. The problem is well understood when the underlying dynamics of the system obey detailed balance. When…
We develop the first exact Bayesian methodology for the problem of inference in discretely observed regime switching diffusions. Switching diffusion models extend ordinary diffusions by allowing for jumps in instantaneous drift and…
In this paper we consider a control problem for a Partially Observable Piecewise Deterministic Markov Process of the following type: After the jump of the process the controller receives a noisy signal about the state and the aim is to…
The problem of sums of independent, identically distributed random variables with stretched-exponential tails exhibits a dynamical phase transition and has recently reemerged in the context of active transport and condensation phenomena. We…
An inductive procedure is developed to calculate the asymptotic behavior at time zero of a diffusion with polynomial drift and degenerate, additive noise. The procedure gives rise to two different rescalings of the process; namely, a…
In computational system biology, the mesoscopic model of reaction-diffusion kinetics is described by a continuous time, discrete space Markov process. To simulate diffusion stochastically, the jump coefficients are obtained by a…
In this paper, we study small noise asymptotics of Markov-modulated diffusion processes in the regime that the modulating Markov chain is rapidly switching. We prove the joint sample-path large deviations principle for the Markov-modulated…
Dunkl processes are multidimensional Markov processes defined through the use of Dunkl operators. These processes have discontinuities, and they can be separated into their continuous (radial) part, and their discontinuous (jump) part.…
We present discrete-time approximation of optimal control policies for infinite horizon discounted/ergodic control problems for controlled diffusions in $\Rd$\,. In particular, our objective is to show near optimality of optimal policies…
This article studies the dynamics of a nonlinear dissipative reaction-diffusion equation with well-separated stable states which is perturbed by infinite-dimensional multiplicative L\'evy noise with a regularly varying component at…
In this brief paper, we consider the problem of minimizing the asymptotic exit rate of diffusion processes from an open connected bounded set pertaining to a multi-channel system with small random perturbations. Specifically, we establish a…
Continuous time random walks (CTRWs) are versatile models for anomalous diffusion processes that have found widespread application in the quantitative sciences. Their scaling limits are typically non-Markovian, and the computation of their…
Physical notions of stochastic resonance for potential diffusions in periodically changing double-well potentials such as the spectral power amplification have proved to be defective. They are not robust for the passage to their effective…
This article gives an overview of the developments in controlled diffusion processes, emphasizing key results regarding existence of optimal controls and their characterization via dynamic programming for a variety of cost criteria and…
We consider two reflecting diffusion processes $(X_t)_{t \ge 0}$ with a moving reflection boundary given by a non-decreasing pure jump Markov process $(R_t)_{t \ge 0}$. Between the jumps of the reflection boundary the diffusion part behaves…
The objective of this work is to study continuous-time Markov decision processes on a general Borel state space with both impulsive and continuous controls for the infinite-time horizon discounted cost. The continuous-time controlled…
In this paper, we consider the gradual-impulse control problem of continuous-time Markov decision processes, where the system performance is measured by the expectation of the exponential utility of the total cost. We prove, under very…
We study the asymptotic position distribution of general quantum walks on a lattice, including walks with a random coin, which is chosen from step to step by a general Markov chain. In the unitary (i.e., non-random) case, we allow any…