Related papers: Absolutely Continuous Compensators
This paper is dedicated to the investigation of a new numerical method to approximate the optimal stopping problem for a discrete-time continuous state space Markov chain under partial observations. It is based on a two-step discretization…
In this paper, the three-dimensional stochastic nonhomogeneous incompressible Navier-Stokes equations driven by L\'evy process consisting of the Brownian motion, the compensated Poisson random measure and the Poisson random measure are…
We consider a general method for the approximation of the distribution of a process conditioned to not hit a given set. Existing methods are based on particle system that are failable, in the sense that, in many situations , they are not…
Suitable reachability conditions can make two different fixed point semantics of a transition system coincide. For instance, the total and partial expected reward semantics on Markov chains (MCs) coincide whenever the MC at hand is almost…
This article considers the average optimality for a continuous-time Markov decision process with Borel state and action spaces and an arbitrarily unbounded nonnegative cost rate. The existence of a deterministic stationary optimal policy is…
We characterize the value function and the optimal stopping time for a large class of optimal stopping problems where the underlying process to be stopped is a fairly general Markov process. The main result is inspired by recent findings…
We prove the existence and uniqueness of tempered random attractors for stochastic Reaction-Diffusion equations on unbounded domains with multiplicative noise and deterministic non-autonomous forcing. We establish the periodicity of the…
The exhaustive classification of stationary incompressible flows with constant total pressure of ideal infinitely electrically conducting fluid is given. By introduction of curvilinear coordinates based on streamlines and magnetic lines of…
We consider an infinite horizon optimal control problem for a pure jump Markov process $X$, taking values in a complete and separable metric space $I$, with noise-free partial observation. The observation process is defined as $Y_t =…
A noncommutative Fornasini-Marchesini system (a multi-variable version of a linear system) can be realized within a weak Markov process (a model for quantum evolution). For a discrete time parameter the resulting structure is worked out…
Discrete time random dynamical systems with countably many maps which admit countable Markov partitions on complete metric spaces such that the resulting Markov systems are uniform continuous and contractive are considered. A notion of a…
We consider periodic Markov chains with absorption. Applying to iterates of this periodic Markov chain criteria for the exponential convergence of conditional distributions of aperiodic absorbed Markov chains, we obtain exponential…
Noncolliding Brownian motion (Dyson's Brownian motion model with parameter $\beta=2$) and noncolliding Bessel processes are determinantal processes; that is, their space-time correlation functions are represented by determinants. Under a…
We consider the problem of estimating the transition rate matrix of a continuous-time Markov chain from a finite-duration realisation of this process. We approach this problem in an imprecise probabilistic framework, using a set of prior…
We introduce a definition of pressure for almost-additive sequences of continuous functions defined over (non-compact) countable Markov shifts. The variational principle is proved. Under certain assumptions we prove the existence of Gibbs…
Under multiplicative drift and other regularity conditions, it is established that the asymptotic variance associated with a particle filter approximation of the prediction filter is bounded uniformly in time, and the nonasymptotic,…
We consider a continuous-time model for inventory management with Markov modulated non-stationary demands. We introduce active learning by assuming that the state of the world is unobserved and must be inferred by the manager. We also…
We consider the problem of estimating the state of a continuous-time Markov chain from noisy observations. We show that the corresponding optimal filter is strictly contracting pathwise, when considered in the Hilbert projective space, and…
The existence of a global attractor is proved for the skew-product semiflow induced by almost periodic Nicholson systems and new conditions are given for the existence of a unique almost periodic positive solution which exponentially…
Our main result is the martingale representations for Markov additive processes where the modulator is a Levy process. These processes have three parts: the modulator, the jumps of the ordinate triggered by the modulator, and the…