Related papers: Stationary, Markov, stochastic processes with poly…
In this paper we focus on the pathwise stability of mild solutions for a class of stochastic partial differential equations which are driven by switching-diffusion processes with jumps. In comparison to the existing literature, we show…
Motivated by the modeling of the temporal structure of the velocity field in a highly turbulent flow, we propose and study a linear stochastic differential equation that involves the ingredients of a Ornstein-Uhlenbeck process, supplemented…
This paper is about the existence and regularity of the transition probability matrix of a nonhomogeneous continuous-time Markov process with a countable state space. A standard approach to prove the existence of such a transition matrix is…
We consider the time dependent probability distribution of a coarse grained observable Y whose evolution is governed by a discrete time map. If the map is mixing, the time dependent one-step transition probabilities converge in the long…
Empirical processes for stationary, causal sequences are considered. We establish empirical central limit theorems for classes of indicators of left half lines, absolutely continuous functions and piecewise differentiable functions. Sample…
In this paper, we present a numerical framework for constructing bounds on stationary performance measures of random walks in the positive orthant using the Markov reward approach. These bounds are established in terms of stationary…
Markov processes are used in a wide range of disciplines, including finance. The transition densities of these processes are often unknown. However, the conditional characteristic functions are more likely to be available, especially for…
For a Markov and stationary stochastic process described by the well-known classical master equation, we introduce complex transition rates instead of real transition rates to study the pre-thermal oscillatory behaviour in complex…
We study the large deviations of additive quantities, such as energy or current, in stochastic processes with intermittent reset. Via a mapping from a discrete-time reset process to the Poland-Scheraga model for DNA denaturation, we derive…
The evolution of a continuous time Markov process with a finite number of states is usually calculated by the Master equation - a linear differential equations with a singular generator matrix. We derive a general method for reducing the…
A new sufficient condition is proved for the existence of stochastic semigroups generated by the sum of two unbounded operators. It is applied to one-dimensional piecewise deterministic Markov processes, where we also discuss the existence…
We study a class of Markov processes with finite state space and continuous time that have product form stationary distributions. We obtain a number of examples that can generate conjectures for diffusions with inert drift.
We discuss various properties of Probabilistic Cellular Automata, such as the structure of the set of stationary measures and multiplicity of stationary measures (or phase transition) for reversible models.
This paper is devoted to parameter estimation for partially observed polynomial state space models. This class includes discretely observed affine or more generally polynomial Markov processes. The polynomial structure allows for the…
The discrete class algorithm presented in this paper is an efficient simulation tool for stochastic processes governed by a reasonably small set of transition rates. The algorithm is presented, its performance compared to prevailing methods…
This paper provides conditions under which a non-stationary copula-based Markov process is $\beta$-mixing. We introduce, as a particular case, a convolution-based gaussian Markov process which generalizes the standard random walk allowing…
Switching ARMA models greatly enhance the standard linear models to the extent that different ARMA model is allowed in a different regime, and the regime switching is typically assumed a Markov chain on the finite states of potential…
This paper is devoted to studying the average optimality in continuous-time Markov decision processes with fairly general state and action spaces. The criterion to be maximized is expected average rewards. The transition rates of underlying…
We investigate the large population dynamics of a family of stochastic particle systems with three-state cyclic individual behaviour and parameter-dependent transition rates. On short time scales, the dynamics turns out to be approximated…
We study the dynamics of condensation for a stochastic continuous mass transport process defined on a one-dimensional lattice. Specifically we introduce three different variations of the truncated random average process. We generalize…