Related papers: Finite / Countable State Space Stochastic Processe…
Doubly-stochastic point processes model the occurrence of events over a spatial domain as an inhomogeneous Poisson process conditioned on the realization of a random intensity function. They are flexible tools for capturing spatial…
Whenever eye movements are measured, a central part of the analysis has to do with where subjects fixate, and why they fixated where they fixated. To a first approximation, a set of fixations can be viewed as a set of points in space: this…
Stochastic models for performance analysis, optimization and control of queues hinge on a multitude of alternatives for input point processes. In case of bursty traffic, one very popular model is the \textit{Markov Modulated Poisson…
Understanding temporal processes and their correlations in time is of paramount importance for the development of near-term technologies that operate under realistic conditions. Capturing the complete multi-time statistics defining a…
The effect of a stochastic displacement field on a statistically independent point process is analyzed. Stochastic displacement fields can be divided into two large classes: spatially correlated and uncorrelated. For both cases exact…
Time-dependent correlation functions of (unstable) particles undergoing biased or unbiased diffusion, coagulation and annihilation are calculated. This is achieved by similarity transformations between different stochastic models and…
In this paper analogically as quadratic stochastic operators and processes we define cubic stochastic operator (CSO) and cubic stochastic processes (CSP). These are defined on the set of all probability measures of a measurable space. The…
This is survey of some recent results connecting random matrices, non-colliding processes and queues.
The notion of stability can be generalised to point processes by defining the scaling operation in a randomised way: scaling a configuration by $t$ corresponds to letting such a configuration evolve according to a Markov branching particle…
The aim of this paper is to present an elementary computable theory of probability, random variables and stochastic processes. The probability theory is baed on existing approaches using valuations and lower integrals. Various approaches to…
We study conditional independence under infinite measures on punctured product spaces, a notion recently introduced for graphical modeling in multivariate extremes and L\'evy processes. In contrast to classical probabilistic conditional…
We consider stochastic processes arising from dynamical systems simply by evaluating an observable function along the orbits of the system and study marked point processes associated to extremal observations of such time series…
Lecture notes for a master-level applied mathematics course on stochastic processes and applications, held at the University of Orl\'eans, France. Contents: Markov chains, Poisson point processes, Markovian jump processes, queueing theory.…
Randomly scaled scale-decorated Poisson point process is introduced recently in Bhattacharya et al. [2017] where it appeared as weak limit of a sequence of point processes in the context of branching random walk. In this article, we obtain…
In this work, we study dynamic programming (DP) algorithms for partially observable Markov decision processes with jointly continuous and discrete state-spaces. We consider a class of stochastic systems which have coupled discrete and…
Using the age-structure formalism, we definitely establish connections between semi-Markov processes and the dynamics of open quantum systems that satisfy the Markov quantum master equations. A generalized Feynman-Kac formula of the…
This work explores a synchronization-like phenomenon induced by common noise for continuous-time Markov jump processes given by chemical reaction networks. A corresponding random dynamical system is formulated in a two-step procedure, at…
In this brief note, we investigate some constructions of Lyapunov functions for stochastic discrete-time stabilizable dynamical systems, in other words, controlled Markov chains. The main question here is whether a Lyapunov function in some…
We consider Markov processes, which describe e.g. queueing network processes, in a random environment which influences the network by determining random breakdown of nodes, and the necessity of repair thereafter. Starting from an explicit…
Stochastic models of point patterns in space and time are widely used to issue forecasts or assess risk, and often they affect societally relevant decisions. We adapt the concept of consistent scoring functions and proper scoring rules,…