English
Related papers

Related papers: Finite / Countable State Space Stochastic Processe…

200 papers

An analogue of the classical Mecke formula for Poisson point processes is proved for the class of space-time STIT tessellation processes. From this key identity the Markov property of a class of associated random processes is derived. This…

Probability · Mathematics 2017-11-06 Werner Nagel , Linh Ngoc Nguyen , Christoph Thaele , Viola Weiss

We propose a new definition of metastability of Markov processes on countable state spaces. We obtain sufficient conditions for a sequence of processes to be metastable. In the reversible case these conditions are expressed in terms of the…

Probability · Mathematics 2015-05-14 Johel Beltrán , Claudio Landim

We give general sufficient conditions to prove the convergence of marked point processes that keep record of the occurrence of rare events and of their impact for non-autonomous dynamical systems. We apply the results to sequential…

Dynamical Systems · Mathematics 2019-04-12 Ana Cristina Moreira Freitas , Jorge Milhazes Freitas , Mário Magalhães , Sandro Vaienti

The marked Hawkes risk process is a compound point process for which the occurrence and amplitude of past events impact the future. Thanks to its autoregressive properties, it found applications in various fields such as neuosciences,…

Probability · Mathematics 2024-09-11 Laure Coutin , Mahmoud Khabou

With the increasing ubiquity of safety-critical autonomous systems operating in uncertain environments, there is a need for mathematical methods for formal verification of stochastic models. Towards formally verifying properties of…

Systems and Control · Electrical Eng. & Systems 2026-02-18 Adrien Banse , Giannis Delimpaltadakis , Luca Laurenti , Manuel Mazo , Raphaël M. Jungers

We review some recent results on connections between Brownian motion, Whittaker functions, random matrices and representation theory.

Probability · Mathematics 2012-10-26 Neil O'Connell

The time evolution of the one-point probability vector of stochastic processes and quantum processes for $N$-level systems have been unified. Hence, quantum states and quantum operations can be regarded as generalizations of the one-point…

Quantum Physics · Physics 2026-02-03 Bilal Canturk

Semi-Markov processes are Markovian processes in which the firing time of the transitions is modelled by probabilistic distributions over positive reals interpreted as the probability of firing a transition at a certain moment in time. In…

Formal Languages and Automata Theory · Computer Science 2017-12-04 Mathias Ruggaard Pedersen , Nathanaël Fijalkow , Giorgio Bacci , Kim Guldstrand Larsen , Radu Mardare

The continuous-time random walk is defined as a Poissonization of discrete-time random walk. We study the noncolliding system of continuous-time simple and symmetric random walks on ${\mathbb{Z}}$. We show that the system is determinantal…

Probability · Mathematics 2014-09-30 Syota Esaki

We consider a class of stochastic dynamical systems, called piecewise deterministic Markov processes, with states $(x, \s)\in \O\times \G$, $\O$ being a region in $\bbR^d$ or the $d$--dimensional torus, $\G$ being a finite set. The…

Statistical Mechanics · Physics 2009-02-25 Alessandra Faggionato , Davide Gabrielli , Marco Ribezzi Crivellari

Continuous Time Markov Chains, Hawkes processes and many other interesting processes can be described as solution of stochastic differential equations driven by Poisson measures. Previous works, using the Stein's method, give the…

Probability · Mathematics 2026-04-02 Eustache Besançon , Laure Coutin , Laurent Decreusefond , Pascal Moyal

We show that quantum dynamical systems can exhibit infinite correlations in their behavior when repeatedly measured. We model quantum processes using quantum finite-state generators and take the stochastic language they generate as a…

Quantum Physics · Physics 2007-05-23 Karoline Wiesner , James P. Crutchfield

Determinantal point processes are models for regular spatial point patterns, with appealing probabilistic properties. We present their spatio-temporal counterparts and give examples of these models, based on spatio-temporal covariance…

Statistics Theory · Mathematics 2023-01-09 Nafiseh Vafaei , Mohammad Ghorbani , Masoud Ganji , Mari Myllymäki

A q-generalization of the product densities in stochastic point processes is developed. The properties of these functions are studied and a q-generalization of the usual $C^r_s$ coefficients is obtained. This for fixed q-number of particles…

Mathematical Physics · Physics 2007-05-23 R. Parthasarathy , R. Sridhar

We characterize synchronization phenomenon in discrete-time, discrete-state random dynamical systems, with random and probabilistic Boolean networks as particular examples. In terms of multiplicative ergodic properties of the induced linear…

Dynamical Systems · Mathematics 2020-09-09 Wen Huang , Hong Qian , Shirou Wang , Felix X. -F. Ye , Yingfei Yi

Stochastic processes find applications in modelling systems in a variety of disciplines. A large number of stochastic models considered are Markovian in nature. It is often observed that higher order Markov processes can model the data…

Probability · Mathematics 2021-04-13 Suryadeepto Nag

Consider an N-dimensional Markov chain obtained from N one-dimensional random walks by Doob h-transform with the q-Vandermonde determinant. We prove that as N becomes large, these Markov chains converge to an infinite-dimensional Feller…

Probability · Mathematics 2014-10-03 Alexei Borodin , Vadim Gorin

For a countable-state Markov decision process we introduce an embedding which produces a finite-state Markov decision process. The finite-state embedded process has the same optimal cost, and moreover, it has the same dynamics as the…

Probability · Mathematics 2007-11-15 Arie Leizarowitz , Adam Shwartz

We consider a new class of non Markovian processes with a countable number of interacting components. At each time unit, each component can take two values, indicating if it has a spike or not at this precise moment. The system evolves as…

Probability · Mathematics 2015-06-12 Antonio Galves , Eva Löcherbach

This is a survey of results about permanental processes, real valued positive processes which are a generalization of squares of Gaussian processes. In a certain sense the symmetric positive definite function that determines a Gaussian…

Probability · Mathematics 2010-08-23 Hana Kogan , Michael B. Marcus , Jay Rosen