English
Related papers

Related papers: Stationary, Markov, stochastic processes with poly…

200 papers

The dynamics of a point particle in a periodic array of spherical scatterers converges, in the limit of small scatterer size, to a random flight process, whose paths are piecewise linear curves generated by a Markov process with memory two.…

Mathematical Physics · Physics 2010-08-25 Jens Marklof , Andreas Strömbergsson

In a wide range of applications, the stochastic properties of the observed time series change over time. The changes often occur gradually rather than abruptly: the properties are (approximately) constant for some time and then slowly start…

Methodology · Statistics 2015-04-03 Michael Vogt , Holger Dette

We explore two notions of stationary processes. The first is called a random-step Markov process in which the stationary process of states, $(X_i)_{i \in \mathbb{Z}}$ has a stationary coupling with an independent process on the positive…

Probability · Mathematics 2014-10-07 Neal Bushaw , Karen Gunderson , Steven Kalikow

We consider the problem of approximating the stationary distribution of an ergodic Markov chain given a set of sampled transitions. Classical simulation-based approaches assume access to the underlying process so that trajectories of…

Machine Learning · Computer Science 2020-03-03 Junfeng Wen , Bo Dai , Lihong Li , Dale Schuurmans

We derive a necessary and sufficient condition for stochastic processes to have almost periodic finite dimensional distributions; in particular, we obtain characterizations for infinitely divisible processes to be almost periodic in terms…

Probability · Mathematics 2022-08-18 David Berger , Farid Mohamed

In this work, we focus on the stationary analysis of a specific class of continuous time Markov-modulated reflected random walks in the quarter plane with applications in the modelling of two-node Markov-modulated queueing networks with…

Probability · Mathematics 2020-06-02 Ioannis Dimitriou

We address the problem of Lyapunov function construction for a class of continuous-time Markov chains with affine transition rates, typically encountered in stochastic chemical kinetics. Following an optimization approach, we take advantage…

Probability · Mathematics 2014-12-30 Andreas Milias-Argeitis , Mustafa Khammash

We analyze certain stationary fields with linear regressions and quadratic conditional variances. This classic probabilistic problem leads somewhat unexpectedly to stationary Markov processes closely tied to non-commutative probability…

Probability · Mathematics 2007-05-23 Wlodzimierz Bryc

We study the stochastic motion of active particles that undergo spontaneous transitions between two distinct modes of motion. Each mode is characterized by a velocity distribution and an arbitrary (anti-)persistence. We present an…

Statistical Mechanics · Physics 2023-07-07 M. Reza Shaebani , Heiko Rieger , Zeinab Sadjadi

We observe a length-$n$ sample generated by an unknown,stationary ergodic Markov process (\emph{model}) over a finite alphabet $\mathcal{A}$. Given any string $\bf{w}$ of symbols from $\mathcal{A}$ we want estimates of the conditional…

Information Theory · Computer Science 2014-06-11 Meysam Asadi , Ramezan Paravi Torghabeh , Narayana P. Santhanam

For each $\lambda>0$ and every square-integrable infinitely-divisible (ID) distribution there exists at least one stationary stochastic process $t\mapsto X_t$ with the specified distribution for $X_1$ and with first-order autoregressive…

Probability · Mathematics 2021-06-02 Robert L Wolpert

We consider a stochastic process which is (a) described by a continuous-time Markov chain on only short time-scales and (b) constrained to conserve a number of hidden quantities on long time-scales. We assume that the transition matrix of…

Statistical Mechanics · Physics 2020-10-27 Vitaly Vanchurin

The parameters of a discrete stationary Markov model are transition probabilities between states. Traditionally, data consist in sequences of observed states for a given number of individuals over the whole observation period. In such a…

Computation · Statistics 2012-04-30 Alberto Pasanisi , Shuai Fu , Nicolas Bousquet

This paper deals with the question of conditional sampling and prediction for the class of stationary max-stable processes which allow for a mixed moving maxima representation. We develop an exact procedure for conditional sampling using…

Probability · Mathematics 2014-03-25 Marco Oesting , Martin Schlather

We consider a general honest homogeneous continuous-time Markov process with restarts. The process is forced to restart from a given distribution at time moments generated by an independent Poisson process. The motivation to study such…

Probability · Mathematics 2012-06-26 Konstantin Avrachenkov , Alexei Piunovskiy , Zhang Yi

In this paper, we study Ornstein-Uhlenbeck processes with Markov modulation, whose parameters depend on an external underlying two-state Markov process. Conditional mean and variance of such processes under given modulation are investigated…

Probability · Mathematics 2021-03-11 Nikita Ratanov

We consider a simple discrete-time Markov chain with values in $[0,\infty)^{Z^d}$. The Markov chain describes various interesting examples such as oriented percolation, directed polymers in random environment, time discretizations of binary…

Probability · Mathematics 2009-06-26 Nobuo Yoshida

The Ornstein-Uhlenbeck process can be seen as a paradigm of a finite-variance and statistically stationary rough random walk. Furthermore, it is defined as the unique solution of a Markovian stochastic dynamics and shares the same local…

Probability · Mathematics 2021-10-05 Laurent Chevillard , Marc Lagoin , Stephane G. Roux

This paper is concerned with the development of rigorous approximations to various expectations associated with Markov chains and processes having non-stationary transition probabilities. Such non-stationary models arise naturally in…

Probability · Mathematics 2018-05-07 Zeyu Zheng , Harsha Honnappa , Peter W. Glynn

We study the persistence probability for processes with stationary increments. Our results apply to a number of examples: sums of stationary correlated random variables whose scaling limit is fractional Brownian motion, random walks in…

Probability · Mathematics 2019-05-01 Frank Aurzada , Nadine Guillotin-Plantard , Françoise Pène