Related papers: Processes of rth Largest

This paper is devoted to the problem of sample path large deviations for the Markov processes on R_+^N having a constant but different transition mechanism on each boundary set {x:x_i=0 for i\notin\Lambda, x_i>0 for i\in\Lambda}. The global…

Consider an N-dimensional Markov chain obtained from N one-dimensional random walks by Doob h-transform with the q-Vandermonde determinant. We prove that as N becomes large, these Markov chains converge to an infinite-dimensional Feller…

We examine the asymptotic behaviour of the sample autocovariance in a continuous-time moving average model with long-range dependence. We show that it is either asymptotically Rosenblatt distributed or stable distributed. This shows that…

The right tail asymptotic series consisting of attenuating exponential terms are derived for the densities of Galton-Watson processes with fractional probability generating functions. The frequencies in the exponential factors form fractal…

The interrelationships of the fundamental biological processes natural selection, mutation, and stochastic drift are quantified by the entropy rate of Moran processes with mutation, measuring the long-run variation of a Markov process. The…

We prove a large deviation principle on path space for a class of discrete time Markov processes whose state space is the intersection of a regular domain $\L\subset \R^d$ with some lattice of spacing $\e$. Transitions from $x$ to $y$ are…

We consider a finite collection of reinforced stochastic processes with a general network-based interaction among them. We provide sufficient and necessary conditions in order to have some form of almost sure asymptotic synchronization,…

We study the random acceleration model, which is perhaps one of the simplest, yet nontrivial, non-Markov stochastic processes, and is key to many applications. For this non-Markov process, we present exact analytical results for the…

The curse of dimensionality is a widely known issue in reinforcement learning (RL). In the tabular setting where the state space $\mathcal{S}$ and the action space $\mathcal{A}$ are both finite, to obtain a nearly optimal policy with…

In this paper we study a representation problem first considered in a simpler version by Bank and El Karoui [2004]. A key ingredient to this problem is a random measure $\mu$ on the time axis which in the present paper is allowed to have…

We consider random processes that are history-dependent, in the sense that the distribution of the next step of the process at any time depends upon the entire past history of the process. In general, therefore, the Markov property cannot…

We study asymptotic behaviour of stochastic approximation procedures with three main characteristics: truncations with random moving bounds, a matrix valued random step-size sequence, and a dynamically changing random regression function.…

We consider a branching Markov process in continuous time in which the particles evolve independently as spectrally negative L\'evy processes. When the branching mechanism is critical or subcritical, the process will eventually die and we…

The asymptotic shape theorem for the contact process in random environment gives the existence of a norm $\mu$ on $\Rd$ such that the hitting time $t(x)$ is asymptotically equivalent to $\mu(x)$ when the contact process survives. We provide…

Distributional identities for a L\'evy process $X_t$, its quadratic variation process $V_t$ and its maximal jump processes, are derived, and used to make "small time" (as $t\downarrow0$) asymptotic comparisons between them. The…

Suppose $(f,\mathcal{X},\mu)$ is a measure preserving dynamical system and $\phi \colon \mathcal{X} \to \mathbb{R}$ a measurable function. Consider the maximum process $M_n:=\max\{X_1 \ldots,X_n\}$, where $X_i=\phi\circ f^{i-1}$ is a time…

We consider a type of random processes which satisfies the conditional increment condition and obtain an estimate for the tail probability and a Doob-type inequality of the maximum of the process. The main result is that, for processes…

We study properties of a piecewise deterministic Markov process modeling the changes in concentration of specific antibodies. The evolution of densities of the process is described by a stochastic semigroup. The long-time behaviour of this…

Representations of branching Markov processes and their measure-valued limits in terms of countable systems of particles are constructed for models with spatially varying birth and death rates. Each particle has a location and a "level,"…

A Markov Additive Process is a bi-variate Markov process $(\xi,J)=\big((\xi_t,J_t),t\geq0\big)$ which should be thought of as a multi-type L\'evy process: the second component $J$ is a Markov chain on a finite space $\{1,\ldots,K\}$, and…