Related papers: Renewal processes with costs and rewards
It is our intention to provide via fractional calculus a generalization of the pure and compound Poisson processes, which are known to play a fundamental role in renewal theory, without and with reward, respectively. We first recall the…
Non-linear renewal theory is extended to include random walks perturbed by both a slowly changing sequence and a stationary one. Main results include a version of the Key Renewal Theorem, a derivation of the limiting distribution of the…
We consider a renewal-reward process with multivariate rewards. Such a process is constructed from an i.i.d.\ sequence of time periods, to each of which there is associated a multivariate reward vector. The rewards in each time period may…
The purpose of this note is to prove the celebrated Discrete Renewal Theorem in a common special case. We use only very elementary methods from real analysis, rather than markov chain theory, complex analysis, or generating functions.…
Via a coupling argument, it is proved that the solution to a renewal equation has a power law decay rate in the case of a spread out interarrival distribution. By the regenerative property, the convergence in distribution for the recurrence…
Certain renewal theorems are extended to the case that the rate of the renewal process goes to 0 and, more generally, to the case that the drift of the random walk goes to infinity. These extensions are motivated by and applied to the…
We briefly review our recent studies on stochastic processes modelling internet on-line trading. We present a way to evaluate the average waiting time between the observation of the price in financial markets and the next price change,…
After sketching the basic principles of renewal theory we discuss the classical Poisson process and offer two other processes, namely the renewal process of Mittag-Leffler type and the renewal process of Wright type, so named by us because…
We present and establish large deviations principles for general multivariate renewal-reward processes associated with a classical discrete-time renewal process. A renewal-reward process describes a cumulative reward over time, supposing…
The versatility of renewal theory is owed to its abstract formulation. Renewals can be interpreted as steps of a random walk, switching events in two-state models, domain crossings of a random motion, etc. We here discuss a renewal process…
Renewal theorems are developed for point processes with interarrival times $W_n=\xi(X_{n+1}X_n\cdots)$, where $(X_n)_{n\in\mathbb Z}$ is a stochastic process with finite state space $\Sigma$ and $\xi\colon\Sigma_A\to\mathbb R$ is a H\"older…
We develop nonlinear renewal theorems for a perturbed random walk without assuming stochastic boundedness of centered perturbation terms. A second order expansion of the expected stopping time is obtained via the uniform integrability of…
We review the theory of regenerative processes, which are processes that can be intuitively seen as comprising of i.i.d.\ cycles. Although we focus on the classical definition, we present a more general definition that allows for some form…
We refine previous results concerning the Renewal Contact Processes. We significantly widen the family of distributions for the interarrival times for which the critical value can be shown to be strictly positive. The result now holds for…
We introduce a notion of real-valued reward testing for probabilistic processes by extending the traditional nonnegative-reward testing with negative rewards. In this richer testing framework, the may and must preorders turn out to be…
Renewal process is a point process where an inter-event time between successive renewals is an independent and identically distributed random variable. Alternating renewal process is a dichotomous process and a slight generalization of the…
We establish a sharp large deviation principle for renewal-reward processes, supposing that each renewal involves a broad-sense reward taking values in a real separable Banach space. In fact, we demonstrate a weak large deviation principle…
We study reinforcement learning (RL) for decision processes with non-Markovian reward, in which high-level knowledge of the task in the form of reward machines is available to the learner. We consider probabilistic reward machines with…
We consider a renewal process with regularly varying stationary and weakly dependent steps, and prove that the steps made before a given time $t$, satisfy an interesting invariance principle. Namely, together with the age of the renewal…
We construct a renewal structure for random walks on surface groups. The renewal times are defined as times when the random walks enters a particular type of a cone and never leaves it again. As a consequence, the trajectory of the random…