English
Related papers

Related papers: Functional central limit theorems for Markov-modul…

200 papers

In this paper, we investigate the concentration properties of cumulative reward in Markov Decision Processes (MDPs), focusing on both asymptotic and non-asymptotic settings. We introduce a unified approach to characterize reward…

Machine Learning · Computer Science 2025-12-04 Borna Sayedana , Peter E. Caines , Aditya Mahajan

The problem of stochastic deadline scheduling is considered. A constrained Markov decision process model is introduced in which jobs arrive randomly at a service center with stochastic job sizes, rewards, and completion deadlines. The…

Optimization and Control · Mathematics 2017-07-10 Zhe Yu , Yunjian Xu , Lang Tong

In this paper we consider the statistics of repeated measurements on the output of a quantum Markov chain. We establish a large deviations result analogous to Sanov's theorem for the empirical measure associated to finite sequences of…

Quantum Physics · Physics 2015-06-22 Merlijn van Horssen , Madalin Guta

We present normal approximation results at the process level for local functionals defined on dynamic Poisson processes in $\mathbb{R}^d$. The dynamics we study here are those of a Markov birth-death process. We prove functional limit…

Probability · Mathematics 2022-10-25 Efe Onaran , Omer Bobrowski , Robert J. Adler

This article considers multivariate linear processes whose components are either short- or long-range dependent. The functional central limit theorems for the sample mean and the sample autocovariances for these processes are investigated,…

Probability · Mathematics 2020-02-13 Marie-Christine Düker

We prove a law of large numbers and a functional central limit theorem for the empirical density of a Marcus-Lushnikov model. The limiting density turns out to be the solution of a Smoluchowski equation, and the fluctuations around this…

Probability · Mathematics 2026-03-30 Julian Amorim , Arturo Arellano , Milton Jara

In this study, we consider multi-class multi-server asymmetric queueing systems consisting of $N$ queues on one side and $K$ servers on the other side, where jobs randomly arrive in queues at each time. The service rate of each job-server…

Machine Learning · Statistics 2025-05-07 Jung-hun Kim , Min-hwan Oh

We prove a functional central limit theorem for integrals $\int_W f(X(t))\, dt$, where $(X(t))_{t\in\mathbb{R}^d}$ is a stationary mixing random field and the stochastic process is indexed by the function $f$, as the integration domain $W$…

Probability · Mathematics 2015-12-14 Jürgen Kampf , Evgeny Spodarev

There is a widespread recent interest in using ideas from statistical physics to model certain types of problems in economics and finance. The main idea is to derive the macroscopic behavior of the market from the random local interactions…

Probability · Mathematics 2020-10-15 Daniel Remenik

We introduce a new basic model for independent and identical distributed sequence on the canonical space $(\mathbb{R}^\mathbb{N},\mathcal{B}(\mathbb{R}^\mathbb{N}))$ via probability kernels with model uncertainty. Thanks to the well-defined…

Probability · Mathematics 2022-03-02 Xinpeng Li

We consider many-server queueing systems with heterogeneous exponential servers and renewal arrivals. The service rate of each server is a random variable drawn from a given distribution. We develop a framework for analyzing the heavy…

Probability · Mathematics 2019-05-13 Burak Büke , Wenyi Qin

We consider the Bouchaud trap model on the integers in the case that the trap distribution has a slowly varying tail at infinity. Our main result is a functional limit theorem for the model under the annealed law, analogous to the…

Probability · Mathematics 2016-04-21 David Croydon , Stephen Muirhead

We investigate the properties of multifractal products of geometric Gaussian processes with possible long-range dependence and geometric Ornstein-Uhlenbeck processes driven by L\'{e}vy motion and their finite and infinite superpositions. We…

Probability · Mathematics 2015-05-12 Denis Denisov , Nikolai Leonenko

The approximation of integral type functionals is studied for discrete observations of a continuous It\^o semimartingale. Based on novel approximations in the Fourier domain, central limit theorems are proved for $L^2$-Sobolev functions…

Probability · Mathematics 2022-11-08 Randolf Altmeyer

In this paper, we focus on studying central limit theorems for functionals of some specific stationary random processes. In classical probability theory, it is well-known that for non-linear functionals of stationary Gaussian sequences, we…

Probability · Mathematics 2017-12-12 Zhichao Wang

The main objective of this article is to establish a central limit theorem for additive three-variable functionals of bifurcating Markov chains. We thus extend the central limit theorem under point-wise ergodic conditions studied in…

Probability · Mathematics 2022-07-04 S. Valère Bitseki Penda

In this paper, we study large multi-server loss models under power-of-$d$ routing scheme when service time distributions are general with finite mean. Previous works have addressed the exponential service time case when the number of…

Performance · Computer Science 2017-08-31 Thirupathaiah Vasantam , Arpan Mukhopadhyay , Ravi R Mazumdar

In the present work we derive a Central Limit Theorem for sequences of Hilbert-valued Piecewise Deterministic Markov process models and their global fluctuations around their deterministic limit identified by the Law of Large Numbers. We…

Probability · Mathematics 2013-04-23 Martin G Riedler , Michele Thieullen

We consider the processor sharing $M/M/1$-PS queue which also models balking. A customer that arrives and sees $n$ others in the system "balks" (i.e., decides not to enter) with probability $1-b_n$. If $b_n$ is inversely proportional to…

Probability · Mathematics 2011-04-26 Qiang Zhen , Johan S. H. van Leeuwaarden , Charles Knessl

We establish central limit theorems for a large class of supercritical branching Markov processes in infinite dimension with spatially dependent and non-necessarily local branching mechanisms. This result relies on a fourth moment…

Probability · Mathematics 2025-01-31 Bertrand Cloez , Nicolás Zalduendo