Related papers: Sample-path large deviations for unbounded additiv…

Learning a Markov Decision Process (MDP) from a fixed batch of trajectories is a non-trivial task whose outcome's quality depends on both the amount and the diversity of the sampled regions of the state-action space. Yet, many MDPs are…

We establish large deviation principles and phase transition results for both quenched and annealed settings of nearest-neighbor random walks with constant drift in random nonnegative potentials on $\mathbb Z^d$. We complement the analysis…

Real-world reinforcement learning is often \emph{nonstationary}: rewards and dynamics drift, accelerate, oscillate, and trigger abrupt switches in the optimal action. Existing theory often represents nonstationarity with coarse-scale models…

A random walk is a basic stochastic process on graphs and a key primitive in the design of distributed algorithms. One of the most important features of random walks is that, under mild conditions, they converge to a stationary distribution…

In this paper, we prove large deviation principles for the empirical measures associated with the Independent Metropolis Hastings (IMH) sampler and the Metropolis-adjusted Langevin Algorithm (MALA). These are the first large deviation…

We consider a random walk (RW) driven by a simple symmetric exclusion process (SSE). Rescaling the RW and the SSE in such a way that a joint hydrodynamic limit theorem holds we prove a joint path large deviation principle. The corresponding…

The problem of sampling a target probability distribution on a constrained domain arises in many applications including machine learning. For constrained sampling, various Langevin algorithms such as projected Langevin Monte Carlo (PLMC),…

In Markov Decision Processes (MDPs) with intermittent state information, decision-making becomes challenging due to periods of missing observations. Linear programming (LP) methods can play a crucial role in solving MDPs, in particular,…

This paper proves a large deviation principle (LDP) for the stationary distribution of queue lengths in a subcritical generalised Jackson network assuming a Cramer condition on the interarrival and service times. The deviation function is…

Random walk sampling methods have been widely used in graph sampling in recent years, while it has bias towards higher degree nodes in the sample. To overcome this deficiency, classical methods such as MHRW design weighted walking by…

Let $(g_n)_{n\geq 1}$ be a sequence of independent and identically distributed elements of the general linear group $GL(d, \mathbb R)$. Consider the random walk $G_n: = g_n \ldots g_1$. Under suitable conditions, we establish…

We consider random walk $(X_n)_{n\geq0}$ on $\mathbb{Z}^d$ in a space--time product environment $\omega\in\Omega$. We take the point of view of the particle and focus on the environment Markov chain $(T_{n,X_n}\omega)_{n\geq0}$ where $T$…

A deterministic walk in a random environment can be understood as a general random process with finite-range dependence that starts repeating a loop once it reaches a site it has visited before. Such process lacks the Markov property. We…

We establish a large deviation principle for the normalized excursion and bridge of an $\alpha$-stable L\'evy process without negative jumps, with $1<\alpha<2$. Based on this, we derive precise asymptotics for the tail distributions of…

We show a finite-time large deviation principle (LDP) for "Dyson type" diffusion processes, including Dyson Brownian motion on the circle, for a fixed number of particles as the coupling parameter $\beta=8/\kappa$ tends to $\infty$. We also…

In this paper we investigate three discrete or semi-discrete approximation schemes for reflected Brownian motion on bounded Euclidean domains. For a class of bounded domains $D$ in $\mathbb{R}^n$ that includes all bounded Lipschitz domains…

We prove existence of the large deviation principle, with a proper convex rate function, for the distribution of the renormalized distance from the origin of a random walk on a free product of finitely generated groups. As a consequence, we…

Let $A$ be a transition probability kernel on a finite state space $\Delta^o =\{1, \ldots , d\}$ such that $A(x,y)>0$ for all $x,y \in \Delta^o$. Consider a reinforced chain given as a sequence $\{X_n, \; n \in \mathbb{N}_0\}$ of…

We prove large deviation principles (LDPs) for full chordal, radial, and multichordal SLE(0+) curves parameterized by capacity. The rate function is given by the appropriate variant of the Loewner energy. There are two key novelties in the…

For a $d-$regular random model, we assign to vertices $q-$state spins. From this model, we define the \emph{empirical co-operate measure}, which enumerates the number of co-operation between a given couple of spins, and \emph{ empirical…