相关论文: Quenched large deviation principle for words in a …

A $\delta$ once-reinforced random walk ($\delta$-ORRW) on connected graph is a self-interacting random walk which moves to its neighbors at each step according to the weights of the edges at that time, where the weights are $1$ on edges…

Large deviations principle is obtained for terminating multidimensional compound renewal processes. We also obtained the asymptotic of large deviations for the case when a Gibbs change of the original probability measure takes place. The…

In this work, we establish, for a strong Feller process, the large deviation principle for the occupation measure conditioned not to exit a given subregion. The rate function vanishes only at a unique measure, which is the so-called…

Assessing the reasoning ability of Large Language Models (LLMs) over data remains an open and pressing research question. Compared with LLMs, human reasoning can derive corresponding modifications to the output based on certain kinds of…

We consider processes with second order long range dependence resulting from heavy tailed durations. We refer to this phenomenon as duration-driven long range dependence (DDLRD), as opposed to the more widely studied linear long range…

We use large language models (LLMs) to uncover long-ranged structure in English texts from a variety of sources. The conditional entropy or code length in many cases continues to decrease with context length at least to $N\sim 10^4$…

We show existence of the weak large deviation principle, with a convex rate function, for the renormalized distance from the starting point of irreducible random walks on relatively hyperbolic groups. Under the assumption of finiteness of…

We consider a system of stochastic interacting particles in $\mathbb{R}^d$ and we describe large deviations asymptotics in a joint mean-field and small-noise limit. Precisely, a large deviations principle (LDP) is established for the…

The study of two-dimensional Coulomb gases lies at the interface of statistical physics and non-Hermitian random matrix theory. In this paper we give a large deviation principle (LDP) for the empirical fields obtained, under the canonical…

Bounds on the entropy of patterns of sequences generated by independently identically distributed (i.i.d.) sources are derived. A pattern is a sequence of indices that contains all consecutive integer indices in increasing order of first…

We study quenched distributions on random walks in a random potential on integer lattices of arbitrary dimension and with an arbitrary finite set of admissible steps. The potential can be unbounded and can depend on a few steps of the walk.…

The entropy rate of printed English is famously estimated to be about one bit per character, a benchmark that modern large language models (LLMs) have only recently approached. This entropy rate implies that English contains nearly 80…

In this article for a finite typed random geometric graph we define the empirical locality distribution, which records the number of nodes of a given type linked to a given number of nodes of each type. We find large deviation principle…

We consider a supercritical branching process $(Z_n)$ in a random environment $\xi$. Let $W$ be the limit of the normalized population size $W_n=Z_n/E[Z_n|\xi]$. We first show a necessary and sufficient condition for the quenched $L^p$…

We introduce Lookup-Table Language Models (LookupLM), a method for scaling up the size of RNN language models with only a constant increase in the floating point operations, by increasing the expressivity of the embedding table. In…

The large deviations of an infinite moving average process with exponentially light tails are very similar to those of an i.i.d. sequence as long as the coefficients decay fast enough. If they do not, the large deviations change…

We calculate the probability distributions for the number of occurrences $n$ of a given $l$ letter word in a random string of $k$ letters. Analytical expressions for the distribution are known for the asymptotic regimes (i) $k \gg r^l \gg…

We consider a run-and-tumble particle (RTP) with stochastic resetting confined to the half line $[0,\infty)$ with a sticky boundary at $x=0$. In the bulk the RTP tumbles at a constant rate $\alpha>0$ between velocity states $\pm v$ with…

This paper investigates the large deviation problem in the sample path space of the nearest-neighbor random walks on regular trees. We establish the sample path large deviation principle for the law of the distance from a nearest random…

We consider the stationary measure of the asymmetric simple exclusion process (ASEP) on a finite interval in $\mathbb{Z}$ with open boundaries. Fixing all the jump rates and letting the system size approach infinity, the height profile of…