English
Related papers

Related papers: An information-spectrum approach to large deviatio…

200 papers

We establish a large-deviations principle for the largest eigenvalue of a generalized sample covariance matrix, meaning a matrix proportional to $Z^T \Gamma Z$, where $Z$ has i.i.d. real or complex entries and $\Gamma$ is not necessarily…

Probability · Mathematics 2023-02-07 Jonathan Husson , Benjamin McKenna

Random feature maps are ubiquitous in modern statistical machine learning, where they generalize random projections by means of powerful, yet often difficult to analyze nonlinear operators. In this paper, we leverage the "concentration"…

Machine Learning · Statistics 2021-03-18 Zhenyu Liao , Romain Couillet

We present a large-deviations/thermodynamic approach to the classic problem of percolation on the complete graph. Specifically, we determine the large-deviation rate function for the probability that the giant component occupies a fixed…

Probability · Mathematics 2011-11-10 Marek Biskup , Lincoln Chayes , S. Alex Smith

In this article we establish a large deviation principle for the family {\nu_{\epsilon}:\epsilon \in (0,1)} of distributions of the scaled stochastic processes {P_{-\log\sqrt{\epsilon}}Z_t}_{t\leq 1}, where (Z_t)_{t\in \lbrack 0,1]} is a…

Probability · Mathematics 2009-04-06 Z. Qian , C. Xu

Let $M_{l,n}$ be the number of blocks with frequency $l$ in the exchangeable random partition induced by a sample of size $n$ from the Ewens-Pitman sampling model. We show that, as $n$ tends to infinity, $n^{-1}M_{l,n}$ satisfies a large…

Probability · Mathematics 2014-07-01 Stefano Favaro , Shui Feng

We revisit and extend the physical interpretation recently given to a certain identity between large--deviations rate--functions (as well as applications of this identity to Information Theory), as an instance of thermal equilibrium between…

Information Theory · Computer Science 2009-08-26 Neri Merhav

This paper is concerned with a rate-distortion theory for sequences of i.i.d. random variables with general distribution supported on general sets including manifolds and fractal sets. Manifold structures are prevalent in data science,…

Information Theory · Computer Science 2018-04-25 Erwin Riegler , Günther Koliander , Helmut Bölcskei

We find large deviations rates for consensus-based distributed inference for directed networks. When the topology is deterministic, we establish the large deviations principle and find exactly the corresponding rate function, equal at all…

Information Theory · Computer Science 2016-06-29 Dragana Bajović , José M. F. Moura , João Xavier , Bruno Sinopoli

Let $\mathcal{G}(N,\frac 1Nt_N)$ be the Erd\H{o}s-R\'enyi graph with connection probability $\frac 1Nt_N\sim t/N$ as $N\to\infty$ for a fixed $t\in(0,\infty)$. We derive a large-deviations principle for the empirical measure of the sizes of…

Probability · Mathematics 2021-04-26 Luisa Andreis , Wolfgang König , Robert I. A. Patterson

This paper develops central limit theorems (CLT's) and large deviations results for additive functionals associated with reflecting diffusions in which the functional may include a term associated with the cumulative amount of boundary…

Probability · Mathematics 2014-07-10 Peter W. Glynn , Rob J. Wang

We describe large deviations for normalized multiple iterated sums and integrals of the form $\bbS_N^{(\nu)}(t)=N^{-\nu}\sum_{0\leq k_1<...<k_\nu\leq Nt}\xi(k_1)\otimes\cdots\otimes\xi(k_\nu)$, $t\in[0,T]$ and…

Probability · Mathematics 2026-04-06 Yuri Kifer , Ofer Zeitouni

An algorithm for calculating generalized fractal dimension of a time series using the general information function is presented. The algorithm is based on a strings sort technique and requires $O(N \log_2 N)$ computations. A rough estimate…

chao-dyn · Physics 2009-10-31 Yosef Ashkenazy

In this paper we address the problem of systems under an external feedback. This is performed using a large deviation approach and rate distortion from information theory. In particular we define a lower boundary for the maximum entropy…

Statistical Mechanics · Physics 2016-04-18 Alessio Gagliardi , Alessandro Pecchia , Aldo Di Carlo

The theory of stochastic approximations form the theoretical foundation for studying convergence properties of many popular recursive learning algorithms in statistics, machine learning and statistical physics. Large deviations for…

Probability · Mathematics 2025-02-05 Henrik Hult , Adam Lindhe , Pierre Nyquist , Guo-Jhen Wu

We consider a diffusion process on $\mathbb R^n$ and prove a large deviation principle for the empirical process in the joint limit in which the time window diverges and the noise vanishes. The corresponding rate function is given by the…

Probability · Mathematics 2024-12-31 Lorenzo Bertini , Davide Gabrielli , Claudio Landim

We establish a large deviation principle for time dependent trajectories (paths) of the empirical density of $N$ particles with long range interactions, for homogeneous systems. This result extends the classical kinetic theory that leads to…

Statistical Mechanics · Physics 2022-01-19 Ouassim Feliachi , Freddy Bouchet

The objective of this article is to investigate the asymptotic behavior of the persistence diagrams of a random cubical filtration as the window size tends to infinity. Here, a random cubical filtration is an increasing family of random…

Probability · Mathematics 2022-10-25 Yasuaki Hiraoka , Shu Kanazawa , Jun Miyanaga , Kenkichi Tsunoda

This paper presents a generalization for Differential and Integral Calculus. Just as the derivative is the instantaneous angular coefficient of the tangent line to a function, the generalized derivative is the instantaneous parameter value…

General Mathematics · Mathematics 2023-03-21 Fernando Marques de Almeida Nogueira

We present two examples of a large deviations principle where the rate function is not strictly convex. This is motivated by a model used in mathematical finance (the Heston model), and adds a new item to the zoology of non strictly convex…

Probability · Mathematics 2016-04-19 Stefano De Marco , Antoine Jacquier , Patrick Roome

Borgs, Chayes, Gaudio, Petti and Sen [arXiv:2007.14508] proved a large deviation principle for block model random graphs with rational block ratios. We strengthen their result by allowing any block ratios (and also establish a simpler…

Probability · Mathematics 2023-11-27 Jan Grebík , Oleg Pikhurko