English
Related papers

Related papers: Large Deviations and Information theory for Sub-Cr…

200 papers

We investigate possible large deviation principles (LDPs) for the $n$-vertex sampling from a given graphon with various speeds $s(n)$ and resolve all the cases except when the speed $s(n)$ is of order $n^2$. For quadratic speed…

Probability · Mathematics 2025-04-29 Jan Grebík , Oleg Pikhurko

Data-parallel (DP) training with synchronous all-reduce is a dominant paradigm for full-parameter fine-tuning of large language models (LLMs). While parameter synchronization guarantees numerical equivalence of model weights after each…

Machine Learning · Computer Science 2026-02-25 Hong Li , Zhen Zhou , Honggang Zhang , Yuping Luo , Xinyue Wang , Han Gong , Zhiyuan Liu

We obtain the large deviation functional of a density profile for the asymmetric exclusion process of L sites with open boundary conditions when the asymmetry scales like 1/L. We recover as limiting cases the expressions derived recently…

Statistical Mechanics · Physics 2015-06-24 B. Derrida , C. Enaud

This work focuses on the downlink and uplink of large-scale single-cell MU-MIMO systems in which the base station (BS) endowed with $M$ antennas communicates with $K$ single-antenna user equipments (UEs). Particularly, we aim at reducing…

Information Theory · Computer Science 2017-04-05 Houssem Sifaou , Abla Kammoun , Luca Sanguinetti , Mérouane Debbah , Mohamed-Slim Alouini

In this paper we study the Large Deviation Principle (LDP in abbreviation) for a class of Stochastic Partial Differential Equations (SPDEs) in the whole space $\mathbb{R}^d$, with arbitrary dimension $d\geq 1$, under random influence which…

Probability · Mathematics 2015-05-20 Tarik El Mellali , Mohamed Mellouk

In this paper we address the problem of systems under an external feedback. This is performed using a large deviation approach and rate distortion from information theory. In particular we define a lower boundary for the maximum entropy…

Statistical Mechanics · Physics 2016-04-18 Alessio Gagliardi , Alessandro Pecchia , Aldo Di Carlo

This paper addresses an interference channel consisting of $\mathbf{n}$ active users sharing $u$ frequency sub-bands. Users are asynchronous meaning there exists a mutual delay between their transmitted codes. A stationary model for…

Information Theory · Computer Science 2010-06-17 Kamyar Moshksar , Amir K. Khandani

The purpose of this paper is to ensure the conditions of G\"artner-Ellis Theorem for evaluations of the empirical measure. We show that up-to-date conditions for ensuring the convergence to a quasi-stationary distribution can be applied…

Probability · Mathematics 2020-04-21 Aurélien Velleret

We study asymptotic performance of distributed detection in large scale connected sensor networks. Contrasting to the canonical parallel network where a single node has access to local decisions from all other nodes, each node can only…

Information Theory · Computer Science 2018-10-16 Shengyu Zhu , Biao Chen

In the performance analyses of wireless networks, asymptotic quantities and properties often pro- vide useful results and insights. The asymptotic analyses become especially important when complete analytical expressions of the performance…

Information Theory · Computer Science 2016-11-16 Anjin Guo , Martin Haenggi , Radha Krishna Ganti

We relate the large time asymptotics of the energy statistics in open harmonic networks to the variance-gamma distribution and prove a full Large Deviation Principle. We consider both Hamiltonian and stochastic dynamics, the later case…

Mathematical Physics · Physics 2017-08-02 Tristan Benoist , Vojkan Jakšić , Claude-Alain Pillet

We prove large deviation principles (LDP) for the invariant measures of the multiclass totally asymmetric simple exclusion process (TASEP) and the multiclass Hammersely-Aldous-Diaconis (HAD) process on a torus. The proof is based on a…

Probability · Mathematics 2008-01-29 Davide Gabrielli

Moderate deviation principles for empirical measure processes associated with weakly interacting Markov processes are established. Two families of models are considered: the first corresponds to a system of interacting diffusions whereas…

Probability · Mathematics 2015-10-09 Amarjit Budhiraja , Ruoyu Wu

In this paper, we are concerned with SIR epidemics in a random environment on complete graphs, where every edges are assigned with i.i.d. weights. Our main results give large and moderate deviation principles of sample paths of this model.

Probability · Mathematics 2020-01-22 Xiaofeng Xue , Yumeng Shen

In cyber-physical systems such as automobiles, measurement data from sensor nodes should be delivered to other consumer nodes such as actuators in a regular fashion. But, in practical systems over unreliable media such as wireless, it is a…

Networking and Internet Architecture · Computer Science 2015-04-14 Xueying Guo , Rahul Singh , P. R. Kumar , Zhisheng Niu

We initiate a study of large deviations for block model random graphs in the dense regime. Following Chatterjee-Varadhan(2011), we establish an LDP for dense block models, viewed as random graphons. As an application of our result, we study…

Probability · Mathematics 2025-09-17 Christian Borgs , Jennifer Chayes , Julia Gaudio , Samantha Petti , Subhabrata Sen

Asymptotic expressions of the mutual information between any discrete input and the corresponding output of the scalar additive white Gaussian noise channel are presented in the limit as the signal-to-noise ratio (SNR) tends to infinity.…

Information Theory · Computer Science 2014-04-23 Alex Alvarado , Fredrik Brannstrom , Erik Agrell , Tobias Koch

Graph theory provides a powerful framework to investigate brain functional connectivity networks and their modular organization. However, most graph-based methods suffer from a fundamental resolution limit that may have affected previous…

Neurons and Cognition · Quantitative Biology 2016-09-15 Carlo Nicolini , Cécile Bordier , Angelo Bifone

Local differential privacy~(LDP) is an information-theoretic privacy definition suitable for statistical surveys that involve an untrusted data curator. An LDP version of quasi-maximum likelihood estimator~(QMLE) has been developed, but the…

Machine Learning · Statistics 2022-02-16 Hajime Ono , Kazuhiro Minami , Hideitsu Hino

The density weighted average derivative (DWAD) of a regression function is a canonical parameter of interest in economics. Classical first-order large sample distribution theory for kernel-based DWAD estimators relies on tuning parameter…

Econometrics · Economics 2024-02-16 Matias D. Cattaneo , Max H. Farrell , Michael Jansson , Ricardo Masini