English
Related papers

Related papers: Sharp variance-entropy comparison for nonnegative …

200 papers

This paper proposes a novel approach to the statistical characterization of non-central complex Gaussian quadratic forms (CGQFs). Its key strategy is the generation of an auxiliary random variable (RV) that converges in distribution to the…

Information Theory · Computer Science 2018-06-18 Pablo Ramírez-Espinosa , Laureano Moreno-Pozas , José F. Paris , José A. Cortés , Eduardo Martos-Naya

We obtain non-asymptotic Gaussian concentration bounds for the difference between the invariant measure $\nu$ of an ergodic Brownian diffusion process and the empirical distribution of an approximating scheme with decreasing time step along…

Probability · Mathematics 2018-05-28 Igor Honoré , Stephane Menozzi , Gilles Pagès

Testing independence is of significant interest in many important areas of large-scale inference. Using extreme-value form statistics to test against sparse alternatives and using quadratic form statistics to test against dense alternatives…

Statistics Theory · Mathematics 2015-12-31 Danning Li , Lingzhou Xue

This paper studies the problem of estimating the differential entropy $h(S+Z)$, where $S$ and $Z$ are independent $d$-dimensional random variables with $Z\sim\mathcal{N}(0,\sigma^2 \mathrm{I}_d)$. The distribution of $S$ is unknown, but $n$…

Statistics Theory · Mathematics 2019-06-04 Ziv Goldfeld , Kristjan Greenewald , Yury Polyanskiy

Let $\{\xi_n, n\in\Z^d\}$ be a $d$-dimensional array of i.i.d. Gaussian random variables and define $\SSS(A)=\sum_{n\in A} \xi_n$, where $A$ is a finite subset of $\Z^d$. We prove that the appropriately normalized maximum of…

Probability · Mathematics 2010-07-05 Zakhar Kabluchko

In this short note we prove a maximal concentration lemma for sub-Gaussian random variables stating that for independent sub-Gaussian random variables we have \[P<(\max_{1\le i\le N}S_{i}>\epsilon>)…

Machine Learning · Computer Science 2011-07-26 Dotan Di Castro , Claudio Gentile , Shie Mannor

This note investigates invariance principles for sums of N(nt) iid radom variables, where n is an integer, t is a positive real number and N(u) is a stochastic process with nonnegative integer values. We show that the sequence of sums of…

Probability · Mathematics 2016-10-11 Gane Samb Lo

In this work, we give efficient algorithms for privately estimating a Gaussian distribution in both pure and approximate differential privacy (DP) models with optimal dependence on the dimension in the sample complexity. In the pure DP…

Data Structures and Algorithms · Computer Science 2023-06-02 Daniel Alabi , Pravesh K. Kothari , Pranay Tankala , Prayaag Venkat , Fred Zhang

We study non-stationary averaging processes, where each term of a sequence is a weighted average of previous terms, namely $a_{n+1} = \sum_{j=1}^n p_n(j) a_j$. Our results extend classical theory in two distinct regimes. First, we prove a…

Probability · Mathematics 2026-03-18 Saba Lepsveridze , Elchanan Mossel

We consider the problem of learning a target probability distribution over a set of $N$ binary variables from the knowledge of the expectation values (with this target distribution) of $M$ observables, drawn uniformly at random. The space…

Statistical Mechanics · Physics 2015-09-02 Tomoyuki Obuchi , Simona Cocco , Rémi Monasson

We study the maximum achievable differential entropy at the output of a system assigning to each input X the sum X+N, with N a given noise with probability law absolutely continuous with respect to the Lebesgue measure and where the input…

Optimization and Control · Mathematics 2016-02-04 Francisco J. Piera

We derive, in more general conditions, a recently introduced variance sum rule (VSR) [I. Di Terlizzi et al., 2024 Science 383 971] involving variances of displacement and force impulse for overdamped Langevin systems in a nonequilibrium…

Statistical Mechanics · Physics 2024-08-06 Ivan Di Terlizzi , Marco Baiesi , Felix Ritort

The capacity of additive Gaussian noise (AGN) channels, $Y_t=X_t+V_t, t=1, \ldots, n$, $\frac{1}{n} {\bf E}\big\{\sum_{t=1}^n |X_t|^2 \big\}\leq \kappa, \kappa \in [0,\infty)$, with time-invariant channel input feedback strategies, is…

Information Theory · Computer Science 2021-08-16 Charalambos D. Charalambous , Christos Kourtellaris , Sergey Loyka

Gamma distributions, which contain the exponential as a special case, have a distinguished place in the representation of near-Poisson randomness for statistical processes; typically, they represent distributions of spacings between events…

Mathematical Physics · Physics 2009-05-22 C. T. J. Dodson

For a sample of absolutely bounded i.i.d. random variables with a continuous density the cumulative distribution function of the sample variance is represented by a univariate integral over a Fourier series. If the density is a polynomial…

Statistics Theory · Mathematics 2008-10-10 T. Royen

We use gauge-gravity duality to compute entanglement entropy in a non-conformal background with an energy scale $\Lambda$. At zero temperature, we observe that entanglement entropy decreases by raising $\Lambda$. However, at finite…

High Energy Physics - Theory · Physics 2017-08-02 M. Rahimi , M. Ali-Akbari , M. Lezgi

The conditional mean is a fundamental and important quantity whose applications include the theories of estimation and rate-distortion. It is also notoriously difficult to work with. This paper establishes novel bounds on the differential…

Information Theory · Computer Science 2022-11-23 Arda Atalik , Alper Köse , Michael Gastpar

We establish that a non-Gaussian nonparametric regression model is asymptotically equivalent to a regression model with Gaussian noise. The approximation is in the sense of Le Cam's deficiency distance $\Delta $; the models are then…

Statistics Theory · Mathematics 2024-12-20 Ion Grama , Michael Nussbaum

Consider two independent Erd\H{o}s-R\'enyi $G(N,1/2)$ graphs. We show that with probability tending to $1$ as $N\to\infty$, the largest induced isomorphic subgraph has size either $\lfloor x_N-\varepsilon_N\rfloor$ or $\lfloor…

Combinatorics · Mathematics 2023-01-02 Sourav Chatterjee , Persi Diaconis

For studies in reliability, biometry, and survival analysis, the length-biased distribution is often well-suited for certain natural sampling plans. In this paper, we study the strong uniform consistency of two nonparametric estimators for…

Methodology · Statistics 2025-09-22 Vaishnavi Pavithradas , Rajesh G
‹ Prev 1 3 4 5 6 7 10 Next ›