English
Related papers

Related papers: Remarks on the Most Informative Function Conjectur…

200 papers

This paper quantifies the intuitive observation that adding noise reduces available information by means of non-linear strong data processing inequalities. Consider the random variables $W\to X\to Y$ forming a Markov chain, where $Y=X+Z$…

Information Theory · Computer Science 2017-11-21 Flavio P. Calmon , Yury Polyanskiy , Yihong Wu

Maximum subarray is a classical problem in computer science that given an array of numbers aims to find a contiguous subarray with the largest sum. We focus on its use for a noisy statistical problem of localizing an interval with a mean…

Methodology · Statistics 2023-10-24 Dennis Wei , Dmitry M. Malioutov

While the linear Pearson correlation coefficient represents a well-established normalized measure to quantify the interrelation of two stochastic variables $X$ and $Y$, it fails for multidimensional variables such as Cartesian coordinates.…

Data Analysis, Statistics and Probability · Physics 2024-09-19 Daniel Nagel , Georg Diez , Gerhard Stock

We formulate and analyze the compound information bottleneck programming. In this problem, a Markov chain $ \mathsf{X} \rightarrow \mathsf{Y} \rightarrow \mathsf{Z} $ is assumed with fixed marginal distributions $\mathsf{P}_{\mathsf{X}}$…

Information Theory · Computer Science 2022-05-11 Michael Dikshtein , Nir Weinberger , Shlomo Shamai

This paper provides a unified framework for analyzing tensor estimation problems that allow for nonlinear observations, heteroskedastic noise, and covariate information. We study a general class of high-dimensional models where each…

Information Theory · Computer Science 2025-06-10 Riccardo Rossetti , Galen Reeves

Given a pair of random variables $(X,Y)\sim P_{XY}$ and two convex functions $f_1$ and $f_2$, we introduce two bottleneck functionals as the lower and upper boundaries of the two-dimensional convex set that consists of the pairs…

Information Theory · Computer Science 2018-11-16 Hsiang Hsu , Shahab Asoodeh , Salman Salamatian , Flavio P. Calmon

Provable lower bounds are presented for the information rate I(X; X+S+N) where X is the symbol drawn from a fixed, finite-size alphabet, S a discrete-valued random variable (RV) and N a Gaussian RV. The information rate I(X; X+S+N) serves…

Information Theory · Computer Science 2011-10-04 Seongwook Jeong , Jaekyun Moon

Let $\mu_1 \ge \dotsc \ge \mu_n > 0$ and $\mu_1 + \dotsm + \mu_n = 1$. Let $X_1, \dotsc, X_n$ be independent non-negative random variables with $EX_1 = \dotsc = EX_n = 1$, and let $Z = \sum_{i=1}^n \mu_i X_i$. Let $M = \max_{1 \le i \le n}…

Probability · Mathematics 2017-03-16 Roland Paulin

Several recent works in communication systems have proposed to leverage the power of neural networks in the design of encoders and decoders. In this approach, these blocks can be tailored to maximize the transmission rate based on…

Information Theory · Computer Science 2020-07-15 Sina Molavipour , Germán Bassi , Mikael Skoglund

The Gaussian noise stability of a function $f:\mathbb{R}^n \to \{-1, 1\}$ is the expected value of $f(\boldsymbol{x}) \cdot f(\boldsymbol{y})$ over $\rho$-correlated Gaussian random variables $\boldsymbol{x}$ and $\boldsymbol{y}$. Borell's…

Quantum Physics · Physics 2022-09-30 Yeongwoo Hwang , Joe Neeman , Ojas Parekh , Kevin Thompson , John Wright

Does the asymptotic variance of the maximum composite likelihood estimator of a parameter of interest always decrease when the nuisance parameters are known? Will a composite likelihood necessarily become more efficient by incorporating…

Statistics Theory · Mathematics 2016-12-22 Ximing Xu , Nancy Reid , Libai Xu

The information theoretic quantity known as mutual information finds wide use in classification and community detection analyses to compare two classifications of the same set of objects into groups. In the context of classification…

Social and Information Networks · Computer Science 2020-04-29 M. E. J. Newman , George T. Cantwell , Jean-Gabriel Young

This paper considers the model of an arbitrary distributed signal x observed through an added independent white Gaussian noise w, y=x+w. New relations between the minimal mean square error of the non-causal estimator and the likelihood…

Probability · Mathematics 2016-11-18 Moshe Zakai

The Maximal Information Coefficient (MIC) of Reshef et al. (Science, 2011) is a statistic for measuring dependence between variable pairs in large datasets. In this note, we prove that MIC is a consistent estimator of the corresponding…

Methodology · Statistics 2021-07-09 John Lazarsfeld , Aaron Johnson

We characterize the growth of the Sibson and Arimoto mutual informations and $\alpha$-maximal leakage, of any order that is at least unity, between a random variable and a growing set of noisy, conditionally independent and…

Information Theory · Computer Science 2021-11-23 Benjamin Wu , Aaron B. Wagner , Ibrahim Issa , G. Edward Suh

In this paper we build provably near-optimal, in the minimax sense, estimates of linear forms and, more generally, "$N$-convex functionals" (the simplest example being the maximum of several fractional-linear functions) of unknown "signal"…

Statistics Theory · Mathematics 2019-04-01 Anatoli Juditsky , Arkadi Nemirovski

We investigate an extension of an equilibrium-type result, conjectured by Ambrus, Ball and Erd\'elyi, and proved recently by Hardin, Kendall and Saff. These results were formulated on the torus, hence we also work on the torus, but one of…

Classical Analysis and ODEs · Mathematics 2018-01-17 Bálint Farkas , Béla Nagy , Szilárd Gy. Révész

In these notes, we prove a recent conjecture posed in the paper by R\"ais\"a, O. et al. [Subsampling is not Magic: Why Large Batch Sizes Work for Differentially Private Stochastic Optimization (2024)]. Theorem 6.2 of the paper asserts that…

Machine Learning · Computer Science 2024-09-10 Nikita P. Kalinin

In this work, the probability of an event under some joint distribution is bounded by measuring it with the product of the marginals instead (which is typically easier to analyze) together with a measure of the dependence between the two…

Information Theory · Computer Science 2020-10-22 Amedeo Roberto Esposito , Michael Gastpar , Ibrahim Issa

Mutual information (MI) is one of the most general ways to measure relationships between random variables, but estimating this quantity for complex systems is challenging. Denoising diffusion models have recently set a new bar for density…

Machine Learning · Computer Science 2025-11-20 Longxuan Yu , Xing Shi , Xianghao Kong , Tong Jia , Greg Ver Steeg