English
Related papers

Related papers: Dictator Functions Maximize Mutual Information

200 papers

An inequality of Brascamp-Lieb-Luttinger generalizes the Riesz-Sobolev inequality, stating that certain multilinear functionals, acting on nonnegative functions of one real variable with prescribed distribution functions, are maximized when…

Classical Analysis and ODEs · Mathematics 2017-06-12 Michael Christ

A data processing inequality states that the quantity of shared information between two entities (e.g. signals, strings) cannot be significantly increased when one of the entities is processed by certain kinds of transformations. In this…

Computational Complexity · Computer Science 2016-08-18 Adam Case

We propose a new Integral Probability Metric (IPM) between distributions: the Sobolev IPM. The Sobolev IPM compares the mean discrepancy of two distributions for functions (critic) restricted to a Sobolev ball defined with respect to a…

Machine Learning · Computer Science 2017-11-15 Youssef Mroueh , Chun-Liang Li , Tom Sercu , Anant Raj , Yu Cheng

We show a partial Boolean function $f$ together with an input $x\in f^{-1}\left(*\right)$ such that both $C_{\bar{0}}\left(f,x\right)$ and $C_{\bar{1}}\left(f,x\right)$ are at least $C\left(f\right)^{2-o\left(1\right)}$. Due to recent…

Computational Complexity · Computer Science 2021-03-10 Kaspars Balodis

Talagran's correlation inequality provides quantitative lower bounds on the covariance of two increasing Boolean functions in terms of their coordinate influences, but, in general, a logarithmic loss is necessary. Motivated by a question of…

Combinatorics · Mathematics 2026-05-19 Fan Chang , Yu Chen

Human cooperation depends on how accurately we infer others' motives--how much they value fairness, generosity, or self-interest from the choices they make. We model that process in binary dictator games, which isolate moral trade-offs…

Neurons and Cognition · Quantitative Biology 2025-11-12 Gregory Stanley , Jun Zhang , Rick Lewis

Let $X$ be a real-valued random variable with distribution function $F$. Set $X_1,\dots, X_m$ to be independent copies of $X$ and let $F_m$ be the corresponding empirical distribution function. We show that there are absolute constants…

Probability · Mathematics 2023-08-10 Daniel Bartl , Shahar Mendelson

We generalize the celebrated isoperimetric inequality of Khot, Minzer, and Safra~(SICOMP 2018) for Boolean functions to the case of real-valued functions $f \colon \{0,1\}^d\to\mathbb{R}$. Our main tool in the proof of the generalized…

Discrete Mathematics · Computer Science 2020-11-19 Hadley Black , Iden Kalemaj , Sofya Raskhodnikova

A collaborative distributed binary decision problem is considered. Two statisticians are required to declare the correct probability measure of two jointly distributed memoryless process, denoted by $X^n=(X_1,\dots,X_n)$ and…

Information Theory · Computer Science 2016-04-11 Gil Katz , Pablo Piantanida , Merouane Debbah

We consider the function computation problem in a three node network with one encoder and two decoders. The encoder has access to two correlated sources $X$ and $Y$. The encoder encodes $X^n$ and $Y^n$ into a message which is given to two…

Information Theory · Computer Science 2016-10-05 Jithin Ravi , Bikash Kumar Dey

In this paper, we establish a new inequality tying together the effective length and the maximum correlation between the outputs of an arbitrary pair of Boolean functions which operate on two sequences of correlated random variables. We…

Information Theory · Computer Science 2017-02-07 Farhad Shirani , S. Sandeep Pradhan

The quadratic decaying property of the information rate function states that given a fixed conditional distribution $p_{\mathsf{Y}|\mathsf{X}}$, the mutual information between the (finite) discrete random variables $\mathsf{X}$ and…

Information Theory · Computer Science 2023-05-15 Michael X. Cao , Marco Tomamichel

The influence of the $k$'th coordinate on a Boolean function $f:\{0,1\}^n \rightarrow \{0,1\}$ is the probability that flipping $x_k$ changes the value $f(x)$. The total influence $I(f)$ is the sum of influences of the coordinates. The…

Combinatorics · Mathematics 2018-06-06 Nathan Keller , Noam Lifshitz

We study mathematical models of the collaborative solving of a two-choice discrimination task. We estimate the difference between the shared performance for a group of n observers over a single person performance. Our paper is a theoretical…

Physics and Society · Physics 2013-03-13 Piotr Migdał , Michał Denkiewicz , Joanna Rcaczaszek-Leonardi , Dariusz Plewczynski

In the rate-distortion function and the Maximum Entropy (ME) method, Minimum Mutual In-formation (MMI) distributions and ME distributions are expressed by Bayes-like formulas, in-cluding Negative Exponential Functions (NEFs) and partition…

Information Theory · Computer Science 2021-10-18 Chenguang Lu

Bregman divergences are a class of distance-like comparison functions which play fundamental roles in optimization, statistics, and information theory. One important property of Bregman divergences is that they cause two useful formulations…

Information Theory · Computer Science 2025-01-07 Philip S. Chodrow

In this paper we prove multilevel concentration inequalities for bounded functionals $f = f(X_1, \ldots, X_n)$ of random variables $X_1, \ldots, X_n$ that are either independent or satisfy certain logarithmic Sobolev inequalities. The…

Probability · Mathematics 2020-06-16 Friedrich Götze , Holger Sambale , Arthur Sinulis

An information-theoretic development is given for the problem of compound Poisson approximation, which parallels earlier treatments for Gaussian and Poisson approximation. Let $P_{S_n}$ be the distribution of a sum $S_n=\Sumn Y_i$ of…

Probability · Mathematics 2019-06-05 A. D. Barbour , Oliver Johnson , Ioannis Kontoyiannis , Mokshay Madiman

Let $(X, \mathscr{L}, \lambda)$ and $(Y, \mathscr{M}, \mu)$ be finite measure spaces for which there exist $A \in \mathscr{L}$ and $B \in \mathscr{M}$ with either $0 < \lambda(A) < 1 < \lambda(X)$ and $0 < \mu(B) < \mu(Y)$, or the other way…

Functional Analysis · Mathematics 2023-05-08 Dorota Glazowska , Paolo Leonetti , Janusz Matkowski , Salvatore Tringali

Let $X, Y$ be two independent identically distributed (i.i.d.) random variables taking values from a separable Banach space $(\mathcal{X}, \|\cdot\|)$. Given two measurable subsets $F, K\subseteq\cal{X}$, we established distribution free…

Probability · Mathematics 2018-05-01 Zhao Dong , Jiange Li , Wenbo V. Li