English
Related papers

Related papers: Dictator Functions Maximize Mutual Information

200 papers

The two-functional conjecture says that if a function f analytic and univalent in the unit disk maximizes Re{L} and Re{M} for two continuous linear functionals L and M, L is not equal to cM for any c>0, then f is a rotation of the Koebe…

Complex Variables · Mathematics 2012-10-16 Dmitri Prokhorov

The Dvoretzky--Kiefer--Wolfowitz (DKW) inequality says that if $F_n$ is an empirical distribution function for variables i.i.d.\ with a distribution function $F$, and $K_n$ is the Kolmogorov statistic $\sqrt{n}\sup_x|(F_n-F)(x)|$, then…

Statistics Theory · Mathematics 2011-08-12 Fan Wei , Richard M Dudley

We present a regularity lemma for Boolean functions $f:\{-1,1\}^n \to \{-1,1\}$ based on noisy influence, a measure of how locally correlated $f$ is with each input bit. We provide an application of the regularity lemma to weaken the…

Computational Complexity · Computer Science 2016-10-25 Chris Jones

Mutual information between two random variables is a well-studied notion, whose understanding is fairly complete. Mutual information between one random variable and a pair of other random variables, however, is a far more involved notion.…

Information Theory · Computer Science 2026-05-05 Aobo Lyu , Andrew Clark , Netanel Raviv

We pursue a systematic study of the following problem. Let f:{0,1}^n -> {0,1} be a (usually monotone) Boolean function whose behaviour is well understood when the input bits are identically independently distributed. What can be said about…

Probability · Mathematics 2012-01-17 Itai Benjamini , Ori Gurel-Gurevich , Ron Peled

Suppose that $X,Y$ are positive random variable and $m$ a numerical (commutative) mean. We prove that the inequality ${\rm E} (m(X,Y)) \leq m({\rm E} (X), {\rm E} (Y))$ holds if and only if the mean is generated by a concave function. With…

Probability · Mathematics 2017-02-22 Paolo Gibilisco , Frank Hansen

Present work contains a method to obtain Jackson and Stechkin type inequalities of approximation by integral functions of finite degree (IFFD) in some variable exponent Lebesgue space of real functions defined on $\boldsymbol{R}:=\left(…

Functional Analysis · Mathematics 2022-08-30 Ramazan Akgün

The following problem is considered: given a joint distribution $P_{XY}$ and an event $E$, bound $P_{XY}(E)$ in terms of $P_XP_Y(E)$ (where $P_XP_Y$ is the product of the marginals of $P_{XY}$) and a measure of dependence of $X$ and $Y$.…

Information Theory · Computer Science 2019-03-12 Ibrahim Issa , Amedeo Roberto Esposito , Michael Gastpar

Mutual information is a widely-used information theoretic measure to quantify the amount of association between variables. It is used extensively in many applications such as image registration, diagnosis of failures in electrical machines,…

Computation · Statistics 2021-08-21 Luai Al-Labadi , Forough Fazeli-Asl , Zahra Saberi

We prove that the classical Efron--Stein inequality holds for independent exchangeable pairs \((X_i,Y_i)\). The same inequality fails for independent identically distributed pairs; a simple trigonometric counterexample shows that the…

Probability · Mathematics 2026-05-08 Jnaneshwar Baslingker , Bálint Virág

The equality problem of the two-variable Bajraktarevi\'c means can be expressed as the functional equation $$ \left(\frac{f}{g}\right)^{-1}\bigg(\frac{f(x)+f(y)}{g(x)+g(y)}\bigg)…

Classical Analysis and ODEs · Mathematics 2021-12-15 Zsolt Páles , Amr Zakaria

We prove that, for any jointly stable random variables $X_1, \dots, X_k$ with zero mean, any $m<k,$ and any even continuous positive definite functions $f$ and $g$ on $\Bbb R^m$ and $\Bbb R^{k-m},$ the random variables $f(X_1,\dots,X_m)$…

Functional Analysis · Mathematics 2016-09-06 Alexander Koldobsky , Stephen J. Montgomery-Smith

This paper considers the problem of approximating a Boolean function $f$ using another Boolean function from a specified class. Two classes of approximating functions are considered: $k$-juntas, and linear Boolean functions. The $n$ input…

Information Theory · Computer Science 2019-07-09 Mohsen Heidari , S. Sandeep Pradhan , Ramji Venkataramanan

We define Letac-Wesolowski-Matsumoto-Yor (LWMY) functions as decreasing functions from $(0,\infty)$ onto $(0,\infty)$ with the following property: there exist independent, positive random variables $X$ and $Y$ such that the variables…

Statistics Theory · Mathematics 2012-03-05 A. E. Koudou , P. Vallois

In literature, different common informations were defined by G\'acs and K\"orner, by Wyner, and by Kumar, Li, and Gamal, respectively. In this paper, we define two generalized versions of common informations, named approximate and exact…

Information Theory · Computer Science 2017-07-26 Lei Yu , Houqiang Li , Chang Wen Chen

We discuss when two rational functions $f$ and $g$ can have the same measure of maximal entropy. The polynomial case was completed by (Beardon, Levin, Baker-Eremenko,Schmidt-Steinmetz, etc., 1980s-90s), and we address the rational case…

Dynamical Systems · Mathematics 2014-09-29 Hexi Ye

Let $I, J\subset \mathbb{R}$ be closed intervals, and let $H$ be $C^{3}$ smooth real valued function on $I\times J$ with nonvanishing $H_{x}$ and $H_{y}$. Take any fixed positive numbers $a,b$, and let $d\mu$ be a probability measure with…

Analysis of PDEs · Mathematics 2017-06-22 Paata Ivanisvili

Let $f:\{-1,1\}^{n}\rightarrow \{-1,1\}$ be a Boolean valued function having total degree $d$. Then a conjecture due to Servedio and Gopalan asserts that $\sum_{i=1}^{n}\widehat{f}(i)\leq \sum_{j=1}^{d}\widehat{\text{Maj}}_{d}(j)$ where…

Computational Complexity · Computer Science 2016-11-08 Sumit Kumar Jha

In this work, the probability of an event under some joint distribution is bounded by measuring it with the product of the marginals instead (which is typically easier to analyze) together with a measure of the dependence between the two…

Information Theory · Computer Science 2020-10-22 Amedeo Roberto Esposito , Michael Gastpar , Ibrahim Issa

Let $\{X_i,i\geq1\}$ be a sequence of negatively associated random variables, and let $\{X_i^\ast,i\geq 1\}$ be a sequence of independent random variables such that $X_i^\ast$ and $X_i$ have the same distribution for each $i$. Denote by…

Probability · Mathematics 2020-05-12 WenCong Zhang