相关论文: A short note on the joint entropy of n/2-wise inde…

We derive an asymptotic lower bound on the Shannon entropy $H$ of sums of $N$ arbitrary iid discrete random variables. The derived bound $H \geq \frac{r(X)}{2}\log(N) + {\it cst}$ is given in terms of the incommensurability rank $r(X)$ of…

Let X be a random variable. We shall call an independent random variable Y to be a symmetrizer for X, if X+Y is symmetric around zero. A random variable is said to be symmetry resistant if the variance of any symmetrizer Y, is never smaller…

Derandomization of Chernoff bound with union bound is already proven in many papers. We here give another explicit version of it that obtains a construction of size that is arbitrary close to the probabilistic nonconstructive size. We apply…

A new upper bound on the relative entropy is derived as a function of the total variation distance for probability measures defined on a common finite alphabet. The bound improves a previously reported bound by Csisz\'ar and Talata. It is…

We introduce a notion of a point-wise entropy of measures (i.e local entropy) called neutralized local entropy, and compare it with the Brin-Katok local entropy. We show that the neutralized local entropy coincides with Brin-Katok local…

Let $\{Z_k\}_{k\geqslant 1}$ denote a sequence of independent Bernoulli random variables defined by ${\mathbb P}(Z_k=1)=1/k=1-{\mathbb P}(Z_k=0)$ $(k\geqslant 1)$ and put $T_n:=\sum_{1\leqslant k\leqslant n}kZ_k$. It is then known that…

Let $ X_1, \ldots, X_n $ be independent random variables taking values in the alphabet $ \{0, 1, \ldots, r\} $, and $ S_n = \sum_{i = 1}^n X_i $. The Shepp--Olkin theorem states that, in the binary case ($ r = 1 $), the Shannon entropy of $…

We consider the Last-Success-Problem with $n$ independent Bernoulli random variables with parameters $p_i>0$. We improve the lower bound provided by F.T. Bruss for the probability of winning and provide an alternative proof to the one given…

We adapt arguments concerning entropy-theoretic convergence from the independent case to the case of FKG random variables. FKG systems are chosen since their dependence structure is controlled through covariance alone, though in the sequel…

Shearer's inequality bounds the sum of joint entropies of random variables in terms of the total joint entropy. We give another lower bound for the same sum in terms of the individual entropies when the variables are functions of…

This paper considers the entropy of the sum of (possibly dependent and non-identically distributed) Bernoulli random variables. Upper bounds on the error that follows from an approximation of this entropy by the entropy of a Poisson random…

Let $\beta\in(1,2)$ and let $H_\beta$ denote Garsia's entropy for the Bernoulli convolution $\mu_\beta$ associated with $\beta$. In the present paper we show that $H_\beta>0.82$ for all $\beta \in (1, 2)$ and improve this bound for certain…

We describe a novel way to represent the probability distribution of a random binary string as a mixture having a maximally weighted component associated with independent (though not necessarily identically distributed) Bernoulli…

We investigate entropic uncertainty relations for two or more binary measurements, for example spin-$\frac{1}{2}$ or polarisation measurements. We argue that the effective anti-commutators of these measurements, i.e. the anti-commutators…

We propose a test of independence of two multivariate random vectors, given a sample from the underlying population. Our approach, which we call MINT, is based on the estimation of mutual information, whose decomposition into joint and…

We adapt arguments concerning information-theoretic convergence in the Central Limit Theorem to the case of dependent random variables under Rosenblatt mixing conditions. The key is to work with random variables perturbed by the addition of…

The uncertainty relation for continuous variables due to Byalinicki-Birula and Mycielski expresses the complementarity between two $n$-uples of canonically conjugate variables $(x_1,x_2,\cdots x_n)$ and $(p_1,p_2,\cdots p_n)$ in terms of…

Motivated by the entropy computations relevant to the evaluation of decrease in entropy in bit reset operations, the authors investigate the deficit in an entropic inequality involving two independent random variables, one continuous and…

In this paper we study the following set\[A=\{p(n)+2^nd \mod 1: n\geq 1\}\subset [0.1],\] where $p$ is a polynomial with at least one irrational coefficient on non constant terms, $d$ is any real number and for $a\in [0,\infty)$, $a \mod 1$…

We find a sharp combinatorial bound for the metric entropy of sets in R^n and general classes of functions. This solves two basic combinatorial conjectures on the empirical processes. 1. A class of functions satisfies the uniform Central…