Related papers: A reverse entropy power inequality for i.i.d. log-…

Fix a modulus $q$. One would expect the number of primes in each invertible residue class mod $q$ to be multinomially distributed, i.e. for each $p \,\mathrm{mod}\, q$ to behave like an independent random variable uniform on…

We compute R\'enyi entropies for a spherical entangling surface in four-dimensional N=4 super-Yang-Mills at strong coupling using the AdS/CFT correspondence. Incorporating the effects of the leading \alpha' corrections to the low energy…

We investigate the R\'enyi entropy of independent sums of integer valued random variables through Fourier theoretic means, and give sharp comparisons between the variance and the R\'enyi entropy, for Poisson-Bernoulli variables. As…

This work studies the location estimation problem for a mixture of two rotation invariant log-concave densities. We demonstrate that Least Squares EM, a variant of the EM algorithm, converges to the true location parameter from a randomly…

We propose a new discretization of the mirror-Langevin diffusion and give a crisp proof of its convergence. Our analysis uses relative convexity/smoothness and self-concordance, ideas which originated in convex optimization, together with a…

We consider random matrices of the form $H = W + \lambda V$, $\lambda\in\mathbb{R}^+$, where $W$ is a real symmetric or complex Hermitian Wigner matrix of size $N$ and $V$ is a real bounded diagonal random matrix of size $N$ with i.i.d.\…

We construct intrinsic on-and off-diagonal upper and lower estimates for the transition probability density of a L\'evy process in small time. By intrinsic we mean that such estimates reflect the structure of the characteristic exponent of…

In this paper, we obtain a reverse version of the integral Hardy inequality on metric measure space with two negative exponents. Also, as for applications we show the reverse Hardy-Littlewood-Sobolev and the Stein-Weiss inequalities with…

A new sharp inequality featuring the differential R\'enyi entropy, the R\'enyi divergence and the R\'enyi cross-entropy of a pair of probability density functions is established. The equality is reached when one of the probability density…

We show that an information-theoretic property of Shannon's entropy power, known as concavity of entropy power, can be fruitfully employed to prove inequalities in sharp form. In particular, the concavity of entropy power implies the…

We introduce the notion of an interpolating path on the set of probability measures on finite graphs. Using this notion, we first prove a displacement convexity property of entropy along such a path and derive Prekopa-Leindler type…

We introduce a generalization of relative entropy derived from the Wigner-Yanase-Dyson entropy and give a simple, self-contained proof that it is convex. Moreover, special cases yield the joint convexity of relative entropy, and for the map…

Let $\{Y_i,-\infty<i<\infty\}$ be a doubly infinite sequence of identically distributed, negatively dependent random variables under sub-linear expectations, $\{a_i,-\infty<i<\infty\}$ be an absolutely summable sequence of real numbers. In…

The log-periodic equation for the entropy $S = - (k/a) \sum_{i=1}^{N} p_{i} \sin(a \ln p_{i})$, based on the forgotten Sharma-Taneja entropy measure, is studied for the first time with $N$ the total number of system states and $p_{i}$ the…

We show that under natural growth conditions on the entropy function, convergence in relative entropy is equivalent to $L_p$-convergence. The main tool is the theory of Young measures, in a form that accounts for the formation of…

In a time-reversal non-invariant system the entropy production, dS/dt, may be negative. Close to the critical point of medium it is positive: larger or smaller as compared with one above critical point depending on whether the transitions…

We study the Monge and Kantorovich transportation problems on $\mathbb{R}^{\infty}$ within the class of exchangeable measures. With the help of the de Finetti decomposition theorem the problem is reduced to an unconstrained optimal…

There are currently two main, continuum models of entropy: a 'reversible', Clausius entropy model and an 'irreversible', Onsager-Prigogine entropy model. It is shown that the equations of the 'reversible' and the 'irreversible' entropy…

In this paper, we analyze the asymptotics of the normalized remaining uncertainty of a source when a compressed or hashed version of it and correlated side-information is observed. For this system, commonly known as Slepian-Wolf source…

We study and develop multilevel methods for the numerical approximation of a log-concave probability $\pi$ on $\mathbb{R}^d$, based on (over-damped) Langevin diffusion. In the continuity of \cite{art:egeapanloup2021multilevel} concentrated…