Related papers: A reverse entropy power inequality for i.i.d. log-…
Given a suitably normalized $X\in\mathbb{R}^n$ we observe that the function $\theta\mapsto\mathbb{E}|X\cdot\theta|$, defined for $\theta\in S^{n-1}$, admits surprisingly strong concentration far surpassing what is expected on account of…
Entropy and other fundamental quantities of information theory are customarily expressed and manipulated as functions of probabilities. Here we study the entropy H and subentropy Q as functions of the elementary symmetric polynomials in the…
We investigate the issue of parameter estimation with nonuniform negative sampling for imbalanced data. We first prove that, with imbalanced data, the available information about unknown parameters is only tied to the relatively small…
In this paper, we study the approximation and estimation of $s$-concave densities via R\'enyi divergence. We first show that the approximation of a probability measure $Q$ by an $s$-concave densities exists and is unique via the procedure…
Shearer's inequality bounds the sum of joint entropies of random variables in terms of the total joint entropy. We give another lower bound for the same sum in terms of the individual entropies when the variables are functions of…
We provide a systematic approach to deal with the following problem. Let $X_1,\ldots,X_n$ be, possibly dependent, $[0,1]$-valued random variables. What is a sharp upper bound on the probability that their sum is significantly larger than…
In this paper, we establish some reverses of the operator entropy inequalities under certain conditions by using the Mond-Pe\v{c}ari\'c method. In particular, we present {\tiny \begin{align*}…
We prove reversed Hardy-Littlewood-Sobolev inequalities by carefully studying the natural associated free energies with direct methods of calculus of variations. Tightness is obtained by a dyadic argument, which quantifies the relative…
Let $K$ be a convex body in $\mathbb R^n$. We introduce a new affine invariant, which we call $\Omega_K$, that can be found in three different ways: as a limit of normalized $L_p$-affine surface areas, as the relative entropy of the cone…
We introduce an axiomatic approach to entropies and relative entropies that relies only on minimal information-theoretic axioms, namely monotonicity under mixing and data-processing as well as additivity for product distributions. We find…
We show that time-reversed Young interferometry reorganizes, rather than reverses, optical entropy. A fixed detector conditions the reciprocal source--detector Green function and produces a source-label probability distribution. Marginal…
We establishe an affine Hardy-Littlewood-Sobolev inequality concerning two different functions which is stronger than the classical Hardy-Littlewood-Sobolev inequality. Furthermore, we also prove reverse inequalities for the new…
We analyze the performance of alternating minimization for loss functions optimized over two variables, where each variable may be restricted to lie in some potentially nonconvex constraint set. This type of setting arises naturally in…
Various lower bounds are established for the entropy of sums, products and their combinations. First, we derive a prime-field analogue of a version of the entropy power inequality established by Tao over torsion-free groups. Next, we prove…
In wall-modelled large-eddy simulations of hypersonic boundary-layer transition, Hoffmann, Chamarthi and Frankel reported that characteristic reconstruction based on conservative-variable eigenvectors produced markedly better results than…
We extend Hoggar's theorem that the sum of two independent discrete-valued log-concave random variables is itself log-concave. We introduce conditions under which the result still holds for dependent variables. We argue that these…
In this paper, we give some reverse-types of Ando's and H\"older-McCarthy's inequalities for positive linear maps, and positive invertible operators. For our purpose, we use a recently improved Young inequality and its reverse.
We prove decoupling inequalities for random polynomials in independent random variables with coefficients in vector space. We use various means of comparison, including rearrangement invariant norms (e.g., Orlicz and Lorentz norms), tail…
We consider a new functional inequality controlling the rate of relative entropy decay for random walks, the interchange process and more general block-type dynamics for permutations. The inequality lies between the classical logarithmic…
Log-concave distributions include some important distributions such as normal distribution, exponential distribution and so on. In this note, we show inequalities between two Lp-norms for log-concave distributions on the Euclidean space.…