中文
相关论文

相关论文: Majorization and R\'enyi Entropy Inequalities via …

200 篇论文

We improve the entropic uncertainty relations for position and momentum coarse-grained measurements. We derive the continuous, coarse-grained counterparts of the discrete uncertainty relations based on the concept of majorization. The…

量子物理 · 物理学 2015-06-30 Łukasz Rudnicki

Lower bounds for the R\'enyi entropies of sums of independent random variables taking values in cyclic groups of prime order under permutations are established. The main ingredients of our approach are extended rearrangement inequalities in…

组合数学 · 数学 2021-10-20 Mokshay Madiman , Liyao Wang , Jae Oh Woo

We compute R\'enyi entropies for the statistics of a noisy simultaneous observation of two complementary observables in two-dimensional quantum systems. The relative amount of uncertainty between two states depends on the uncertainty…

量子物理 · 物理学 2015-11-17 Alfredo Luis , Gustavo Martín Bosyk , Mariela Portesi

R\'enyi divergence is related to R\'enyi entropy much like information divergence (also called Kullback-Leibler divergence or relative entropy) is related to Shannon's entropy, and comes up in many settings. It was introduced by R\'enyi as…

信息论 · 计算机科学 2010-05-28 Tim van Erven , Peter Harremoës

We investigate the R\'enyi entropy of independent sums of integer valued random variables through Fourier theoretic means, and give sharp comparisons between the variance and the R\'enyi entropy, for Poisson-Bernoulli variables. As…

概率论 · 数学 2024-03-19 Mokshay Madiman , James Melbourne , Cyril Roberto

Entropic uncertainty relations in a finite dimensional Hilbert space are investigated. Making use of the majorization technique we derive explicit lower bounds for the sum of R\'enyi entropies describing probability distributions associated…

量子物理 · 物理学 2015-11-20 Zbigniew Puchała , Łukasz Rudnicki , Karol Życzkowski

In this paper we have shall generalize Shearer's entropy inequality and its recent extensions by Madiman and Tetali, and shall apply projection inequalities to deduce extensions of some of the inequalities concerning sums of sets of…

组合数学 · 数学 2017-01-10 Paul Balister , Béla Bollobás

This work provides data-processing and majorization inequalities for $f$-divergences, and it considers some of their applications to coding problems. This work also provides tight bounds on the R\'{e}nyi entropy of a function of a discrete…

信息论 · 计算机科学 2021-04-01 Igal Sason

Shearer's inequality bounds the sum of joint entropies of random variables in terms of the total joint entropy. We give another lower bound for the same sum in terms of the individual entropies when the variables are functions of…

概率论 · 数学 2021-03-23 Endre Csóka , Viktor Harangi , Bálint Virág

New families of Fisher information and entropy power inequalities for sums of independent random variables are presented. These inequalities relate the information in the sum of $n$ independent random variables to the information contained…

信息论 · 计算机科学 2024-05-07 Mokshay Madiman , Andrew Barron

A lower bound on the R\'enyi differential entropy of a sum of independent random vectors is demonstrated in terms of rearrangements. For the special case of Boltzmann-Shannon entropy, this lower bound is better than that given by the…

信息论 · 计算机科学 2015-05-07 Liyao Wang , Mokshay Madiman

Majorization is a stochastic ordering relation that compares the relative diversity of probability distributions with numerous applications in econometrics, spectral theory, and ecology. It is well-known that the majorization partial order…

信息论 · 计算机科学 2026-05-25 Anuj Kumar Yadav , Yanina Y. Shkel

The entropy power inequality for independent random vectors is a foundational result of information theory, with deep connections to probability and geometric functional analysis. Several extensions of the entropy power inequality have been…

信息论 · 计算机科学 2025-12-23 Mokshay Madiman , James Melbourne , Cyril Roberto

A new sharp inequality featuring the differential R\'enyi entropy, the R\'enyi divergence and the R\'enyi cross-entropy of a pair of probability density functions is established. The equality is reached when one of the probability density…

信息论 · 计算机科学 2026-03-10 Razvan Gabriel Iagar , David Puertas-Centeno

We introduce a variant of the R\'enyi entropy definition that aligns it with the well-known H\"older mean: in the new formulation, the r-th order R\'enyi Entropy is the logarithm of the inverse of the r-th order H\"older mean. This brings…

信息论 · 计算机科学 2018-11-16 Francisco José Valverde-Albacete , Carmen Peláez-Moreno

This paper provides tight bounds on the R\'enyi entropy of a function of a discrete random variable with a finite number of possible values, where the considered function is not one-to-one. To that end, a tight lower bound on the R\'enyi…

信息论 · 计算机科学 2018-12-11 Igal Sason

We calculate analytically the Renyi entropy for the zeta-urn model with a Gibbs measure definition of the micro-state probabilities. This allows us to obtain the singularities in the R\'enyi entropy from those of the thermodynamic…

统计力学 · 物理学 2023-12-07 Piotr Bialas , Zdzislaw Burda , Desmond A. Johnston

A new notion of partition-determined functions is introduced, and several basic inequalities are developed for the entropy of such functions of independent random variables, as well as for cardinalities of compound sets obtained using these…

信息论 · 计算机科学 2012-06-05 Mokshay Madiman , Adam Marcus , Prasad Tetali

We consider a probability distribution depending on a real parameter $x$. As functions of $x$, the R\'enyi entropy and the Tsallis entropy can be expressed in terms of the associated index of coincidence $S(x)$. We establish recurrence…

经典分析与常微分方程 · 数学 2019-10-31 Alexandra Maduta , Diana Otrocol , Ioan Rasa

Existing polarization theories have mostly been concerned with Shannon's information measures, such as Shannon entropy and mutual information, and some related measures such as the Bhattacharyya parameter. In this work, we extend…

信息论 · 计算机科学 2019-07-16 Mengfan Zheng , Ling Liu , Cong Ling
‹ 上一页 1 2 3 10 下一页 ›