English

Lower Bound on Derivatives of Costa's Differential Entropy

Information Theory 2020-07-21 v1 math.IT

Abstract

Several conjectures concern the lower bound for the differential entropy H(Xt)H(X_t) of an nn-dimensional random vector XtX_t introduced by Costa. Cheng and Geng conjectured that H(Xt)H(X_t) is completely monotone, that is, C1(m,n):(1)m+1(dm/dmt)H(Xt)0C_1(m,n): (-1)^{m+1}(d^m/d^m t)H(X_t)\ge0. McKean conjectured that Gaussian XGtX_{Gt} achieves the minimum of (1)m+1(dm/dmt)H(Xt)(-1)^{m+1}(d^m/d^m t)H(X_t) under certain conditions, that is, C2(m,n):(1)m+1(dm/dmt)H(Xt)(1)m+1(dm/dmt)H(XGt)C_2(m,n): (-1)^{m+1}(d^m/d^m t)H(X_t)\ge(-1)^{m+1}(d^m/d^m t)H(X_{Gt}). McKean's conjecture was only considered in the univariate case before: C2(1,1)C_2(1,1) and C2(2,1)C_2(2,1) were proved by McKean and C2(i,1),i=3,4,5C_2(i,1),i=3,4,5 were proved by Zhang-Anantharam-Geng under the log-concave condition. In this paper, we prove C2(1,n)C_2(1,n), C2(2,n)C_2(2,n) and observe that McKean's conjecture might not be true for n>1n>1 and m>2m>2. We further propose a weaker version C3(m,n):(1)m+1(dm/dmt)H(Xt)(1)m+11n(dm/dmt)H(XGt)C_3(m,n): (-1)^{m+1}(d^m/d^m t)H(X_t)\ge(-1)^{m+1}\frac{1}{n}(d^m/d^m t)H(X_{Gt}) and prove C3(3,2)C_3(3,2), C3(3,3)C_3(3,3), C3(3,4)C_3(3,4), C3(4,2)C_3(4,2) under the log-concave condition. A systematical procedure to prove Cl(m,n)C_l(m,n) is proposed based on semidefinite programming and the results mentioned above are proved using this procedure.

Keywords

Cite

@article{arxiv.2007.10145,
  title  = {Lower Bound on Derivatives of Costa's Differential Entropy},
  author = {Laigang Guo and Chun-Ming Yuan and Xiao-Shan Gao},
  journal= {arXiv preprint arXiv:2007.10145},
  year   = {2020}
}

Comments

arXiv admin note: text overlap with arXiv:2004.08543