English
Related papers

Related papers: Minimum entropy of a log-concave variable for fixe…

200 papers

In this paper, we study an ordinary differential equation with a degenerate global attractor at the origin, to which we add a white noise with a small parameter that regulates its intensity. Under general conditions, for any fixed…

Probability · Mathematics 2025-05-27 Gerardo Barrera , Conrado da Costa , Milton Jara

We consider the sharp Sobolev-Poincar\'e constant for the embedding of $W^{1,2}_0(\Omega)$ into $L^q(\Omega)$. We show that such a constant exhibits an unexpected dual variational formulation, in the range $1<q<2$. Namely, this can be…

Analysis of PDEs · Mathematics 2021-06-11 Lorenzo Brasco

This paper focuses on the extreme-value problem for Shannon entropy of the joint distribution with given marginals. It is proved that the minimum-entropy coupling must be of order-preserving, while the maximum-entropy coupling coincides…

Information Theory · Computer Science 2022-06-09 Ya-Jing Ma , Feng Wang , Xian-Yuan Wu , Kai-Yuan Cai

Variational inference is a powerful tool for approximate inference. However, it mainly focuses on the evidence lower bound as variational objective and the development of other measures for variational inference is a promising area of…

Machine Learning · Computer Science 2016-12-06 Michael Figurnov , Kirill Struminsky , Dmitry Vetrov

We study the entropy increase of quantum systems evolving under primitive, doubly stochastic Markovian noise and thus converging to the maximally mixed state. This entropy increase can be quantified by a logarithmic-Sobolev constant of the…

Quantum Physics · Physics 2017-12-06 Alexander Müller-Hermes , Daniel Stilck Franca , Michael M. Wolf

We present an abstract framework to study weak convergence of numerical approximations of linear stochastic partial differential equations driven by additive L\'evy noise. We first derive a representation formula for the error which we then…

Probability · Mathematics 2016-02-25 Mihály Kovács , Felix Lindner , René L. Schilling

In this paper, we provide explicit lower bounds with respect to some quantities of interest (parameters of the underlying distribution, dimension, geometrical characteristics of the domain, position of the origin, etc.) on the spectral gap…

Functional Analysis · Mathematics 2024-03-27 Michel Bonnefont , Aldéric Joulin

We show a direct relationship between the variance and the differential entropy for subclasses of symmetric and asymmetric unimodal distributions by providing an upper bound on variance in terms of entropy power. Combining this bound with…

Information Theory · Computer Science 2017-11-27 Hye Won Chung , Brian M. Sadler , Alfred O. Hero

In this paper we derived a variational principle for the specific entropy on the context of symbolic dynamics of compact metric space alphabets and use this result to obtain the uniqueness of the equilibrium states associated to a Walters…

Dynamical Systems · Mathematics 2018-06-11 D. Aguiar , L. Cioletti , R. Ruviaro

Using the graphical calculus and integration techniques introduced by the authors, we study the statistical properties of outputs of products of random quantum channels for entangled inputs. In particular, we revisit and generalize models…

Quantum Physics · Physics 2012-02-17 Benoit Collins , Ion Nechita

We consider a line with noise in the simplest case. Loss does not add noise. Amplification via phase insensitive amplifiers do add noise. A lower bound of this capacity is the quantum analog to the Shannon capacity of a linear channel with…

Quantum Physics · Physics 2013-03-05 Antonio Mecozzi

A lower bound of the reduced relative entropy is given by the use of a variational expression. The reduced Tsallis relative entropy is defined and some results are given. In particular, the convexity of the reduced Tsallis relative entropy…

Quantum Physics · Physics 2025-03-06 Shigeru Furuichi , Frank Hansen

We study the problem of discovering the simplest latent variable that can make two observed discrete variables conditionally independent. The minimum entropy required for such a latent is known as common entropy in information theory. We…

We provide a sharp lower bound on the $p$-norm of a sum of independent uniform random variables in terms of its variance when $0 < p < 1$. We address an analogous question for $p$-R\'enyi entropy for $p$ in the same range.

Probability · Mathematics 2025-01-28 Giorgos Chasapis , Keerthana Gurushankar , Tomasz Tkocz

Two-sided bounds are explored for concentration functions and R\'enyi entropies in the class of discrete log-concave probability distributions. They are used to derive certain variants of the entropy power inequalities.

Probability · Mathematics 2021-04-27 Sergey G. Bobkov , Arnaud Marsiglietti , James Melbourne

We observe that the distribution of the eigenvalues of an $N$-by-$N$ GUE random matrix is log-concave on $\mathbb{R}^N$, and that the same is true for the law of a single gap between two consecutive eigenvalues. We use this observation to…

Probability · Mathematics 2026-01-12 Samuel G. G. Johnston

We show that the likelihood function for a multinomial vector observed under arbitrary interval censoring constraints on the frequencies or their partial sums is completely log-concave by proving that the constrained sample spaces comprise…

Statistics Theory · Mathematics 2023-11-07 Bruce Levin , Erik Learned-Miller

A lower bound on the R\'enyi differential entropy of a sum of independent random vectors is demonstrated in terms of rearrangements. For the special case of Boltzmann-Shannon entropy, this lower bound is better than that given by the…

Information Theory · Computer Science 2015-05-07 Liyao Wang , Mokshay Madiman

We present an extension of the famous Littlewood-Offord problem when Bernoulli distributions are replaced with discrete log-concave distributions. A variant of the Littlewood-Offord problem for arithmetic progressions, as well as an…

Probability · Mathematics 2026-02-19 Arnaud Marsiglietti , James Melbourne

The classical energy minimization principles of Dirichlet and Thompson are extended as minimization principles to acoustics, elastodynamics and electromagnetism in lossy inhomogeneous bodies at fixed frequency. This is done by building upon…

Mathematical Physics · Physics 2011-05-06 Graeme W. Milton , Pierre Seppecher , Guy Bouchitte