English
Related papers

Related papers: On Reverse Pinsker Inequalities

200 papers

We introduce a generalization of relative entropy derived from the Wigner-Yanase-Dyson entropy and give a simple, self-contained proof that it is convex. Moreover, special cases yield the joint convexity of relative entropy, and for the map…

Quantum Physics · Physics 2015-05-13 Anna Jencova , Mary Beth Ruskai

Recently,D.Mondal et.al[Phys. Rev. A. 95, 052117(2017)]creatively introduce a new interesting concept of reverse uncertainty relation which indicates that one cannot only prepare quantum states with joint small uncertainty, but also with…

Quantum Physics · Physics 2023-08-28 Xiao Zheng , Ai-Ling Ji , Guo-Feng Zhang

Relations between Shannon entropy and Renyi entropies of integer order are discussed. For any N-point discrete probability distribution for which the Renyi entropies of order two and three are known, we provide an lower and an upper bound…

Quantum Physics · Physics 2007-05-23 Karol Zyczkowski

The weak law of large numbers implies that, under mild assumptions on the source, the Renyi entropy per produced symbol converges (in probability) towards the Shannon entropy rate. This paper quantifies the speed of this convergence for…

Information Theory · Computer Science 2017-05-01 Maciej Skorski

The Riesz-Sobolev inequality provides an upper bound, in integral form, for the convolution of indicator functions of subsets of Euclidean space. We formulate and prove a sharper form of the inequality. This can be equivalently phrased as a…

Classical Analysis and ODEs · Mathematics 2017-06-08 Michael Christ

For $\ell\colon \mathbb{R}^d \to [0,\infty)$ we consider the sequence of probability measures $\left(\mu_n\right)_{n \in \mathbb{N}}$, where $\mu_n$ is determined by a density that is proportional to $\exp(-n\ell)$. We allow for infinitely…

Probability · Mathematics 2023-12-11 Mareike Hasenpflug , Daniel Rudolf , Björn Sprungk

We study the convergence of states under continuous-time depolarizing channels with full rank fixed points in terms of the relative entropy. The optimal exponent of an upper bound on the relative entropy in this case is given by the…

Quantum Physics · Physics 2017-12-06 Alexander Müller-Hermes , Daniel Stilck Franca , Michael M. Wolf

We introduce the notion of relative volume entropy for two spacetimes with preferred compact spacelike foliations. This is accomplished by applying the notion of Kullback-Leibler divergence to the volume elements induced on spacelike…

General Relativity and Quantum Cosmology · Physics 2015-11-24 Nikolas Akerblom , Gunther Cornelissen

The sumset and inverse sumset theories of Freiman, Pl\"{u}nnecke and Ruzsa, give bounds connecting the cardinality of the sumset $A+B=\{a+b\;;\;a\in A,\,b\in B\}$ of two discrete sets $A,B$, to the cardinalities (or the finer structure) of…

Information Theory · Computer Science 2015-05-07 Ioannis Kontoyiannis , Mokshay Madiman

The fundamental inequality of Guivarc'h relates the entropy and the drift of random walks on groups. It is strict if and only if the random walk does not behave like the uniform measure on balls. We prove that, in any nonelementary…

Probability · Mathematics 2015-01-22 Sébastien Gouëzel , Frédéric Mathéus , François Maucourant

This paper describes the construction of a lower bound for the tails of general random variables, using solely knowledge of their moment generating function. The tilting procedure used allows for the construction of lower bounds that are…

Probability · Mathematics 2007-06-13 Ted Theodosopoulos

This paper considers the problem of variable-length intrinsic randomness. We propose the average variational distance as the performance criterion from the viewpoint of a dual relationship with the problem formulation of variable-length…

Information Theory · Computer Science 2018-05-04 Jun Yoshizawa , Shota Saito , Toshiyasu Matsushima

We utilize quantum superposition principle to establish the improvable upper and lower bounds on the stronger uncertainty relation, i.e., the "weighted-like" sum of the variances of observables. Our bounds include some free parameters which…

Quantum Physics · Physics 2017-04-17 Jun Zhang , Yang Zhang , Chang-shui Yu

Sensitivity properties describe how changes to the input of a program affect the output, typically by upper bounding the distance between the outputs of two runs by a monotone function of the distance between the corresponding inputs. When…

Logic in Computer Science · Computer Science 2020-08-11 Alejandro Aguirre , Gilles Barthe , Justin Hsu , Benjamin Lucien Kaminski , Joost-Pieter Katoen , Christoph Matheja

We generalize McDiarmid's inequality for functions with bounded differences on a high probability set, using an extension argument. Those functions concentrate around their conditional expectations. We further extend the results to…

Machine Learning · Computer Science 2024-05-03 Richard Combes

In this note, we prove a tight lower bound on the joint entropy of $n$ unbiased Bernoulli random variables which are $n/2$-wise independent. For general $k$-wise independence, we give new lower bounds by adapting Navon and Samorodnitsky's…

Discrete Mathematics · Computer Science 2018-01-16 Amey Bhangale , Aditya Potukuchi

Minimum divergence estimators provide a natural choice of estimators in a statistical inference problem. Different properties of various families of these divergence measures such as Hellinger distance, power divergence, density power…

Statistics Theory · Mathematics 2025-07-08 Subhrajyoty Roy , Supratik Basu , Abhik Ghosh , Ayanendranath Basu

The precise one-shot characterisation of operational tasks in classical and quantum information theory relies on different forms of smooth entropic quantities. A particularly important connection is between the hypothesis testing relative…

Quantum Physics · Physics 2026-04-29 Bartosz Regula , Ludovico Lami , Nilanjana Datta

Many axiomatic definitions of entropy, such as the R\'enyi entropy, of a random variable are closely related to the $\ell_{\alpha}$-norm of its probability distribution. This study considers probability distributions on finite sets, and…

Information Theory · Computer Science 2016-05-06 Yuta Sakai , Ken-ichi Iwata

Uncertain input of a mathematical model induces uncertainties in the output and probabilistic sensitivity analysis identifies the influential inputs to guide decision-making. Of practical concern is the probability that the output would, or…

Information Theory · Computer Science 2022-07-12 Jiannan Yang