English
Related papers

Related papers: Reweighted information inequalities

200 papers

We introduce new classes of informational functionals, called \emph{upper moments}, respectively \emph{down-Fisher measures}, obtained by applying classical functionals such as $p$-moments and the Fisher information to the recently…

Mathematical Physics · Physics 2025-05-28 Razvan Gabriel Iagar , David Puertas-Centeno

We propose new measures of shared information, unique information and synergistic information that can be used to decompose the multi-information of a pair of random variables $(Y,Z)$ with a third random variable $X$. Our measures are…

Information Theory · Computer Science 2014-06-18 Nils Bertschinger , Johannes Rauh , Eckehard Olbrich , Jürgen Jost , Nihat Ay

It is known that a quadratic transportation-information inequality $\mathrm{W_2I}$ interpolates between the Talagrand's inequality $\mathrm{W_2H}$ and the log-Sobolev inequality (LSI for short). The aim of the present paper is threefold:…

Probability · Mathematics 2016-06-08 Yuan Liu

We establish a reversal of Lyapunov's inequality for monotone log-concave sequences, settling a conjecture of Havrilla-Tkocz and Melbourne-Tkocz. A strengthened version of the same conjecture is disproved through counter example. We also…

Information Theory · Computer Science 2021-11-16 James Melbourne , Gerardo Palafox-Castillo

We study here the difference between quantum statistical treatments and semi-classical ones, using as the main research tool a semi-classical, shift-invariant Fisher information measure built up with Husimi distributions. Its semi-classical…

Statistical Mechanics · Physics 2015-06-24 F. Pennini , A. Plastino , G. L. Ferri

HWI inequalities are interpolation inequalities relating entropy, Fisher information and optimal transport distances. We adapt an argument of Y. Wu for proving the Gaussian HWI inequality via a coupling argument to the discrete setting,…

Probability · Mathematics 2023-12-05 Thomas A. Courtade , Max Fathi

Fisher's information measure plays a very important role in diverse areas of theoretical physics. The associated measures as functionals of quantum probability distributions defined in, respectively, coordinate and momentum spaces, are the…

Quantum Physics · Physics 2015-04-20 Angelo Plastino , Guido Bellomo , Angel R. Plastino

Skew-symmetric densities recently received much attention in the literature, giving rise to increasingly general families of univariate and multivariate skewed densities. Most of those families, however, suffer from the inferential drawback…

Statistics Theory · Mathematics 2012-07-03 Marc Hallin , Christophe Ley

The entropy of a pair of random variables is commonly depicted using a Venn diagram. This representation is potentially misleading, however, since the multivariate mutual information can be negative. This paper presents new measures of…

Information Theory · Computer Science 2020-04-22 Conor Finn , Joseph T. Lizier

We propose a new approach to deriving quantitative mean field approximations for any probability measure $P$ on $\mathbb{R}^n$ with density proportional to $e^{f(x)}$, for $f$ strongly concave. We bound the mean field approximation for the…

Probability · Mathematics 2022-06-06 Daniel Lacker , Sumit Mukherjee , Lane Chun Yeung

Inference and learning are commonly cast in terms of optimisation, yet the fundamental constraints governing uncertainty reduction remain unclear. This work presents a first-principles framework inherent to Bayesian updating, termed…

Information Theory · Computer Science 2026-01-22 Takuya Isomura

Partial information decomposition (PID) of the multivariate mutual information describes the distinct ways in which a set of source variables contains information about a target variable. The groundbreaking work of Williams and Beer has…

Information Theory · Computer Science 2021-03-31 Abdullah Makkeh , Aaron J. Gutknecht , Michael Wibral

The conventional formulation of quantum sensing is based on the assumption that the probe is reset to its initial state after each measurement. In a very distinct approach, one can also pursue a sequential measurement scheme in which…

Quantum Physics · Physics 2023-08-08 Yaoling Yang , Victor Montenegro , Abolfazl Bayat

The minimum rate needed to accurately approximate a product distribution based on an unnormalized informational divergence is shown to be a mutual information. This result subsumes results of Wyner on common information and Han-Verd\'{u} on…

Information Theory · Computer Science 2013-05-14 Jie Hou , Gerhard Kramer

We present a logarithmic Sobolev inequality adapted to a log-concave measure. Assume that $\Phi$ is a symmetric convex function on $\dR$ satisfying $(1+\e)\Phi(x)\leq {x}\Phi'(x)\leq(2-\e)\Phi(x)$ for $x\geq0$ large enough and with…

Probability · Mathematics 2007-05-23 Ivan Gentil , Arnaud Guillin , Laurent Miclo

Fisher Information is a key notion in the whole field of quantum metrology. It allows for a direct quantification of maximal achievable precision of estimation of parameters encoded in quantum states using the most general quantum…

Quantum Physics · Physics 2023-04-25 Stanislaw Kurdzialek , Rafal Demkowicz-Dobrzanski

We show that the natural scaling of measurement for a particular problem defines the most likely probability distribution of observations taken from that measurement scale. Our approach extends the method of maximum entropy to use…

Quantitative Methods · Quantitative Biology 2010-03-02 Steven A. Frank , D. Eric Smith

The Fisher's information metric is introduced in order to find the real meaning of the probability distribution in classical and quantum systems described by Riemaniann non-degenerated superspaces. In particular, the physical r\^{o}le…

High Energy Physics - Theory · Physics 2012-12-04 Diego Julio Cirilo-Lombardo , Victor I. Afonso

We introduce a pair of transformations, which are mutually inverse, acting on rather general classes of probability densities in R. These transformations have the property of interchanging the main informational measures such as p-moments,…

Mathematical Physics · Physics 2025-03-19 Razvan Gabriel Iagar , David Puertas-Centeno

Mixture distributions are extensively used as a modeling tool in diverse areas from machine learning to communications engineering to physics, and obtaining bounds on the entropy of probability distributions is of fundamental importance in…

Information Theory · Computer Science 2022-12-05 James Melbourne , Saurav Talukdar , Shreyas Bhaban , Mokshay Madiman , Murti V. Salapaka
‹ Prev 1 4 5 6 7 8 10 Next ›