English
Related papers

Related papers: Functional inequalities for Boolean entropy

200 papers

Shannon information entropy is a natural measure of probability (de)localization and thus (un)predictability in various procedures of data analysis for model systems. We pay particular attention to links between the Shannon entropy and the…

Statistical Mechanics · Physics 2007-05-23 Piotr Garbaczewski

This note presents a method based on Feynman-Kac semigroups for logarithmic Sobolev inequalities. It follows the recent work of Bonnefont and Joulin on intertwining relations for diffusion operators, formerly used for spectral gap…

Functional Analysis · Mathematics 2021-06-09 Clément Steiner

We establish a family of functional inequalities interpolating between the classical logarithmic Sobolev and Poincar\'e inequalities. We prove that they imply the concentration of measure phenomenon intermediate between Gaussian and…

Probability · Mathematics 2015-01-06 Rafał Latała , Krzysztof Oleszkiewicz

Relative Fisher information, also known as score matching, is a recently introduced learning method for parameter estimation. Fundamental relations between relative entropy and score matching have been established in the literature for…

Information Theory · Computer Science 2025-04-29 Yirong Shen , Lu Gan , Cong Ling

In the setting of reversible continuous-time Markov chains, the $CD_\Upsilon$ condition has been shown recently to be a consistent analogue to the Bakry-\'Emery condition in the diffusive setting in terms of proving Li-Yau inequalities…

Probability · Mathematics 2020-10-14 Frederic Weber

We develop a new method for bounding the relative entropy of a random vector in terms of its Stein factors. Our approach is based on a novel representation for the score function of smoothly perturbed random variables, as well as on the de…

Probability · Mathematics 2013-08-20 Ivan Nourdin , Giovanni Peccati , Yvik Swan

The aim of this paper is to discuss new results concerning some kinds of parametric extended entropies and divergences. As a result of our studies for mathematical properties on entropy and divergence, we give new bounds for the Tsallis…

Information Theory · Computer Science 2019-07-24 Shigeru Furuichi , Nicuşor Minculete

Building on the inequalities for homogeneous tetrahedral polynomials in independent Gaussian variables due to R. Lata{\l}a we provide a concentration inequality for non-necessarily Lipschitz functions $f\colon \R^n \to \R$ with bounded…

Probability · Mathematics 2013-04-09 Radosław Adamczak , Paweł Wolff

We prove a stochastic formula for the Gaussian relative entropy in the spirit of Borell's formula for the Laplace transform. As an application, we give unified and short proofs of a number of functional inequalities.

Probability · Mathematics 2011-07-18 Joseph Lehec

A class of distortions termed functional Bregman divergences is defined, which includes squared error and relative entropy. A functional Bregman divergence acts on functions or distributions, and generalizes the standard Bregman divergence…

Information Theory · Computer Science 2007-07-13 B. A. Frigyik , S. Srivastava , M. R. Gupta

We study the formulation of the uncertainty principle in quantum mechanics in terms of entropic inequalities, extending results recently derived by Bialynicki-Birula [1] and Zozor et al. [2]. Those inequalities can be considered as…

Probability · Mathematics 2009-04-14 Steeve Zozor , Mariela Portesi , Christophe Vignat

We examine a hierarchy of equivalence classes of quasi-random properties of Boolean Functions. In particular, we prove an equivalence between a number of properties including balanced influences, spectral discrepancy, local strong…

Combinatorics · Mathematics 2022-09-09 Fan Chung , Nicholas Sieger

Fourier analysis on the discrete hypercubes $\{-1,1\}^n$ has found numerous applications in learning theory. A recent breakthrough involves the use of a classical result from Fourier analysis, the Bohnenblust--Hille inequality, in the…

Functional Analysis · Mathematics 2024-09-18 Haonan Zhang

In the setting of intermittent Pomeau-Manneville maps with time dependent parameters, we show a functional correlation bound widely useful for the analysis of the statistical properties of the model. We give two applications of this result,…

Dynamical Systems · Mathematics 2018-07-05 Juho Leppänen

Discrete convex Sobolev inequalities and Beckner inequalities are derived for time-continuous Markov chains on finite state spaces. Beckner inequalities interpolate between the modified logarithmic Sobolev inequality and the Poincar\'e…

Probability · Mathematics 2016-08-19 Ansgar Jüngel , Wen Yue

IIt is demonstrated that the entropy of statistical mechanics and of information theory, $S({\bf p}) = -\sum p_i \log p_i $ may be viewed as a measure of correlation. Given a probability distribution on two discrete variables, $p_{ij}$, we…

Mathematical Physics · Physics 2007-05-23 John H. Van Drie

We define the pivotal set of a Boolean function and we prove a fundamental inequality on its expected size, when the inputs are independent random coins of parameter~$p$. We give two complete proofs of this inequality. Along the way, we…

Probability · Mathematics 2024-05-31 Raphaël Cerf

We recognise that an entropy inequality akin to the main intermediate goal of recent works (Gowers, Green, Manners, Tao [3],[2]) regarding a conjecture of Marton provides a black box from which we can also through a short deduction recover…

Information Theory · Computer Science 2024-06-18 Thomas Karam

We study the interrelationships between the Fisher information metric recently introduced, on the basis of maximum entropy considerations, by Brody and Hughston (quant-ph/9906085) and the monotone metrics, as explicated by Petz and Sudar.…

Quantum Physics · Physics 2007-05-23 Paul B. Slater

Interpolation inequalities play an essential role in Analysis with fundamental consequences in Mathematical Physics, Nonlinear Partial Differential Equations (PDEs), Markov Processes, etc., and have a wide range of applications in various…

Analysis of PDEs · Mathematics 2021-10-19 Jean Dolbeault