English
Related papers

Related papers: Rigid characterizations of probability measures th…

200 papers

We study the Lp-integrated risk of some classical estimators of the density, when the observations are drawn from a strictly stationary sequence. The results apply to a large class of sequences, which can be non-mixing in the sense of…

Statistics Theory · Mathematics 2016-05-18 Jérôme Dedecker , Florence Merlevède

Brascamp-Lieb inequalities are entropy inequalities which have a dual formulation as generalized Young inequalities. In this work, we introduce a fully quantum version of this duality, relating quantum relative entropy inequalities to…

Quantum Physics · Physics 2023-03-17 Mario Berta , David Sutter , Michael Walter

Statistical mechanics relies on the complete though probabilistic description of a system in terms of all the microscopic variables. Its object is to derive therefrom static and dynamic properties involving some reduced set of variables.…

Statistical Mechanics · Physics 2009-10-31 R. Balian

Formalising the confrontation of opinions (models) to observations (data) is the task of Inferential Statistics. Information Theory provides us with a basic functional, the relative entropy (or Kullback-Leibler divergence), an asymmetrical…

Information Theory · Computer Science 2015-03-13 François Bavaud

We introduce an independence criterion based on entropy regularized optimal transport. Our criterion can be used to test for independence between two samples. We establish non-asymptotic bounds for our test statistic and study its…

Machine Learning · Statistics 2022-04-21 Lang Liu , Soumik Pal , Zaid Harchaoui

Conditional independence and Markov properties are powerful tools allowing expression of multidimensional probability distributions by means of low-dimensional ones. As multidimensional possibilistic models have been studied for several…

Artificial Intelligence · Computer Science 2013-01-18 Jirina Vejnarova

Measuring dependence between random variables is a fundamental problem in Statistics, with applications across diverse fields. While classical measures such as Pearson's correlation have been widely used for over a century, they have…

Statistics Theory · Mathematics 2025-10-08 Marta Catalano , Hugo Lavenant

The use of Bell's theorem in any application or experiment relies on the assumption of free choice or, more precisely, measurement independence, meaning that the measurements can be chosen freely. Here, we prove that even in the simplest…

Quantum Physics · Physics 2016-11-25 Gilles Pütz , Denis Rosset , Tomer Jack Barnea , Yeong-Cherng Liang , Nicolas Gisin

A new combinatorial-probabilistic diagnostic entropy has been introduced. It describes the pair-wise sum of probabilities of system conditions that have to be distinguished during the diagnosing process. The proposed measure describes the…

Information Theory · Computer Science 2009-09-29 Henryk Borowczyk

The concepts of variability and uncertainty, both epistemic and alleatory, came from experience and coexist with different connotations. Therefore this article attempts to express their relation by analytic means firstly setting sights on…

Other Statistics · Statistics 2013-01-15 Kalman Ziha

A probability measure is a characteristic measure of a topological dynamical system if it is invariant to the automorphism group of the system. We show that zero entropy shifts always admit characteristic measures. We use similar techniques…

Dynamical Systems · Mathematics 2021-07-01 Joshua Frisch , Omer Tamuz

This thesis develops a new divergence that generalizes relative entropy and can be used to compare probability measures without a requirement of absolute continuity. We establish properties of the divergence, and in particular derive and…

Probability · Mathematics 2020-11-18 Yixiang Mao

The paper deals with conditional linear information inequalities valid for entropy functions induced by discrete random variables. Specifically, the so-called conditional Ingleton inequalities are in the center of interest: these are valid…

Information Theory · Computer Science 2022-03-16 Milan Studeny

Motivated by applications to goodness of fit testing, the empirical likelihood approach is generalized to allow for the number of constraints to grow with the sample size and for the constraints to use estimated criteria functions. The…

Statistics Theory · Mathematics 2013-07-24 Hanxiang Peng , Anton Schick

Testing for association or dependence between pairs of random variables is a fundamental problem in statistics. In some applications, data are subject to selection bias that causes dependence between observations even when it is absent from…

Methodology · Statistics 2020-10-13 Yaniv Tenzer , Micha Mandel , Or Zuk

We study stability issues for the so-called Borell-Brascamp-Lieb inequalities, proving that when near equality is realized, the involved functions must be $L^1$-close to be $p$-concave and to coincide up to homotheties of their graphs.

Functional Analysis · Mathematics 2017-02-01 Andrea Rossi , Paolo Salani

Finding interdependency relations between (possibly multivariate) time series provides valuable knowledge about the processes that generate the signals. Information theory sets a natural framework for non-parametric measures of several…

Information Theory · Computer Science 2016-02-09 German Gomez-Herrero , Wei Wu , Kalle Rutanen , Miguel C. Soriano , Gordon Pipa , Raul Vicente

We prove, using the Brascamp-Lieb inequality, that the Gaussian measure is the only strong log-concave measure having a strong log-concavity parameter equal to its covariance matrix. We also give a similar characterization of the Poisson…

Probability · Mathematics 2019-05-09 Erwan Hillion , Oliver Johnson , Adrien Saumard

Recently a class of generalized information measures was defined on sets of items parametrized by submodular functions. In this paper, we propose and study various notions of independence between sets with respect to such information…

Information Theory · Computer Science 2021-08-21 Himanshu Asnani , Jeff Bilmes , Rishabh Iyer

We consider testing marginal independence versus conditional independence in a trivariate Gaussian setting. The two models are non-nested and their intersection is a union of two marginal independences. We consider two sequences of such…

Statistics Theory · Mathematics 2020-10-23 F. Richard Guo , Thomas S. Richardson