English
Related papers

Related papers: Generalised Measures of Multivariate Information C…

200 papers

The mutual information between two jointly distributed random variables $X$ and $Y$ is a functional of the joint distribution $P_{XY},$ which is sometimes difficult to handle or estimate. A coarser description of the statistical behavior of…

Information Theory · Computer Science 2016-11-17 Yanjun Han , Or Ordentlich , Ofer Shayevitz

Inspired by works on information transmission through quantum channels, we propose the use of a couple of mutual entropies to quantify the efficiency of continual measurement schemes in extracting information on the measured quantum system.…

Quantum Physics · Physics 2009-10-09 Albert Barchielli , Giancarlo Lupieri

Prediction polling is an increasingly popular form of crowdsourcing in which multiple participants estimate the probability or magnitude of some future event. These estimates are then aggregated into a single forecast. Historically,…

Methodology · Statistics 2016-04-25 Ville A. Satopää , Shane T. Jensen , Robin Pemantle , Lyle H. Ungar

We present simple and computationally efficient nonparametric estimators of R\'enyi entropy and mutual information based on an i.i.d. sample drawn from an unknown, absolutely continuous distribution over $\R^d$. The estimators are…

Machine Learning · Statistics 2010-10-27 Dávid Pál , Barnabás Póczos , Csaba Szepesvári

We define the concept of dependence among multiple variables using maximum entropy techniques and introduce a graphical notation to denote the dependencies. Direct inference of information theoretic quantities from data uncovers…

Quantitative Methods · Quantitative Biology 2007-07-13 Ilya Nemenman

In this paper, we present a new multi-scale information content calculation method based on Shannon information (and Shannon entropy). The original method described by Claude E. Shannon and based on the logarithm of the probability of…

Information Theory · Computer Science 2023-05-23 Zsolt Pocze

The extraction of a physical law y=yo(x) from joint experimental data about x and y is treated. The joint, the marginal and the conditional probability density functions (PDF) are expressed by given data over an estimator whose kernel is…

Data Analysis, Statistics and Probability · Physics 2007-10-10 I. Grabec

Measures of complex network analysis, such as vertex centrality, have the potential to unveil existing network patterns and behaviors. They contribute to the understanding of networks and their components by analyzing their structural…

Social and Information Networks · Computer Science 2018-11-06 Felipe Grando , Diego Noble , Luis C. Lamb

The Shannon entropy, one of the cornerstones of information theory, is widely used in physics, particularly in statistical mechanics. Yet its characterization and connection to physics remain vague, leaving ample room for misconceptions and…

Statistical Mechanics · Physics 2021-07-28 Gabriele Carcassi , Christine A. Aidala , Julian Barbour

The creation of social ties is largely determined by the entangled effects of people's similarities in terms of individual characters and friends. However, feature and structural characters of people usually appear to be correlated, making…

Machine Learning · Computer Science 2019-10-30 Sébastien Lerique , Jacob Levy Abitbol , Márton Karsai

Graph based entropy, an index of the diversity of events in their distribution to parts of a co-occurrence graph, is proposed for detecting signs of structural changes in the data that are informative in explaining latent dynamics of…

Social and Information Networks · Computer Science 2019-05-03 Yukio Ohsawa

Measuring model performance is a key issue for deep learning practitioners. However, we often lack the ability to explain why a specific architecture attains superior predictive accuracy for a given data set. Often, validation accuracy is…

Machine Learning · Computer Science 2022-04-01 Marius C. Landverk , Signe Riemer-Sørensen

Stimulated by the need of describing useful notions related to information measures, we introduce the `pdf-related distributions'. These are defined in terms of transformation of absolutely continuous random variables through their own…

Probability · Mathematics 2024-05-02 Antonio Di Crescenzo , Luca Paolillo , Alfonso Suarez-Llorens

Conditional mutual information is important in the selection and interpretation of graphical models. Its empirical version is well known as a generalised likelihood ratio test and that it may be represented as a difference in entropy. We…

Methodology · Statistics 2015-01-20 Joe Whittaker , Florian Martin , Yang Xiang

Knowledge graphs play a central role for linking different data which leads to multiple layers. Thus, they are widely used in big data integration, especially for connecting data from different domains. Few studies have investigated the…

Social and Information Networks · Computer Science 2022-03-18 Jens Dörpinghaus , Vera Weil , Carsten Düing , Martin W. Sommer

This paper proposes a general multiple imputation approach for analyzing large-scale data with missing values. An imputation model is derived from a joint distribution induced by a latent variable model, which can flexibly capture…

Methodology · Statistics 2025-09-26 Siliang Zhang , Yunxiao Chen , Jouni Kuha

Heisenberg's uncertainty principle has recently led to general measurement uncertainty relations for quantum systems: incompatible observables can be measured jointly or in sequence only with some unavoidable approximation, which can be…

Quantum Physics · Physics 2017-06-27 Alberto Barchielli , Matteo Gregoratti , Alessandro Toigo

Quantifying the complexity of large graphs requires measures that extend beyond predefined structural features and scale efficiently with graph size. This work adopts a generative perspective, modeling large networks as exchangeable graphs…

Information Theory · Computer Science 2025-03-14 Anda Skeja , Sofia C. Olhede

The region of entropic vectors is a convex cone that has been shown to be at the core of many fundamental limits for problems in multiterminal data compression, network coding, and multimedia transmission. This cone has been shown to be…

Information Theory · Computer Science 2015-12-11 Yunshu Liu , John MacLaren Walsh

We review with a tutorial scope the information theory foundations of quantum statistical physics. Only a small proportion of the variables that characterize a system at the microscopic scale can be controlled, for both practical and…

Statistical Mechanics · Physics 2007-05-23 R. Balian