English
Related papers

Related papers: Normalized mutual information is a biased measure …

200 papers

Clustering is a concept used in a huge variety of applications. We review a conceptually very simple algorithm for hierarchical clustering called in the following the {\it mutual information clustering} (MIC) algorithm. It uses mutual…

Quantitative Methods · Quantitative Biology 2008-09-10 Alexander Kraskov , Peter Grassberger

Meta-learning, or "learning to learn", refers to techniques that infer an inductive bias from data corresponding to multiple related tasks with the goal of improving the sample efficiency for new, previously unobserved, tasks. A key…

Machine Learning · Computer Science 2021-02-24 Sharu Theresa Jose , Osvaldo Simeone

We address the practical problems of estimating the information relations that characterize large networks. Building on methods developed for analysis of the neural code, we show that reliable estimates of mutual information can be obtained…

Information Theory · Computer Science 2007-07-13 Noam Slonim , Gurinder S. Atwal , Gasper Tkacik , William Bialek

We consider the problem of decomposing the total mutual information conveyed by a pair of predictor random variables about a target random variable into redundant, unique and synergistic contributions. We focus on the relationship between…

Information Theory · Computer Science 2015-09-15 Pradeep Kr. Banerjee , Virgil Griffith

We study the utility of social learning in a distributed detection model with agents sharing the same goal: a collective decision that optimizes an agreed upon criterion. We show that social learning is helpful in some cases but is provably…

Information Theory · Computer Science 2015-03-24 Joong Bum Rhim , Vivek K Goyal

Recommender systems learn from historical users' feedback that is often non-uniformly distributed across items. As a consequence, these systems may end up suggesting popular items more than niche items progressively, even when the latter…

Information Retrieval · Computer Science 2020-10-06 Ludovico Boratto , Gianni Fenu , Mirko Marras

Mutual information has many applications in image alignment and matching, mainly due to its ability to measure the statistical dependence between two images, even if the two images are from different modalities (e.g., CT and MRI). It…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Jiecheng Liao , Junhao Lu , Jeff Ji , Jiacheng He

The flow of information reaching us via the online media platforms is optimized not by the information content or relevance but by popularity and proximity to the target. This is typically performed in order to maximise platform usage. As a…

Physics and Society · Physics 2019-06-19 Alina Sîrbu , Dino Pedreschi , Fosca Giannotti , János Kertész

When machine-learning algorithms are used in high-stakes decisions, we want to ensure that their deployment leads to fair and equitable outcomes. This concern has motivated a fast-growing literature that focuses on diagnosing and addressing…

Computers and Society · Computer Science 2023-09-26 Talia Gillis , Bryce McLaughlin , Jann Spiess

Decades of research suggest that information exchange in groups and organizations can reliably improve judgment accuracy in tasks such as financial forecasting, market research, and medical decision-making. However, we show that improving…

General Economics · Economics 2021-04-26 Joshua Becker , Douglas Guilbeault , Ned Smith

Tensor networks have emerged as promising tools for machine learning, inspired by their widespread use as variational ansatze in quantum many-body physics. It is well known that the success of a given tensor network ansatz depends in part…

Quantum Physics · Physics 2022-03-02 Ian Convy , William Huggins , Haoran Liao , K. Birgitta Whaley

Our consumption of online information is mediated by filtering, ranking, and recommendation algorithms that introduce unintentional biases as they attempt to deliver relevant and engaging content. It has been suggested that our reliance on…

Social and Information Networks · Computer Science 2020-10-07 Dimitar Nikolov , Mounia Lalmas , Alessandro Flammini , Filippo Menczer

The aim of this work is to provide bounds connecting two probability measures of the same event using R\'enyi $\alpha$-Divergences and Sibson's $\alpha$-Mutual Information, a generalization of respectively the Kullback-Leibler Divergence…

Information Theory · Computer Science 2020-01-20 Amedeo Roberto Esposito , Michael Gastpar , Ibrahim Issa

We consider the problem of recovering the community structure in the stochastic block model with two communities. We aim to describe the mutual information between the observed network and the actual community structure in the sparse…

Probability · Mathematics 2023-08-30 Tomas Dominguez , Jean-Christophe Mourrat

Information-maximization clustering learns a probabilistic classifier in an unsupervised manner so that mutual information between feature vectors and cluster assignments is maximized. A notable advantage of this approach is that it only…

Machine Learning · Statistics 2011-12-06 Masashi Sugiyama , Makoto Yamada , Manabu Kimura , Hirotaka Hachiya

The concepts of conditional mutual information (CMI) and normalized conditional mutual information (NCMI) are introduced to measure the concentration and separation performance of a classification deep neural network (DNN) in the output…

Machine Learning · Computer Science 2023-09-19 En-Hui Yang , Shayan Mohajer Hamidi , Linfeng Ye , Renhao Tan , Beverly Yang

Testing hypothesis of independence between two random elements on a joint alphabet is a fundamental exercise in statistics. Pearson's chi-squared test is an effective test for such a situation when the contingency table is relatively small.…

Statistics Theory · Mathematics 2025-03-19 Jialin Zhang , Zhiyi Zhang

An information-theoretic upper bound on the generalization error of supervised learning algorithms is derived. The bound is constructed in terms of the mutual information between each individual training sample and the output of the…

Machine Learning · Computer Science 2020-08-06 Yuheng Bu , Shaofeng Zou , Venugopal V. Veeravalli

A game is introduced to study the effect of privacy in strategic communication between well-informed senders and a receiver. The receiver wants to accurately estimate a random variable. The sender, however, wants to communicate a message…

Computer Science and Game Theory · Computer Science 2015-09-21 Farhad Farokhi , Girish Nair

The key distinguishing property of a Bayesian approach is marginalization, rather than using a single setting of weights. Bayesian marginalization can particularly improve the accuracy and calibration of modern deep neural networks, which…

Machine Learning · Computer Science 2022-03-31 Andrew Gordon Wilson , Pavel Izmailov