English
Related papers

Related papers: Equitability, mutual information, and the maximal …

200 papers

In this work we present a new method for the estimation of Mutual Information (MI) between random variables. Our approach is based on an original interpretation of the Girsanov theorem, which allows us to use score-based diffusion models to…

Machine Learning · Computer Science 2024-05-16 Giulio Franzese , Mustapha Bounoua , Pietro Michiardi

Given the increasing popularity of algorithms for overlapping clustering, in particular in social network analysis, quantitative measures are needed to measure the accuracy of a method. Given a set of true clusters, and the set of clusters…

Physics and Society · Physics 2013-08-05 Aaron F. McDaid , Derek Greene , Neil Hurley

The estimation of mutual information (MI) or conditional mutual information (CMI) from a set of samples is a long-standing problem. A recent line of work in this area has leveraged the approximation power of artificial neural networks and…

Information Theory · Computer Science 2021-10-27 Sina Molavipour , Germán Bassi , Mikael Skoglund

We address the practical problems of estimating the information relations that characterize large networks. Building on methods developed for analysis of the neural code, we show that reliable estimates of mutual information can be obtained…

Information Theory · Computer Science 2007-07-13 Noam Slonim , Gurinder S. Atwal , Gasper Tkacik , William Bialek

Dynamic feature selection, where we sequentially query features to make accurate predictions with a minimal budget, is a promising paradigm to reduce feature acquisition costs and provide transparency into a model's predictions. The problem…

Machine Learning · Computer Science 2024-09-10 Soham Gadgil , Ian Covert , Su-In Lee

We correct claims about lower bounds on mutual information (MI) between real-valued random variables made in A. Kraskov {\it et al.}, Phys. Rev. E {\bf 69}, 066138 (2004). We show that non-trivial lower bounds on MI in terms of linear…

Data Analysis, Statistics and Probability · Physics 2013-05-29 David V. Foster , Peter Grassberger

In the framework of mutually unbiased bases (MUBs), a measurement in one basis gives \emph{no information} about the outcomes of measurements in another basis. Here, we relax the no-information condition by allowing the $d$ outcomes to be…

Quantum Physics · Physics 2025-12-18 Seyed Javad Akhtarshenas , Saman Karimi , Mahdi Salehi

Estimating mutual correlations between random variables or data streams is essential for intelligent behavior and decision-making. As a fundamental quantity for measuring statistical relationships, mutual information has been extensively…

Information Theory · Computer Science 2024-02-16 Zhengyang Hu , Song Kang , Qunsong Zeng , Kaibin Huang , Yanchao Yang

We propose a new framework for reasoning about information in complex systems. Our foundation is based on a variational extension of Shannon's information theory that takes into account the modeling power and computational constraints of…

Machine Learning · Computer Science 2020-02-26 Yilun Xu , Shengjia Zhao , Jiaming Song , Russell Stewart , Stefano Ermon

Efficient information processing is crucial for both living organisms and engineered systems. The mutual information rate, a core concept of information theory, quantifies the amount of information shared between the trajectories of input…

Molecular Networks · Quantitative Biology 2025-09-01 Manuel Reinhardt , Age J. Tjalma , Anne-Lena Moor , Christoph Zechner , Pieter Rein ten Wolde

The uncertainty principle bounds the uncertainties about incompatible measurements, clearly setting quantum theory apart from the classical world. Its mathematical formulation via uncertainty relations, plays an irreplaceable role in…

Quantum Physics · Physics 2019-08-22 Yunlong Xiao , Kun Fang , Gilad Gour

The use of Mutual Information (MI) as a measure to evaluate the efficiency of cryptosystems has an extensive history. However, estimating MI between unknown random variables in a high-dimensional space is challenging. Recent advances in…

Certifying maximal quantum randomness without assumptions about system dimension remains a pivotal challenge for secure communication and foundational studies. Here, we introduce a generalized framework to directly certify maximal…

Quantum Physics · Physics 2025-07-15 Tianqi Zheng , Yi Li , Yu Xiang , Qiongyi He

Comparing the top $k$ elements between two or more ranked results is a common task in many contexts and settings. A few measures have been proposed to compare top $k$ lists with attractive mathematical properties, but they face a number of…

Information Theory · Computer Science 2013-10-02 Arun Konagurthu , James Collier

We define Persistent Mutual Information (PMI) as the Mutual (Shannon) Information between the past history of a system and its evolution significantly later in the future. This quantifies how much past observations enable long term…

Adaptation and Self-Organizing Systems · Physics 2015-03-13 R. C. Ball , M. Diakonova , R. S. MacKay

Since its inception, the neural estimation of mutual information (MI) has demonstrated the empirical success of modeling expected dependency between high-dimensional random variables. However, MI is an aggregate statistic and cannot be used…

Machine Learning · Computer Science 2020-10-16 Yao-Hung Hubert Tsai , Han Zhao , Makoto Yamada , Louis-Philippe Morency , Ruslan Salakhutdinov

We argue that the estimation of mutual information between high dimensional continuous random variables can be achieved by gradient descent over neural networks. We present a Mutual Information Neural Estimator (MINE) that is linearly…

With the success of self-supervised representations, researchers seek a better understanding of the information encapsulated within a representation. Among various interpretability methods, we focus on classification-based linear probing.…

Information Theory · Computer Science 2023-12-18 Kwanghee Choi , Jee-weon Jung , Shinji Watanabe

A novel measure, quantumness of correlations is introduced here for bipartite states, by incorporating the required measurement scheme crucial in defining any such quantity. Quantumness coincides with the previously proposed measures in…

Quantum Physics · Physics 2008-04-20 A. R. Usha Devi , A. K. Rajagopal

Background: Alignment of biological sequences such as DNA, RNA or proteins is one of the most widely used tools in computational bioscience. All existing alignment algorithms rely on heuristic scoring schemes based on biological expertise.…

Genomics · Quantitative Biology 2008-10-27 Orion Penner , Peter Grassberger , Maya Paczuski