English
Related papers

Related papers: Information Theoretical Estimators Toolbox

200 papers

Mutual information is a general statistical dependency measure which has found applications in representation learning, causality, domain generalization and computational biology. However, mutual information estimators are typically…

Machine Learning · Statistics 2023-10-17 Paweł Czyż , Frederic Grabowski , Julia E. Vogt , Niko Beerenwinkel , Alexander Marx

In a feedforward network, Transfer Entropy (TE) can be used to measure the influence that one layer has on another by quantifying the information transfer between them during training. According to the Information Bottleneck principle, a…

Machine Learning · Computer Science 2024-04-03 Adrian Moldovan , Angel Cataron , Razvan Andonie

Missing values are a major challenge in most data science projects working on real data. To avoid losing valuable information, imputation methods are used to fill in missing values with estimates, allowing the preservation of samples or…

Machine Learning · Computer Science 2024-07-17 Pedro Pons-Suñer , Laura Arnal , J. Ramón Navarro-Cerdán , François Signol

Information theory has been taken as a prospective tool for quantifying the complexity of complex networks. In this paper, we first study the information entropy or uncertainty of a path using the information theory. Then we apply the path…

Physics and Society · Physics 2016-05-04 Zhongqi Xu , Cunlai Pu , Jian Yang

Kernel methods form a theoretically-grounded, powerful and versatile framework to solve nonlinear problems in signal processing and machine learning. The standard approach relies on the \emph{kernel trick} to perform pairwise evaluations of…

Machine Learning · Computer Science 2020-01-03 Kan Li , Jose C. Principe

Integrated Information Theory (IIT) is a prominent theory of consciousness that has at its centre measures that quantify the extent to which a system generates more information than the sum of its parts. While several candidate measures of…

Neurons and Cognition · Quantitative Biology 2019-01-30 Pedro A. M. Mediano , Anil K. Seth , Adam B. Barrett

We argue that the estimation of mutual information between high dimensional continuous random variables can be achieved by gradient descent over neural networks. We present a Mutual Information Neural Estimator (MINE) that is linearly…

Machine learning can help personalized decision support by learning models to predict individual treatment effects (ITE). This work studies the reliability of prediction-based decision-making in a task of deciding which action $a$ to take…

Machine Learning · Statistics 2019-06-07 Iiris Sundin , Peter Schulam , Eero Siivola , Aki Vehtari , Suchi Saria , Samuel Kaski

Estimating mutual information (MI) is a fundamental task in data science and machine learning. Existing estimators mainly rely on either highly flexible models (e.g., neural networks), which require large amounts of data, or overly…

Machine Learning · Computer Science 2025-10-27 Yanzhi Chen , Zijing Ou , Adrian Weller , Michael U. Gutmann

We propose Partially Interpretable Estimators (PIE) which attribute a prediction to individual features via an interpretable model, while a (possibly) small part of the PIE prediction is attributed to the interaction of features via a…

Machine Learning · Computer Science 2021-05-07 Tong Wang , Jingyi Yang , Yunyi Li , Boxiang Wang

Diffusion bridge models have recently become a powerful tool in the field of generative modeling. In this work, we leverage their power to address another important problem in machine learning and information theory, the estimation of the…

Machine Learning · Computer Science 2026-03-02 Sergei Kholkin , Ivan Butakov , Evgeny Burnaev , Nikita Gushchin , Alexander Korotin

In this article, we propose a novel probabilistic framework to improve the accuracy of a weighted majority voting algorithm. In order to assign higher weights to the classifiers which can correctly classify hard-to-classify instances, we…

Machine Learning · Statistics 2019-11-13 Ziheng Chen , Hongshik Ahn

Despite the popularity of information measures in analysis of probabilistic systems, proper tools for their visualization are not common. This work develops a simple matrix representation of information transfer in sequential systems,…

Information Theory · Computer Science 2024-05-28 Dor Tsur , Haim Permuter

There is intense interest in applying machine learning to problems of causal inference in fields such as healthcare, economics and education. In particular, individual-level causal inference has important applications such as precision…

Machine Learning · Statistics 2017-05-17 Uri Shalit , Fredrik D. Johansson , David Sontag

Measuring Mutual Information (MI) between high-dimensional, continuous, random variables from observed samples has wide theoretical and practical applications. Recent work, MINE (Belghazi et al. 2018), focused on estimating tight…

Machine Learning · Computer Science 2019-05-28 Xiao Lin , Indranil Sur , Samuel A. Nastase , Ajay Divakaran , Uri Hasson , Mohamed R. Amer

Estimating mutual information from observed samples is a basic primitive, useful in several machine learning tasks including correlation mining, information bottleneck clustering, learning a Chow-Liu tree, and conditional independence…

Information Theory · Computer Science 2018-10-11 Weihao Gao , Sreeram Kannan , Sewoong Oh , Pramod Viswanath

The theoretical properties of active inference agents are impressive, but how do we realize effective agents in working hardware and software on edge devices? This is an interesting problem because the computational load for policy…

Machine Learning · Statistics 2023-07-27 Bert de Vries

In this paper, an open-source MATLAB toolbox is presented that is able to generate synthetic, combined transmission and distribution network models. These can be used to analyse the interactions between transmission and multiple…

Systems and Control · Computer Science 2017-11-15 Nicolas Pilatte , Petros Aristidou , Gabriela Hug

Loss functions play a crucial role in deep metric learning thus a variety of them have been proposed. Some supervise the learning process by pairwise or tripletwise similarity constraints while others take advantage of structured similarity…

Machine Learning · Computer Science 2019-11-25 Xinshao Wang , Elyor Kodirov , Yang Hua , Neil Robertson

The Mutual Information (MI) is an often used measure of dependency between two random variables utilized in information theory, statistics and machine learning. Recently several MI estimators have been proposed that can achieve parametric…

Information Theory · Computer Science 2018-11-26 Morteza Noshad , Yu Zeng , Alfred O. Hero