English
Related papers

Related papers: Mutual Information Estimation via $f$-Divergence a…

200 papers

Feature selection eliminates redundancy among features to improve downstream task performance while reducing computational overhead. Existing methods often struggle to capture intricate feature interactions and adapt across diverse…

Machine Learning · Computer Science 2026-03-02 Rui Liu , Tao Zhe , Yanjie Fu , Feng Xia , Ted Senator , Dongjie Wang

Partial information decomposition (PID) of the multivariate mutual information describes the distinct ways in which a set of source variables contains information about a target variable. The groundbreaking work of Williams and Beer has…

Information Theory · Computer Science 2021-03-31 Abdullah Makkeh , Aaron J. Gutknecht , Michael Wibral

This correspondence studies the basic problem of classifications - how to evaluate different classifiers. Although the conventional performance indexes, such as accuracy, are commonly used in classifier selection or evaluation,…

Machine Learning · Computer Science 2007-11-26 Yong Wang , Bao-Gang Hu

The key challenge in unaligned multimodal language sequences lies in effectively integrating information from various modalities to obtain a refined multimodal joint representation. Recently, the disentangle and fuse methods have achieved…

Computation and Language · Computer Science 2024-09-20 Fan Qian , Jiqing Han , Jianchen Li , Yongjun He , Tieran Zheng , Guibin Zheng

The estimation of an f-divergence between two probability distributions based on samples is a fundamental problem in statistics and machine learning. Most works study this problem under very weak assumptions, in which case it is provably…

Machine Learning · Statistics 2019-10-25 Paul K. Rubenstein , Olivier Bousquet , Josip Djolonga , Carlos Riquelme , Ilya Tolstikhin

Tensor networks have emerged as promising tools for machine learning, inspired by their widespread use as variational ansatze in quantum many-body physics. It is well known that the success of a given tensor network ansatz depends in part…

Quantum Physics · Physics 2022-03-02 Ian Convy , William Huggins , Haoran Liao , K. Birgitta Whaley

The amount of information exchanged per unit of time between two nodes in a dynamical network or between two data sets is a powerful concept for analysing complex systems. This quantity, known as the mutual information rate (MIR), is…

Chaotic Dynamics · Physics 2015-05-27 M. S. Baptista , R. M. Rubinger , E. R. V. Junior , J. C. Sartorelli , U. Parlitz , C. Grebogi

The factor graph (FG) based iterative detection is considered an effective and practical method for multiple-input and multiple-out (MIMO), particularly massive MIMO (m-MIMO) systems. However, the convergence analysis for the FG-based…

Information Theory · Computer Science 2023-07-06 Huan Li , Jingxuan Huang , Zesong Fei

Sliced Mutual Information (SMI) is widely used as a scalable alternative to mutual information for measuring non-linear statistical dependence. Despite its advantages, such as faster convergence, robustness to high dimensionality, and…

Machine Learning · Computer Science 2025-12-10 Alexander Semenenko , Ivan Butakov , Alexey Frolov , Ivan Oseledets

Mutual information $I(X;Y)$ is a useful definition in information theory to estimate how much information the random variable $Y$ holds about the random variable $X$. One way to define the mutual information is by comparing the joint…

Information Theory · Computer Science 2022-04-14 Bulut Kuskonmaz , Jaron Skovsted Gundersen , Rafal Wisniewski

Quantifying the dependence between high-dimensional random variables is central to statistical learning and inference. Two classical methods are canonical correlation analysis (CCA), which identifies maximally correlated projected versions…

Machine Learning · Computer Science 2023-09-29 Dor Tsur , Ziv Goldfeld , Kristjan Greenewald

We introduce a new cost function over experiments, f-information, based on the theory of multivariate statistical divergences, that generalizes Sims's classic model of rational inattention as well as the class of posterior-separable cost…

Theoretical Economics · Economics 2025-10-07 Alex Bloedel , Tommaso Denti , Luciano Pomatto

Providing natural language-based explanations to justify recommendations helps to improve users' satisfaction and gain users' trust. However, as current explanation generation methods are commonly trained with an objective to mimic existing…

Information Retrieval · Computer Science 2024-08-22 Yurou Zhao , Yiding Sun , Ruidong Han , Fei Jiang , Lu Guan , Xiang Li , Wei Lin , Weizhi Ma , Jiaxin Mao

We study the problem of community detection when there is covariate information about the node labels and one observes multiple correlated networks. We provide an asymptotic upper bound on the per-node mutual information as well as a…

Information Theory · Computer Science 2019-12-12 Vaishakhi Mayya , Galen Reeves

As a fundamental concept in information theory, mutual information ($MI$) has been commonly applied to quantify association between random vectors. Most existing nonparametric estimators of $MI$ have unstable statistical performance since…

Applications · Statistics 2025-02-19 Soumik Purkayastha , Peter X. K. Song

Self-supervised sequential recommendation significantly improves recommendation performance by maximizing mutual information with well-designed data augmentations. However, the mutual information estimation is based on the calculation of…

Machine Learning · Computer Science 2023-06-21 Ziwei Fan , Zhiwei Liu , Hao Peng , Philip S Yu

The problem of f-divergence estimation is important in the fields of machine learning, information theory, and statistics. While several nonparametric divergence estimators exist, relatively few have known convergence properties. In…

Information Theory · Computer Science 2015-03-16 Kevin R. Moon , Alfred O. Hero

Mutual information (MI) minimization has gained considerable interests in various machine learning tasks. However, estimating and minimizing MI in high-dimensional spaces remains a challenging problem, especially when only samples, rather…

Machine Learning · Computer Science 2020-07-27 Pengyu Cheng , Weituo Hao , Shuyang Dai , Jiachang Liu , Zhe Gan , Lawrence Carin

The information theoretic quantity known as mutual information finds wide use in classification and community detection analyses to compare two classifications of the same set of objects into groups. In the context of classification…

Social and Information Networks · Computer Science 2020-04-29 M. E. J. Newman , George T. Cantwell , Jean-Gabriel Young

Human decision making can be challenging to predict because decisions are affected by a number of complex factors. Adding to this complexity, decision-making processes can differ considerably between individuals, and methods aimed at…