English
Related papers

Related papers: Scalable Mutual Information Estimation using Depen…

200 papers

Diffusion bridge models in both continuous and discrete state spaces have recently become powerful tools in the field of generative modeling. In this work, we leverage the discrete state space formulation of bridge matching models to…

Machine Learning · Computer Science 2026-02-10 Iryna Zabarianska , Sergei Kholkin , Grigoriy Ksenofontov , Ivan Butakov , Alexander Korotin

Estimating the Generalization Error (GE) of Deep Neural Networks (DNNs) is an important task that often relies on availability of held-out data. The ability to better predict GE based on a single training set may yield overarching DNN…

Machine Learning · Computer Science 2022-07-20 Angus Galloway , Anna Golubeva , Mahmoud Salem , Mihai Nica , Yani Ioannou , Graham W. Taylor

An important question in statistical network analysis is how to estimate models of discrete and dependent network data with intractable likelihood functions, without sacrificing computational scalability and statistical guarantees. We…

Statistics Theory · Mathematics 2026-03-06 Jonathan R. Stewart , Michael Schweinberger

We propose a direct estimation method for R\'{e}nyi and f-divergence measures based on a new graph theoretical interpretation. Suppose that we are given two sample sets $X$ and $Y$, respectively with $N$ and $M$ samples, where $\eta:=M/N$…

Information Theory · Computer Science 2017-11-22 Morteza Noshad , Kevin R. Moon , Salimeh Yasaei Sekeh , Alfred O. Hero

We study some of the most commonly used mutual information estimators, based on histograms of fixed or adaptive bin size, $k$-nearest neighbors and kernels, and focus on optimal selection of their free parameters. We examine the consistency…

Data Analysis, Statistics and Probability · Physics 2015-05-13 Angeliki Papana , Dimitris Kugiumtzis

Estimating mutual information (MI) between two continuous random variables $X$ and $Y$ allows to capture non-linear dependencies between them, non-parametrically. As such, MI estimation lies at the core of many data science applications.…

Information Theory · Computer Science 2022-01-19 Alexander Marx , Jonas Fischer

Conditional Mutual Information (CMI) is a measure of conditional dependence between random variables X and Y, given another random variable Z. It can be used to quantify conditional dependence among variables in many data-driven inference…

Machine Learning · Computer Science 2019-06-10 Sudipto Mukherjee , Himanshu Asnani , Sreeram Kannan

In this paper, we investigate the problem of learning disentangled representations. Given a pair of images sharing some attributes, we aim to create a low-dimensional representation which is split into two parts: a shared representation…

Machine Learning · Statistics 2019-12-10 Eduardo Hugo Sanchez , Mathieu Serrurier , Mathias Ortner

We introduce a generalized formulation of mutual information (MI) based on the extended Bregman divergence, a framework that subsumes the generalized S-Bregman (GSB) divergence family. The GSB divergence unifies two important classes of…

Methodology · Statistics 2026-02-05 Arijit Pyne

This paper develops a unified estimation framework, the Maximum Ideal Likelihood Estimation (MILE), for general parametric models with latent variables. Unlike traditional approaches relying on the marginal likelihood of the observed data,…

Statistics Theory · Mathematics 2025-10-08 Yizhou Cai , Ting Fung Ma

Sliced Mutual Information (SMI) is widely used as a scalable alternative to mutual information for measuring non-linear statistical dependence. Despite its advantages, such as faster convergence, robustness to high dimensionality, and…

Machine Learning · Computer Science 2025-12-10 Alexander Semenenko , Ivan Butakov , Alexey Frolov , Ivan Oseledets

We propose a fully data-driven approach to designing mutual information (MI) estimators. Since any MI estimator is a function of the observed sample from two random variables, we parameterize this function with a neural network (MIST) and…

Machine Learning · Computer Science 2026-02-24 German Gritsai , Megan Richards , Maxime Méloux , Kyunghyun Cho , Maxime Peyrard

Diffusion bridge models have recently become a powerful tool in the field of generative modeling. In this work, we leverage their power to address another important problem in machine learning and information theory, the estimation of the…

Machine Learning · Computer Science 2026-03-02 Sergei Kholkin , Ivan Butakov , Evgeny Burnaev , Nikita Gushchin , Alexander Korotin

Mutual information (MI) is a general measure of statistical dependence with widespread application across the sciences. However, estimating MI between multi-dimensional variables is challenging because the number of samples necessary to…

Quantitative Methods · Quantitative Biology 2025-03-06 Gokul Gowri , Xiao-Kang Lun , Allon M. Klein , Peng Yin

Graphical model has been widely used to investigate the complex dependence structure of high-dimensional data, and it is common to assume that observed data follow a homogeneous graphical model. However, observations usually come from…

Methodology · Statistics 2016-01-01 Kevin Lee , Lingzhou Xue

Dynamic graphs with ordered sequences of events between nodes are prevalent in real-world industrial applications such as e-commerce and social platforms. However, representation learning for dynamic graphs has posed great computational…

Machine Learning · Computer Science 2021-12-16 Xinshi Chen , Yan Zhu , Haowen Xu , Mengyang Liu , Liang Xiong , Muhan Zhang , Le Song

Computing expected information gain (EIG) from prior to posterior (equivalently, mutual information between candidate observations and model parameters or other quantities of interest) is a fundamental challenge in Bayesian optimal…

Methodology · Statistics 2026-01-30 Fengyi Li , Ricardo Baptista , Youssef Marzouk

We propose to use precise estimators of mutual information (MI) to find least dependent components in a linearly mixed signal. On the one hand this seems to lead to better blind source separation than with any other presently available…

Computational Physics · Physics 2007-07-16 Harald Stögbauer , Alexander Kraskov , Sergey A. Astakhov , Peter Grassberger

Network models are useful tools for modelling complex associations. If a Gaussian graphical model is assumed, conditional independence is determined by the non-zero entries of the inverse covariance (precision) matrix of the data. The…

Methodology · Statistics 2023-04-18 Camilla Lingjærde , Benjamin P. Fairfax , Sylvia Richardson , Hélène Ruffieux

In this paper, we consider distributed maximum likelihood estimation (MLE) with dependent quantized data under the assumption that the structure of the joint probability density function (pdf) is known, but it contains unknown deterministic…

Information Theory · Computer Science 2013-09-17 Xiaojing Shen , Pramod K. Varshney , Yunmin Zhu