English
Related papers

Related papers: Efficiently Estimating Mutual Information Between …

200 papers

Mutual Information (MI) is a fundamental metric for quantifying dependency between two random variables. When we can access only the samples, but not the underlying distribution functions, we can evaluate MI using sample-based estimators.…

Machine Learning · Statistics 2024-10-16 Kyungeun Lee , Wonjong Rhee

Clustering plays a crucial role in computer science, facilitating data analysis and problem-solving across numerous fields. By partitioning large datasets into meaningful groups, clustering reveals hidden structures and relationships within…

Databases · Computer Science 2026-02-19 Aryan Esmailpour , Stavros Sintos

Learning-based hashing methods are widely used for nearest neighbor retrieval, and recently, online hashing methods have demonstrated good performance-complexity trade-offs by learning hash functions from streaming data. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2017-08-01 Fatih Cakir , Kun He , Sarah Adel Bargal , Stan Sclaroff

Background: Coevolution within a protein family is often predicted using statistics that measure the degree of covariation between positions in the protein sequence. Mutual Information is a measure of dependence between two random variables…

Populations and Evolution · Quantitative Biology 2013-04-17 Russell J. Dickson , Gregory B. Gloor

Mutual information (MI) is a principled and widely used objective for robotic information gathering (RIG), providing strong theoretical guarantees for sensor placement (SP) and informative path planning (IPP). However, its high…

Robotics · Computer Science 2026-02-16 Kalvik Jakkala , Jason O'Kane , Srinivas Akella

Mutual Information (MI) is a crucial measure for capturing dependencies between variables, but exact computation is challenging in high dimensions with intractable likelihoods, impacting accuracy and robustness. One idea is to use an…

Machine Learning · Statistics 2025-03-13 Forough Fazeliasl , Michael Minyi Zhang , Bei Jiang , Linglong Kong

Relation Extraction (RE) from tables is the task of identifying relations between pairs of columns of a table. Generally, RE models for this task require labelled tables for training. These labelled tables can also be generated artificially…

Computation and Language · Computer Science 2021-09-07 Gaurav Singh , Siffi Singh , Joshua Wong , Amir Saffari

Mutual Information (MI) is an useful tool for the recognition of mutual dependence berween data sets. Differen methods for the estimation of MI have been developed when both data sets are discrete or when both data sets are continuous. The…

Applications · Statistics 2017-08-30 Miguel A. Ré , Guillermo G. Aguirre Varela

The mutual information (MI) between two random variables is an important correlation measure in data analysis. The Shannon entropy of a joint probability distribution is the variable part under fixed marginals. We aim to minimize and…

Optimization and Control · Mathematics 2025-09-08 Paula Franke , Kay Hamacher , Paul Manns

Machine learning models depend critically on feature quality, yet useful features are often scattered across multiple relational tables. Feature augmentation enriches a base table by discovering and integrating features from related tables…

Databases · Computer Science 2026-02-03 Serafeim Papadias , Kostas Patroumpas , Dimitrios Skoutas

In this paper, we investigate the problem of learning disentangled representations. Given a pair of images sharing some attributes, we aim to create a low-dimensional representation which is split into two parts: a shared representation…

Machine Learning · Statistics 2019-12-10 Eduardo Hugo Sanchez , Mathieu Serrurier , Mathias Ortner

Open-domain question answering over datalakes requires retrieving and composing information from multiple tables, a challenging subtask that demands semantic relevance and structural coherence (e.g., joinability). While exact optimization…

Information Retrieval · Computer Science 2025-11-18 Allaa Boutaleb , Bernd Amann , Rafael Angarita , Hubert Naacke

A mixed data frame (MDF) is a table collecting categorical, numerical and count observations. The use of MDF is widespread in statistics and the applications are numerous from abundance data in ecology to recommender systems. In many cases,…

Methodology · Statistics 2019-03-27 Geneviève Robin , Olga Klopp , Julie Josse , Éric Moulines , Robert Tibshirani

Mutual information is a widely-used information theoretic measure to quantify the amount of association between variables. It is used extensively in many applications such as image registration, diagnosis of failures in electrical machines,…

Computation · Statistics 2021-08-21 Luai Al-Labadi , Forough Fazeli-Asl , Zahra Saberi

Tables are an extremely powerful visual and interactive tool for structuring and manipulating data, making spreadsheet programs one of the most popular computer applications. In this paper we introduce and address the task of recommending…

Information Retrieval · Computer Science 2019-07-26 Shuo Zhang , Krisztian Balog

As a pivotal task in data lake management, joinable table discovery has attracted widespread interest. While existing language model-based methods achieve remarkable performance by combining offline column representation learning with…

Computation and Language · Computer Science 2026-01-06 Shiyuan Liu , Jianwei Wang , Xuemin Lin , Lu Qin , Wenjie Zhang , Ying Zhang

Estimating mutual information is an important statistics and machine learning problem. To estimate the mutual information from data, a common practice is preparing a set of paired samples $\{(\mathbf{x}_i,\mathbf{y}_i)\}_{i=1}^n…

Machine Learning · Statistics 2024-07-16 Yanbin Liu , Makoto Yamada , Yao-Hung Hubert Tsai , Tam Le , Ruslan Salakhutdinov , Yi Yang

Estimating mutual information accurately is pivotal across diverse applications, from machine learning to communications and biology, enabling us to gain insights into the inner mechanisms of complex systems. Yet, dealing with…

Machine Learning · Computer Science 2024-11-12 Nunzio A. Letizia , Nicola Novello , Andrea M. Tonello

Synthesizing relational data has started to receive more attention from researchers, practitioners, and industry. The task is more difficult than synthesizing a single table due to the added complexity of relationships between tables. For…

Databases · Computer Science 2024-10-07 Valter Hudovernik , Martin Jurkovič , Erik Štrumbelj

Graphical models are widely used to make inferences concerning interplay in multivariate systems. In many applications, data are collected from multiple related but nonidentical units whose underlying networks may differ but are likely to…

Methodology · Statistics 2014-12-04 Chris J. Oates , Jim Korkola , Joe W. Gray , Sach Mukherjee