English
Related papers

Related papers: Comment on "Improved mutual information measure fo…

200 papers

Evaluating clustering quality with reliable evaluation metrics like normalized mutual information (NMI) requires labeled data that can be expensive to annotate. We focus on the underexplored problem of estimating clustering quality with…

Machine Learning · Computer Science 2022-10-04 Nihal V. Nayak , Ethan R. Elenberg , Clemens Rosenbaum

Semi-supervised clustering aims to introduce prior knowledge in the decision process of a clustering algorithm. In this paper, we propose a novel semi-supervised clustering algorithm based on the information-maximization principle. The…

Machine Learning · Computer Science 2013-05-02 Daniele Calandriello , Gang Niu , Masashi Sugiyama

Model-based clustering is a powerful tool that is often used to discover hidden structure in data by grouping observational units that exhibit similar response values. Recently, clustering methods have been developed that permit…

Methodology · Statistics 2025-06-24 Sally Paganin , Garritt L. Page , Fernando Andrés Quintana

We use a well known model (T. Vicsek et al. Phys Rev Lett 15, 1226 (1995)) for flocking to test mutual information as a tool for detecting order-disorder transitions, in particular when observations of the system are limited. We show that…

Data Analysis, Statistics and Probability · Physics 2009-11-13 R. T. Wicks , S. C. Chapman , R. O. Dendy

Fields like public health, public policy, and social science often want to quantify the degree of dependence between variables whose relationships take on unknown functional forms. Typically, in fact, researchers in these fields are…

Statistics Theory · Mathematics 2019-12-10 Octavio César Mesner , Cosma Rohilla Shalizi

Debiased recommender models have recently attracted increasing attention from the academic and industry communities. Existing models are mostly based on the technique of inverse propensity score (IPS). However, in the recommendation domain,…

Information Retrieval · Computer Science 2022-08-16 Quanyu Dai , Zhenhua Dong , Xu Chen

Feature selection aims to select the smallest feature subset that yields the minimum generalization error. In the rich literature in feature selection, information theory-based approaches seek a subset of features such that the mutual…

Computer Vision and Pattern Recognition · Computer Science 2019-01-30 Shujian Yu , Jose C. Principe

As a fundamental concept in information theory, mutual information ($MI$) has been commonly applied to quantify association between random vectors. Most existing nonparametric estimators of $MI$ have unstable statistical performance since…

Applications · Statistics 2025-02-19 Soumik Purkayastha , Peter X. K. Song

Gathering the most information by picking the least amount of data is a common task in experimental design or when exploring an unknown environment in reinforcement learning and robotics. A widely used measure for quantifying the…

Machine Learning · Statistics 2015-09-17 Johannes Kulick , Robert Lieck , Marc Toussaint

Many recent methods for unsupervised or self-supervised representation learning train feature extractors by maximizing an estimate of the mutual information (MI) between different views of the data. This comes with several immediate…

Machine Learning · Computer Science 2020-01-24 Michael Tschannen , Josip Djolonga , Paul K. Rubenstein , Sylvain Gelly , Mario Lucic

Although there is growing interest in measuring integrated information in computational and cognitive systems, current methods for doing so in practice are computationally unfeasible. Existing and novel integration measures are investigated…

Neurons and Cognition · Quantitative Biology 2017-02-08 Max Tegmark

The presence of mutual information in the research of deep learning has grown significantly. It has been proven that mutual information can be a good objective function to build a robust deep learning model. Most of the researches utilize…

Information Theory · Computer Science 2021-06-29 Marshal Arijona Sinaga

The clustering ensemble technique aims to combine multiple clusterings into a probably better and more robust clustering and has been receiving an increasing attention in recent years. There are mainly two aspects of limitations in the…

Machine Learning · Statistics 2016-06-06 Dong Huang , Jian-Huang Lai , Chang-Dong Wang

Mutual information is fundamentally important for measuring statistical dependence between variables and for quantifying information transfer by signaling and communication mechanisms. It can, however, be challenging to evaluate for…

Information Theory · Computer Science 2014-07-29 Clive G. Bowsher , Margaritis Voliotis

Community detection, which focuses on clustering nodes or detecting communities in (mostly) a single network, is a problem of considerable practical interest and has received a great deal of attention in the research community. While being…

Machine Learning · Statistics 2017-11-07 Soumendu Sundar Mukherjee , Purnamrita Sarkar , Lizhen Lin

This paper proposes a new paradigm and computational framework for identification of correspondences between sub-structures of distinct composite systems. For this, we define and investigate a variant of traditional data clustering, termed…

Machine Learning · Computer Science 2007-05-23 Zvika Marx , Ido Dagan , Joachim Buhmann

Community detection in graphs is crucial for understanding the organization of nodes into densely connected clusters. While numerous strategies have been developed to identify these clusters, the success of community detection can lead to…

Social and Information Networks · Computer Science 2025-09-03 Junyuan Fang , Huimin Liu , Yueqi Peng , Jiajing Wu , Zibin Zheng , Chi K. Tse

We study the problem of graph partitioning, or clustering, in sparse networks with prior information about the clusters. Specifically, we assume that for a fraction $\rho$ of the nodes their true cluster assignments are known in advance.…

Physics and Society · Physics 2010-10-06 Armen E. Allahverdyan , Greg Ver Steeg , Aram Galstyan

Recent methods for learning unsupervised visual representations, dubbed contrastive learning, optimize the noise-contrastive estimation (NCE) bound on mutual information between two views of an image. NCE uses randomly sampled negative…

Machine Learning · Computer Science 2020-10-06 Mike Wu , Milan Mosse , Chengxu Zhuang , Daniel Yamins , Noah Goodman

Meme clustering is critical for toxicity detection, virality modeling, and typing, but it has received little attention in previous research. Clustering similar Internet memes is challenging due to their multimodality, cultural context, and…

Computation and Language · Computer Science 2025-05-05 Tygo Bloem , Filip Ilievski