English
Related papers

Related papers: Identifying bias in cluster quality metrics

200 papers

The clustering of a data set is one of the core tasks in data analytics. Many clustering algorithms exhibit a strong contrast between a favorable performance in practice and bad theoretical worst-cases. Prime examples are least-squares…

Optimization and Control · Mathematics 2018-09-05 S. Borgwardt , F. Happach

This paper investigates two fundamental descriptors of data, i.e., density distribution versus mass distribution, in the context of clustering. Density distribution has been the de facto descriptor of data distribution since the…

Machine Learning · Statistics 2026-01-26 Kai Ming Ting , Ye Zhu , Hang Zhang , Tianrun Liang

In clustering, strong dominance in the size of a particular cluster is often undesirable, motivating a measure of cluster size uniformity that can be used to filter such partitions. A basic requirement of such a measure is stability:…

Machine Learning · Statistics 2026-03-26 Randolph Wiredu-Aidoo

Cluster analysis requires many decisions: the clustering method and the implied reference model, the number of clusters and, often, several hyper-parameters and algorithms' tunings. In practice, one produces several partitions, and a final…

Machine Learning · Statistics 2023-08-14 Luca Coraggio , Pietro Coretto

In cluster analysis, it can be useful to interpret the partition built from the data in the light of external categorical variables which were not directly involved to cluster the data. An approach is proposed in the model-based clustering…

Many networks of interest in the sciences, including a variety of social and biological networks, are found to divide naturally into communities or modules. The problem of detecting and characterizing this community structure has attracted…

Data Analysis, Statistics and Probability · Physics 2007-05-23 M. E. J. Newman

Debiased recommender models have recently attracted increasing attention from the academic and industry communities. Existing models are mostly based on the technique of inverse propensity score (IPS). However, in the recommendation domain,…

Information Retrieval · Computer Science 2022-08-16 Quanyu Dai , Zhenhua Dong , Xu Chen

High-fidelity measurements are important for the physical implementation of quantum information protocols. Current methods for classifying measurement trajectories in superconducting qubit systems produce fidelities that are systematically…

Quantum Physics · Physics 2015-05-27 Easwar Magesan , Jay M. Gambetta , A. D. Córcoles , Jerry M. Chow

Although distance measures are used in many machine learning algorithms, the literature on the context-independent selection and evaluation of distance measures is limited in the sense that prior knowledge is used. In cluster analysis,…

Machine Learning · Computer Science 2021-08-24 Michael C. Thrun

Clustering is a data analysis method for extracting knowledge by discovering groups of data called clusters. Among these methods, state-of-the-art density-based clustering methods have proven to be effective for arbitrary-shaped clusters.…

Machine Learning · Computer Science 2023-10-26 Nabil El Malki , Robin Cugny , Olivier Teste , Franck Ravat

Modularity is one of the most widely used quality measures for graph clusterings. Maximizing modularity is NP-hard, and the runtime of exact algorithms is prohibitive for large graphs. A simple and effective class of heuristics coarsens the…

Data Structures and Algorithms · Computer Science 2009-09-22 Andreas Noack , Randolf Rotta

Identifying clusters of vertices in graphs continues to be an important problem, and modularity continues to be used as a tool for solving the problem. Modularity, which measures the quality of a division of the vertices into clusters,…

Social and Information Networks · Computer Science 2021-09-13 Larry Wilson

It has been hypothesized that some form of "modular" structure in artificial neural networks should be useful for learning, compositionality, and generalization. However, defining and quantifying modularity remains an open problem. We cast…

Machine Learning · Computer Science 2022-06-23 Richard D. Lange , David S. Rolnick , Konrad P. Kording

Promoting fairness for deep clustering models in unsupervised clustering settings to reduce demographic bias is a challenging goal. This is because of the limitation of large-scale balanced data with well-annotated labels for sensitive or…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Xuan-Bac Nguyen , Chi Nhan Duong , Marios Savvides , Kaushik Roy , Hugh Churchill , Khoa Luu

We compare recent approaches to community structure identification in terms of sensitivity and computational cost. The recently proposed modularity measure is revisited and the performance of the methods as applied to ad hoc networks with…

Disordered Systems and Neural Networks · Physics 2007-05-23 Leon Danon , Jordi Duch , Albert Diaz-Guilera , Alex Arenas

Clustering is an essential data mining tool that aims to discover inherent cluster structure in data. For most applications, applying clustering is only appropriate when cluster structure is present. As such, the study of clusterability,…

Machine Learning · Statistics 2018-10-30 A. Adolfsson , M. Ackerman , N. C. Brownstein

The prevalence of algorithmic bias in Machine Learning (ML)-driven approaches has inspired growing research on measuring and mitigating bias in the ML domain. Accordingly, prior research studied how to measure fairness in regression which…

Machine Learning · Computer Science 2025-08-21 Abdalwahab Almajed , Maryam Tabar , Peyman Najafirad

Internal cluster validity measures (such as the Calinski-Harabasz, Dunn, or Davies-Bouldin indices) are frequently used for selecting the appropriate number of partitions a dataset should be split into. In this paper we consider what…

Machine Learning · Statistics 2022-08-31 Marek Gagolewski , Maciej Bartoszuk , Anna Cena

A novel approach rooted on the notion of consensus clustering, a strategy developed for community detection in complex networks, is proposed to cope with the heterogeneity that characterizes connectivity matrices in health and disease. The…

Neurons and Cognition · Quantitative Biology 2017-05-09 Javier Rasero , Mario Pellicoro , Leonardo Angelini , Jesus M. Cortes , Daniele Marinazzo , Sebastiano Stramaglia

Graphs representing real world systems may be studied from their underlying community structure. A community in a network is an intuitive idea for which there is no consensus on its objective mathematical definition. The most used metric in…

Social and Information Networks · Computer Science 2022-06-29 Daniel Gamermann , José Antônio Pellizaro