English
Related papers

Related papers: Clusterability test for categorical data

200 papers

Motivation: Combining the results of different experiments to exhibit complex patterns or to improve statistical power is a typical aim of data integration. The starting point of the statistical analysis often comes as sets of p-values…

Methodology · Statistics 2021-12-02 Tristan Mary-Huard , Sarmistha Das , Indranil Mukhopadhyay , Stéphane Robin

A clustering is an implicit assignment of labels of points, based on proximity to other points. It is these labels that are then used for downstream analysis (either focusing on individual clusters, or identifying representatives of…

Machine Learning · Computer Science 2013-05-22 Parasaran Raman , Suresh Venkatasubramanian

Inferring cluster structure in microarray datasets is a fundamental task for the -omic sciences. A fundamental question in Statistics, Data Analysis and Classification, is the prediction of the number of clusters in a dataset, usually…

Data Structures and Algorithms · Computer Science 2011-02-16 Filippo Utro

Standard conformal prediction methods provide a marginal coverage guarantee, which means that for a random test point, the conformal prediction set contains the true label with a user-specified probability. In many classification problems,…

Clustering methods have led to a number of important discoveries in bioinformatics and beyond. A major challenge in their use is determining which clusters represent important underlying structure, as opposed to spurious sampling artifacts.…

Methodology · Statistics 2021-10-20 Hanwen Huang , Yufeng Liu , Ming Yuan , J. S. Marron

Multi-sensor data that track system operating behaviors are widely available nowadays from various engineering systems. Measurements from each sensor over time form a curve and can be viewed as functional data. Clustering of these…

Methodology · Statistics 2024-01-08 Zhongnan Jin , Jie Min , Yili Hong , Pang Du , Qingyu Yang

Time series clustering promises to uncover hidden structural patterns in data with applications across healthcare, finance, industrial systems, and other critical domains. However, without validated ground truth information, researchers…

Machine Learning · Computer Science 2025-05-21 Isabella Degen , Zahraa S Abdallah , Henry W J Reeve , Kate Robson Brown

Metadata presents a medium for connection, elaboration, examination, and comprehension of relativity between two datasets. Metadata can be enriched to calculate the existence of a connection between different disintegrated datasets. In…

Databases · Computer Science 2018-09-14 Hiba Khalid , Esteban Zimanyi , Robert Wrembel

Peer-grouping is used in many sectors for organisational learning, policy implementation, and benchmarking. Clustering provides a statistical, data-driven method for constructing meaningful peer groups, but peer groups must be compatible…

Applications · Statistics 2021-07-14 Daniel William Kennedy , Jessica Cameron , Paul Pao-Yen Wu , Kerrie Mengersen

With the explosive growth of multi-source data, multi-view clustering has attracted great attention in recent years. Most existing multi-view methods operate in raw feature space and heavily depend on the quality of original feature…

Machine Learning · Computer Science 2022-05-20 Liang Liu , Peng Chen , Guangchun Luo , Zhao Kang , Yonggang Luo , Sanchu Han

Identifying meaningful concepts in large data sets can provide valuable insights into engineering design problems. Concept identification aims at identifying non-overlapping groups of design instances that are similar in a joint space of…

Machine Learning · Computer Science 2023-11-15 Felix Lanfermann , Sebastian Schmitt , Patricia Wollstadt

The objective of clustering is to discover natural groups in datasets and to identify geometrical structures which might reside there, without assuming any prior knowledge on the characteristics of the data. The problem can be seen as…

Computational Geometry · Computer Science 2018-01-26 Luis-Evaristo Caraballo , José-Miguel Díaz-Báñez , Nadine Kroher

An extension of the latent class model is presented for clustering categorical data by relaxing the classical "class conditional independence assumption" of variables. This model consists in grouping the variables into inter-independent and…

Computation · Statistics 2015-10-01 Matthieu Marbac , Christophe Biernacki , Vincent Vandewalle

In this paper, we test whether two datasets share a common clustering structure. As a leading example, we focus on comparing clustering structures in two independent random samples from two mixtures of multivariate normal distributions.…

Statistics Theory · Mathematics 2022-11-21 Chao Gao , Zongming Ma

Not long ago primary census data became available to publicity. It opened qualitatively new perspectives not only for researchers in demography and sociology, but also for those people, who somehow face processes occurring in society. In…

Databases · Computer Science 2011-06-28 Oleg Chertov , Marharyta Aleksandrova

Clustering is a core task in machine learning with wide-ranging applications in data mining and pattern recognition. However, its unsupervised nature makes it inherently challenging. Many existing clustering algorithms suffer from critical…

Machine Learning · Computer Science 2025-07-29 Ahmed Shokry , Ayman Khalafallah

Many fields, such as neuroscience, are experiencing the vast proliferation of cellular data, underscoring the need for organizing and interpreting large datasets. A popular approach partitions data into manageable subsets via hierarchical…

Quantitative Methods · Quantitative Biology 2024-03-07 Diek W. Wheeler , Giorgio A. Ascoli

Clustering ensemble, or consensus clustering, has emerged as a powerful tool for improving both the robustness and the stability of results from individual clustering methods. Weighted clustering ensemble arises naturally from clustering…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Mimi Zhang

Understanding the global organization of complicated and high dimensional data is of primary interest for many branches of applied sciences. It is typically achieved by applying dimensionality reduction techniques mapping the considered…

Computational Geometry · Computer Science 2024-11-11 Paweł Dłotko , Davide Gurnari , Mathis Hallier , Anna Jurek-Loughrey

Motivated by theoretical advancements in dimensionality reduction techniques we use a recent model, called Block Markov Chains, to conduct a practical study of clustering in real-world sequential data. Clustering algorithms for Block Markov…

Machine Learning · Computer Science 2022-10-05 Alexander Van Werde , Albert Senen-Cerda , Gianluca Kosmella , Jaron Sanders