English
Related papers

Related papers: Simultaneous model-based clustering and visualizat…

200 papers

Clustering short text is a difficult problem, due to the low word co-occurrence between short text documents. This work shows that large language models (LLMs) can overcome the limitations of traditional clustering approaches by generating…

Computation and Language · Computer Science 2025-04-08 Justin K. Miller , Tristram J. Alexander

Clustering algorithms are pivotal in data analysis, enabling the organization of data into meaningful groups. However, individual clustering methods often exhibit inherent limitations and biases, preventing the development of a universal…

Neural and Evolutionary Computing · Computer Science 2024-12-13 H. Jahani , F. Zamio

Creating low dimensional representations of a high dimensional data set is an important component in many machine learning applications. How to cluster data using their low dimensional embedded space is still a challenging problem in…

Machine Learning · Computer Science 2023-03-27 Zahra Moslehi , Abdolreza Mirzaei , Mehran Safayani

LLM pre-training efficacy increasingly depends on data composition rather than sheer volume. Yet, optimal mixing is hindered by categorization flaws: human taxonomies suffer from ontological misalignment, and Euclidean clustering fails to…

Machine Learning · Computer Science 2026-05-27 Yue Min , Ziyun Qiao , Ruining Chen , Yujun Li

Partially recorded data are frequently encountered in many applications and usually clustered by first removing incomplete cases or features with missing values, or by imputing missing values, followed by application of a clustering…

Methodology · Statistics 2021-10-20 Emily M. Goren , Ranjan Maitra

Modern scientific studies often collect data sets in the forms of tensors, which call for innovative statistical analysis methods. In particular, there is a pressing need for tensor clustering methods to understand the heterogeneity in the…

Methodology · Statistics 2021-04-27 Qing Mai , Xin Zhang , Yuqing Pan , Kai Deng

This paper studies a factor modeling-based approach for clustering high-dimensional data generated from a mixture of strongly correlated variables. Statistical modeling with correlated structures pervades modern applications in economics,…

Statistics Theory · Mathematics 2024-08-23 Shange Tang , Soham Jana , Jianqing Fan

Finding a set of nested partitions of a dataset is useful to uncover relevant structure at different scales, and is often dealt with a data-dependent methodology. In this paper, we introduce a general two-step methodology for model-based…

Computation · Statistics 2021-04-22 Etienne Côme , Nicolas Jouvin , Pierre Latouche , Charles Bouveyron

The paper proposes a latent variable model for binary data coming from an unobserved heterogeneous population. The heterogeneity is taken into account by replacing the traditional assumption of Gaussian distributed factors by a finite…

Methodology · Statistics 2010-10-13 Silvia Cagnone , Cinzia Viroli

Entity Resolution (ER) is a fundamental data quality improvement task that identifies and links records referring to the same real-world entity. Traditional ER approaches often rely on pairwise comparisons, which can be costly in terms of…

Databases · Computer Science 2025-06-04 Jiajie Fu , Haitong Tang , Arijit Khan , Sharad Mehrotra , Xiangyu Ke , Yunjun Gao

Mixture-of-Experts models are commonly used when there exist distinct clusters with different relationships between the independent and dependent variables. Fitting such models for large datasets, however, is computationally virtually…

Methodology · Statistics 2023-09-06 Yanxi Liu , John Stufken , Min Yang

High-dimensional clustering analysis is a challenging problem in statistics and machine learning, with broad applications such as the analysis of microarray data and RNA-seq data. In this paper, we propose a new clustering procedure called…

Methodology · Statistics 2022-10-31 Tianqi Liu , Yu Lu , Biqing Zhu , Hongyu Zhao

The mixture model is undoubtedly one of the greatest contributions to clustering. For continuous data, Gaussian models are often used and the Expectation-Maximization (EM) algorithm is particularly suitable for estimating parameters from…

Machine Learning · Statistics 2025-11-25 Zineddine Tighidet , Lazhar Labiod , Mohamed Nadif

In microbiome studies, it is often of great interest to identify clusters or partitions of microbiome profiles within a study population and to characterize the distinctive attributes of each resulting microbial community. While raw counts…

Methodology · Statistics 2025-08-18 Zhongmao Liu , Xiaohui Yin , Yanjiao Zhou , Gen Li , Kun Chen

Recent developed deep unsupervised methods allow us to jointly learn representation and cluster unlabelled data. These deep clustering methods mainly focus on the correlation among samples, e.g., selecting high precision pairs to gradually…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Jianlong Wu , Keyu Long , Fei Wang , Chen Qian , Cheng Li , Zhouchen Lin , Hongbin Zha

The problem of complex data analysis is a central topic of modern statistical science and learning systems and is becoming of broader interest with the increasing prevalence of high-dimensional data. The challenge is to develop statistical…

Machine Learning · Statistics 2018-03-05 Faicel Chamroukhi , Hien D. Nguyen

Though very popular, it is well known that the EM for GMM algorithm suffers from non-Gaussian distribution shapes, outliers and high-dimensionality. In this paper, we design a new robust clustering algorithm that can efficiently deal with…

Machine Learning · Statistics 2020-10-06 Violeta Roizman , Matthieu Jonckheere , Frédéric Pascal

A central aim of modeling complex networks is to accurately embed networks in order to detect structures and predict link and node properties. The latent space models (LSM) have become prominent frameworks for embedding networks and include…

Social and Information Networks · Computer Science 2022-07-21 Nikolaos Nakis , Abdulkadir Çelikkanat , Morten Mørup

Modern data-driven and distributed learning frameworks deal with diverse massive data generated by clients spread across heterogeneous environments. Indeed, data heterogeneity is a major bottleneck in scaling up many distributed learning…

Machine Learning · Computer Science 2023-08-23 Amirhossein Reisizadeh , Khashayar Gatmiry , Asuman Ozdaglar

Generating interpretable visualizations from complex data is a common problem in many applications. Two key ingredients for tackling this issue are clustering and representation learning. However, current methods do not yet successfully…

Machine Learning · Computer Science 2020-06-11 Laura Manduchi , Matthias Hüser , Julia Vogt , Gunnar Rätsch , Vincent Fortuin