English
Related papers

Related papers: Statistical analysis of a hierarchical clustering …

200 papers

In this study, we consider unsupervised clustering of categorical vectors that can be of different size using mixture. We use likelihood maximization to estimate the parameters of the underlying mixture model and a penalization technique to…

Statistics Theory · Mathematics 2017-09-08 Esther Derman , Erwan Le Pennec

Algorithmic fairness in clustering aims to balance the proportions of instances assigned to each cluster with respect to a given sensitive attribute. While recently developed fair clustering algorithms optimize clustering objectives under…

Machine Learning · Computer Science 2025-10-24 Kunwoong Kim , Jihu Lee , Sangchul Park , Yongdai Kim

The advent of ML-driven decision-making and policy formation has led to an increasing focus on algorithmic fairness. As clustering is one of the most commonly used unsupervised machine learning approaches, there has naturally been a…

Machine Learning · Statistics 2023-05-30 Abhisek Chakraborty , Anirban Bhattacharya , Debdeep Pati

This paper evaluates algorithms for classification and outlier detection accuracies in temporal data. We focus on algorithms that train and classify rapidly and can be used for systems that need to incorporate new data regularly. Hence, we…

Machine Learning · Statistics 2018-05-03 Victoria J. Hodge , Jim Austin

This paper examines the problem of locating outlier columns in a large, otherwise low-rank, matrix. We propose a simple two-step adaptive sensing and inference approach and establish theoretical guarantees for its performance; our results…

Information Theory · Computer Science 2015-06-22 Xingguo Li , Jarvis Haupt

Hierarchical clustering is a critical task in numerous domains. Many approaches are based on heuristics and the properties of the resulting clusterings are studied post hoc. However, in several applications, there is a natural cost function…

Hierarchical clustering is a widely used approach for clustering datasets at multiple levels of granularity. Despite its popularity, existing algorithms such as hierarchical agglomerative clustering (HAC) are limited to the offline setting,…

Machine Learning · Computer Science 2019-09-24 Aditya Krishna Menon , Anand Rajagopalan , Baris Sumengen , Gui Citovsky , Qin Cao , Sanjiv Kumar

Given an unlabeled dataset, wherein we have access only to pairwise similarities (or distances), how can we effectively (1) detect outliers, and (2) annotate/tag the outliers by type? Outlier detection has a large literature, yet we find a…

Machine Learning · Computer Science 2021-10-19 Guilherme D. F. Silva , Leman Akoglu , Robson L. F. Cordeiro

Traditional machine learning models focus on achieving good performance on the overall training distribution, but they often underperform on minority groups. Existing methods can improve the worst-group performance, but they can have…

Machine Learning · Computer Science 2022-10-14 Yuchen Zeng , Kristjan Greenewald , Kangwook Lee , Justin Solomon , Mikhail Yurochkin

In supervised clustering, standard techniques for learning a pairwise dissimilarity function often suffer from a discrepancy between the training and clustering objectives, leading to poor cluster quality. Rectifying this discrepancy…

Machine Learning · Computer Science 2019-06-20 Nishant Yadav , Ari Kobren , Nicholas Monath , Andrew McCallum

The applicability of agglomerative clustering, for inferring both hierarchical and flat clustering, is limited by its scalability. Existing scalable hierarchical clustering methods sacrifice quality for speed and often lead to over-merging…

For companies developing products or algorithms, it is important to understand the potential effects not only globally, but also on sub-populations of users. In particular, it is important to detect if there are certain groups of users that…

Machine Learning · Computer Science 2020-10-28 Amir Sepehri , Cyrus DiCiccio

Ensemble methods for classification and clustering have been effectively used for decades, while ensemble learning for outlier detection has only been studied recently. In this work, we design a new ensemble approach for outlier detection…

Machine Learning · Computer Science 2016-09-20 Shebuti Rayana , Wen Zhong , Leman Akoglu

Recommendation algorithms perform differently if the users, recommendation contexts, applications, and user interfaces vary even slightly. It is similarly observed in other fields, such as combinatorial problem solving, that algorithms…

Information Retrieval · Computer Science 2021-01-01 Andrew Collins , Laura Tierney , Joeran Beel

Distance-based hierarchical clustering (HC) methods are widely used in unsupervised data analysis but few authors take account of uncertainty in the distance data. We incorporate a statistical model of the uncertainty through corruption or…

Machine Learning · Statistics 2016-09-02 Dekang Zhu , Dan P. Guralnik , Xuezhi Wang , Xiang Li , Bill Moran

A task of clustering data given in the ordinal scale under conditions of overlapping clusters has been considered. It's proposed to use an approach based on memberhsip and likelihood functions sharing. A number of performed experiments…

Machine Learning · Computer Science 2017-02-07 Zhengbing Hu , Yevgeniy V. Bodyanskiy , Oleksii K. Tyshchenko , Viktoriia O. Samitova

There are various cluster validity indices used for evaluating clustering results. One of the main objectives of using these indices is to seek the optimal unknown number of clusters. Some indices work well for clusters with different…

Machine Learning · Statistics 2024-01-09 Nathakhun Wiroonsri

We formulate a novel technique for the detection of functional clusters in discrete event data. The advantage of this algorithm is that no prior knowledge of the number of functional groups is needed, as our procedure progressively combines…

Neurons and Cognition · Quantitative Biology 2015-05-13 S. Feldt , J. Waddell , V. L. Hetrick , J. D. Berke , M. Zochowski

We focus on spectral clustering of unlabeled graphs and review some results on clustering methods which achieve weak or strong consistent identification in data generated by such models. We also present a new algorithm which appears to…

Statistics Theory · Mathematics 2015-08-11 Sharmodeep Bhattacharyya , Peter J. Bickel

Byzantine machine learning has garnered considerable attention in light of the unpredictable faults that can occur in large-scale distributed learning systems. The key to secure resilience against Byzantine machines in distributed learning…

Machine Learning · Computer Science 2024-04-02 Yuhao Yi , Ronghui You , Hong Liu , Changxin Liu , Yuan Wang , Jiancheng Lv