English
Related papers

Related papers: Statistical analysis of a hierarchical clustering …

200 papers

Clustering, or unsupervised classification, is a task often plagued by outliers. Yet there is a paucity of work on handling outliers in clustering. Outlier identification algorithms tend to fall into three broad categories: outlier…

Methodology · Statistics 2024-05-31 Katharine M. Clark , Paul D. McNicholas

We consider the problem of clustering data points coming from sub-Gaussian mixtures. Existing methods that provably achieve the optimal mislabeling error, such as the Lloyd algorithm, are usually vulnerable to outliers. In contrast,…

Statistics Theory · Mathematics 2025-11-03 Soham Jana , Kun Yang , Sanjeev Kulkarni

Hierarchical Clustering (HC) is a widely studied problem in exploratory data analysis, usually tackled by simple agglomerative procedures like average-linkage, single-linkage or complete-linkage. In this paper we focus on two objectives,…

Data Structures and Algorithms · Computer Science 2018-08-08 Moses Charikar , Vaggos Chatziafratis , Rad Niazadeh

Outlier detection is an important problem occurring in a wide range of areas. Outliers are the outcome of fraudulent behaviour, mechanical faults, human error, or simply natural deviations. Many data mining applications perform outlier…

Machine Learning · Computer Science 2025-10-28 Juan A. Lara , David Lizcano , Víctor Rampérez , Javier Soriano

Recommender systems are designed to suggest items based on user preferences, helping users navigate the vast amount of information available on the internet. Given the overwhelming content, outlier detection has emerged as a key research…

Information Retrieval · Computer Science 2024-10-02 Mahamudul Hasan

In this paper we present methods for exemplar based clustering with outlier selection based on the facility location formulation. Given a distance function and the number of outliers to be found, the methods automatically determine the…

Machine Learning · Computer Science 2014-03-07 Lionel Ott , Linsey Pang , Fabio Ramos , David Howe , Sanjay Chawla

Most community detection approaches make very strong assumptions about communities in the data, such as every vertex must belong to exactly one community (the communities form a partition). For vector data, Hierarchical Density Based…

Social and Information Networks · Computer Science 2025-09-03 Ryan DeWolfe

In this paper, we present a local search-based algorithm for individually fair clustering in the presence of outliers. We consider the individual fairness definition proposed in Jung et al., which requires that each of the $n$ points in the…

Data Structures and Algorithms · Computer Science 2025-10-08 Binita Maity , Shrutimoy Das , Anirban Dasgupta

Clustering has many important applications in computer science, but real-world datasets often contain outliers. Moreover, the presence of outliers can make the clustering problems to be much more challenging. To reduce the complexities,…

Data Structures and Algorithms · Computer Science 2020-05-04 Hu Ding , Jiawei Huang , Haikuo Yu

Functional data present unique challenges for clustering due to their infinite-dimensional nature and potential sensitivity to outliers. An extension of the OCLUST algorithm to the functional setting is proposed to address these issues. The…

Machine Learning · Statistics 2025-08-06 Katharine M. Clark , Paul D. McNicholas

One of the main challenges for hierarchical clustering is how to appropriately identify the representative points in the lower level of the cluster tree, which are going to be utilized as the roots in the higher level of the cluster tree…

Machine Learning · Statistics 2021-11-16 Wen-Bo Xie , Zhen Liu , Jaideep Srivastava

Individual fairness guarantees are often desirable properties to have, but they become hard to formalize when the dataset contains outliers. Here, we investigate the problem of developing an individually fair $k$-means clustering algorithm…

Machine Learning · Computer Science 2024-12-17 Binita Maity , Shrutimoy Das , Anirban Dasgupta

We propose a nearest neighbor based clustering algorithm that results in a naturally defined hierarchy of clusters. In contrast to the agglomerative and divisive hierarchical clustering algorithms, our approach is not dependent on the…

Data Structures and Algorithms · Computer Science 2022-03-16 Kaan Gokcesu , Hakan Gokcesu

Outlier detection and cluster number estimation is an important issue for clustering real data. This paper focuses on spectral clustering, a time-tested clustering method, and reveals its important properties related to outliers. The…

Computer Vision and Pattern Recognition · Computer Science 2017-03-06 Takuro Ina , Atsushi Hashimoto , Masaaki Iiyama , Hidekazu Kasahara , Mikihiko Mori , Michihiko Minoh

The outlier detection problem in some cases is similar to the classification problem. For example, the main concern of clustering-based outlier detection algorithms is to find clusters and outliers, which are often regarded as noise that…

Machine Learning · Computer Science 2014-05-25 M. H. Marghny , Ahmed I. Taloba

Pairwise "same-cluster" queries are one of the most widely used forms of supervision in semi-supervised clustering. However, it is impractical to ask human oracles to answer every query correctly. In this paper, we study the influence of…

Machine Learning · Statistics 2017-11-21 Taewan Kim , Joydeep Ghosh

In scientific computing, it is common that a mathematical expression can be computed by many different algorithms (sometimes over hundreds), each identifying a specific sequence of library calls. Although mathematically equivalent, those…

Performance · Computer Science 2021-09-15 Aravind Sankaran , Paolo Bientinesi

Clustering with outliers is one of the most fundamental problems in Computer Science. Given a set $X$ of $n$ points and two integers $k$ and $m$, the clustering with outliers aims to exclude $m$ points from $X$ and partition the remaining…

Data Structures and Algorithms · Computer Science 2023-02-21 Akanksha Agrawal , Tanmay Inamdar , Saket Saurabh , Jie Xue

Short text clustering is a challenging task due to the lack of signal contained in such short texts. In this work, we propose iterative classification as a method to b o ost the clustering quality (e.g., accuracy) of short texts. Given a…

Information Retrieval · Computer Science 2020-02-03 Md Rashadul Hasan Rakib , Norbert Zeh , Magdalena Jankowska , Evangelos Milios

Clustering is a widely used unsupervised learning method for finding structure in the data. However, the resulting clusters are typically presented without any guarantees on their robustness; slightly changing the used data sample or…

Machine Learning · Statistics 2017-01-02 Andreas Henelius , Kai Puolamäki , Henrik Boström , Panagiotis Papapetrou