English
Related papers

Related papers: Class Angular Distortion Index for Dimensionality …

200 papers

Different unsupervised models for dimensionality reduction like PCA, LLE, Shannon's mapping, tSNE, UMAP, etc. work on different principles, hence, they are difficult to compare on the same ground. Although they are usually good for…

Methodology · Statistics 2024-05-10 Subhrajyoty Roy

Linear discriminant analysis (LDA) is a well-known method for multiclass classification and dimensionality reduction. However, in general, ordinary LDA does not achieve high prediction accuracy when observations in some classes are…

Methodology · Statistics 2021-07-07 Kei Hirose , Kanta Miura , Atori Koie

Unsupervised anomaly detection (AD) is a fundamental problem in machine learning and statistics. A popular approach to unsupervised AD is clustering-based detection. However, this method lacks the ability to guarantee the reliability of the…

Machine Learning · Statistics 2025-04-29 Nguyen Thi Minh Phu , Duong Tan Loc , Vo Nguyen Le Duy

We present Preserving Clusters and Correlations (PCC), a novel dimensionality reduction (DR) method a novel dimensionality reduction (DR) method that achieves state-of-the-art global structure (GS) preservation while maintaining competitive…

Machine Learning · Computer Science 2025-03-18 Jacob Gildenblat , Jens Pahnke

The random cluster model is used to define an upper bound on a distance measure as a function of the number of data points to be classified and the expected value of the number of classes to form in a hybrid K-means and regression…

Machine Learning · Computer Science 2016-02-12 Robert A. Murphy

Unsupervised Re-ID methods aim at learning robust and discriminative features from unlabeled data. However, existing methods often ignore the relationship between module parameters of Re-ID framework and feature distributions, which may…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Ziqi He , Mengjia Xue , Yunhao Du , Zhicheng Zhao , Fei Su

We develop a new density-based clustering algorithm named CRAD which is based on a new neighbor searching function with a robust data depth as the dissimilarity measure. Our experiments prove that the new CRAD is highly competitive at…

Computation · Statistics 2019-04-09 Xin Huang , Yulia R. Gel

Evaluating data separation in a geometrical space is fundamental for pattern recognition. A plethora of dimensionality reduction (DR) algorithms have been developed in order to reveal the emergence of geometrical patterns in a low…

Machine Learning · Computer Science 2020-01-01 A. Acevedo , S. Ciucci , MJ. Kuo , C. Duran , CV. Cannistraci

We propose Concavity-induced Distance (CID) as a novel way to measure the dissimilarity between a pair of points in an unoriented point cloud. CID indicates the likelihood of two points or two sets of points belonging to different convex…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Ruoyu Wang , Yanfei Xue , Bharath Surianarayanan , Dong Tian , Chen Feng

Dimensionality reduction (DR) algorithms compress high-dimensional data into a lower dimensional representation while preserving important features of the data. DR is a critical step in many analysis pipelines as it enables visualisation,…

Machine Learning · Statistics 2023-05-26 Aditya Ravuri , Francisco Vargas , Vidhi Lalchand , Neil D. Lawrence

The misclassification error distance and the adjusted Rand index are two of the most commonly used criteria to evaluate the performance of clustering algorithms. This paper provides an in-depth comparison of the two criteria, aimed to…

Machine Learning · Statistics 2019-07-29 José E. Chacón

A novel multi-resolution cluster detection (MCD) method is proposed to identify irregularly shaped clusters in space. Multi-scale test statistic on a single cell is derived based on likelihood ratio statistic for Bernoulli sequence, Poisson…

Methodology · Statistics 2012-05-11 Lingsong Zhang , Zhengyuan Zhu

When faced with new data, we often conduct a cluster analysis to obtain a better understanding of the data's structure and the archetypical samples present in the data. This process often includes visualization of the data, either as a way…

Applications · Statistics 2026-04-06 Justin Lin , Julia Fukuyama

Accurate estimation of Intrinsic Dimensionality (ID) is of crucial importance in many data mining and machine learning tasks, including dimensionality reduction, outlier detection, similarity search and subspace clustering. However, since…

Clustering high-dimensional datasets is hard because interpoint distances become less informative in high-dimensional spaces. We present a clustering algorithm that performs nonlinear dimensionality reduction and clustering jointly. The…

Machine Learning · Computer Science 2018-03-06 Sohil Atul Shah , Vladlen Koltun

For numerous reasons there raises a need for dimension reduction that preserves certain characteristics of data. In this work we focus on data coming from a mixture of Gaussian distributions and we propose a method that preserves…

Statistics Theory · Mathematics 2014-07-30 Ewa Nowakowska , Jacek Koronacki , Stan Lipovetsky

Dimensionality reduction is a fundamental technique in machine learning and data analysis, enabling efficient representation and visualization of high-dimensional data. This paper explores five key methods: Principal Component Analysis…

Other Statistics · Statistics 2025-02-19 Yuan-chin Ivan Chang

Subspace clustering refers to the problem of clustering unlabeled high-dimensional data points into a union of low-dimensional linear subspaces, whose number, orientations, and dimensions are all unknown. In practice one may have access to…

Machine Learning · Statistics 2015-12-15 Reinhard Heckel , Michael Tschannen , Helmut Bölcskei

Dimensionality reduction (DR) techniques inherently distort the original structure of input high-dimensional data, producing imperfect low-dimensional embeddings. Diverse distortion measures have thus been proposed to evaluate the…

Machine Learning · Computer Science 2023-08-14 Hyeon Jeon , Aeri Cho , Jinhwa Jang , Soohyun Lee , Jake Hyun , Hyung-Kwon Ko , Jaemin Jo , Jinwook Seo

As one type of efficient unsupervised learning methods, clustering algorithms have been widely used in data mining and knowledge discovery with noticeable advantages. However, clustering algorithms based on density peak have limited…

Machine Learning · Computer Science 2019-11-26 Jianguo Chen , Philip S. Yu