English
Related papers

Related papers: Understanding How Dimension Reduction Tools Work: …

200 papers

The goal of dimension reduction tools is to construct a low-dimensional representation of high-dimensional data. These tools are employed for a variety of reasons such as noise reduction, visualization, and to lower computational costs.…

Applications · Statistics 2024-09-20 Justin Lin , Julia Fukuyama

Topology based dimensionality reduction methods such as t-SNE and UMAP have seen increasing success and popularity in high-dimensional data. These methods have strong mathematical foundations and are based on the intuition that the topology…

Artificial Intelligence · Computer Science 2021-12-17 Ayush Dalmia , Suzanna Sia

Data visualisation helps understanding data represented by multiple variables, also called features, stored in a large matrix where individuals are stored in lines and variable values in columns. These data structures are frequently called…

Human-Computer Interaction · Computer Science 2022-07-25 Haseeb Younis , Paul Trust , Rosane Minghim

Dimension reduction (DR) is inherently non-unique: multiple embeddings can preserve the structure of high-dimensional data equally well while differing in layout or geometry. In this paper, we formally define the Rashomon set for DR -- the…

Machine Learning · Computer Science 2026-04-29 Yiyang Sun , Haiyang Huang , Gaurav Rajesh Parikh , Cynthia Rudin

This paper shows that dimensionality reduction methods such as UMAP and t-SNE, can be approximately recast as MAP inference methods corresponding to a model introduced in Ravuri et al. (2023), that describes the graph Laplacian (an estimate…

Machine Learning · Statistics 2025-05-13 Aditya Ravuri , Neil D. Lawrence

Dimensionality Reduction (DR) techniques such as t-SNE and UMAP are popular for transforming complex datasets into simpler visual representations. However, while effective in uncovering general dataset patterns, these methods may introduce…

Human-Computer Interaction · Computer Science 2024-04-19 Parisa Salmanian , Angelos Chatzimparmpas , Ali Can Karaca , Rafael M. Martins

tSNE and UMAP are popular dimensionality reduction algorithms due to their speed and interpretable low-dimensional embeddings. Despite their popularity, however, little work has been done to study their full span of differences. We…

We present Preserving Clusters and Correlations (PCC), a novel dimensionality reduction (DR) method a novel dimensionality reduction (DR) method that achieves state-of-the-art global structure (GS) preservation while maintaining competitive…

Machine Learning · Computer Science 2025-03-18 Jacob Gildenblat , Jens Pahnke

Dimensionality reduction (DR) is a popular method for preparing and analyzing high-dimensional data. Reduced data representations are less computationally intensive and easier to manage and visualize, while retaining a significant…

Machine Learning · Computer Science 2022-05-02 Avraam Bardos , Ioannis Mollas , Nick Bassiliades , Grigorios Tsoumakas

Dimensionality reduction (DR) is an important technique for data exploration and knowledge discovery. However, most of the main DR methods are either linear (e.g., PCA), do not provide an explicit mapping between the original data and its…

Neural and Evolutionary Computing · Computer Science 2022-03-15 Thomas Uriot , Marco Virgolin , Tanja Alderliesten , Peter Bosman

With the increasing availability of high-dimensional data, analysts often rely on exploratory data analysis to understand complex data sets. A key approach to exploring such data is dimensionality reduction, which embeds high-dimensional…

Machine Learning · Computer Science 2024-12-17 Pavlin G. Poličar , Blaž Zupan

Dimensionality Reduction (DR) is widely used for visualizing high-dimensional data, often with the goal of revealing expected cluster structure. However, such a structure may not always appear in the projections. Existing DR quality metrics…

Machine Learning · Computer Science 2025-09-05 Diede P. M. van der Hoorn , Alessio Arleo , Fernando V. Paulovich

With the recent surge in big data analytics for hyper-dimensional data there is a renewed interest in dimensionality reduction techniques for machine learning applications. In order for these methods to improve performance gains and…

Machine Learning · Computer Science 2023-01-20 J. Derek Tucker , Matthew T. Martinez , Jose M. Laborde

This paper considers the problem of nonlinear dimensionality reduction. Unlike existing methods, such as LLE, ISOMAP, which attempt to unfold the true manifold in the low dimensional space, our algorithm tries to preserve the nonlinear…

Computer Vision and Pattern Recognition · Computer Science 2019-02-15 Xu Zhao , Zongli Jiang

Dimensionality reduction is crucial both for visualization and preprocessing high dimensional data for machine learning. We introduce a novel method based on a hierarchy built on 1-nearest neighbor graphs in the original space which is used…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 M. Saquib Sarfraz , Marios Koulakis , Constantin Seibold , Rainer Stiefelhagen

We explore two primary classes of approaches to dimensionality reduction (DR): Independent Dimensionality Reduction (IDR) and Simultaneous Dimensionality Reduction (SDR). In IDR methods, of which Principal Components Analysis is a…

Machine Learning · Statistics 2024-10-28 Eslam Abdelaleem , Ahmed Roman , K. Michael Martini , Ilya Nemenman

We introduce Uniform Manifold Approximation with Two-phase Optimization (UMATO), a dimensionality reduction (DR) technique that improves UMAP to capture the global structure of high-dimensional data more accurately. In UMATO, optimization…

Machine Learning · Computer Science 2023-01-03 Hyeon Jeon , Hyung-Kwon Ko , Soohyun Lee , Jaemin Jo , Jinwook Seo

Dimensionality reduction methods such as t-SNE are designed to preserve local neighborhood structure but do not explicitly account for how probability mass is distributed, often leading to distortions of data density. We reformulate…

Machine Learning · Computer Science 2026-05-05 Maksim Kazanskii

Dimensionality reduction methods such as t-SNE and UMAP are popular methods for visualizing data with a potential (latent) clustered structure. They are known to group data points at the same time as they embed them, resulting in…

Machine Learning · Computer Science 2025-09-04 Elizabeth Coda , Ery Arias-Castro , Gal Mishne

Modeling data as being sampled from a union of independent subspaces has been widely applied to a number of real world applications. However, dimensionality reduction approaches that theoretically preserve this independence assumption have…

Machine Learning · Computer Science 2016-04-08 Devansh Arpit , Ifeoma Nwogu , Venu Govindaraju