English
Related papers

Related papers: Using Dimensionality Reduction to Optimize t-SNE

200 papers

The need to understand the structure of hierarchical or high-dimensional data is present in a variety of fields. Hyperbolic spaces have proven to be an important tool for embedding computations and analysis tasks as their non-linear nature…

Human-Computer Interaction · Computer Science 2024-01-26 Martin Skrodzki , Hunter van Geffen , Nicolas F. Chaves-de-Plaza , Thomas Höllt , Elmar Eisemann , Klaus Hildebrandt

The tensor-train (TT) format is a data-sparse tensor representation commonly used in high dimensional data approximations. In order to represent data with interpretability in data science, researchers develop data-centric skeletonized low…

Numerical Analysis · Mathematics 2026-02-10 Daniel Hayes , Jing-Mei Qiu , Tianyi Shi

Dense embedding models are commonly deployed in commercial search engines, wherein all the document vectors are pre-computed, and near-neighbor search (NNS) is performed with the query vector to find relevant documents. However, the…

Machine Learning · Computer Science 2020-09-01 Tharun Medini , Beidi Chen , Anshumali Shrivastava

Visualizing high-dimensional data has been a focus in data analysis communities for decades, which has led to the design of many algorithms, some of which are now considered references (such as t-SNE for example). In our era of overwhelming…

Machine Learning · Computer Science 2017-02-21 Johan Paratte , Nathanaël Perraudin , Pierre Vandergheynst

Low-dimensional embeddings for data from disparate sources play critical roles in multi-modal machine learning, multimedia information retrieval, and bioinformatics. In this paper, we propose a supervised dimensionality reduction method…

Machine Learning · Computer Science 2021-01-15 Yanjun Li , Bihan Wen , Hao Cheng , Yoram Bresler

We propose a new dimensionality reduction toolkit designed to address some of the challenges faced by traditional methods like UMAP and tSNE such as loss of global structure and computational efficiency. Built on the JAX framework, DiRe…

Machine Learning · Computer Science 2025-08-19 Alexander Kolpakov , Igor Rivin

Nowadays, as data becomes increasingly complex and distributed, data analyses often involve several related datasets that are stored on different servers and probably owned by different stakeholders. While there is an emerging need to…

Cryptography and Security · Computer Science 2020-07-31 Jiazhi Xia , Tianxiang Chen , Lei Zhang , Wei Chen , Yang Chen , Xiaolong Zhang , Cong Xie , Tobias Schreck

This work is concerned with the continuum limit of a graph-based data visualization technique called the t-Distributed Stochastic Neighbor Embedding (t-SNE), which is widely used for visualizing data in a variety of applications, but is…

Machine Learning · Statistics 2026-04-15 Jeff Calder , Zhonggan Huang , Ryan Murray , Adam Pickarski

Running machine learning analytics over geographically distributed datasets is a rapidly arising problem in the world of data management policies ensuring privacy and data security. Visualizing high dimensional data using tools such as…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-13 Viska Wei , Nikita Ivkin , Vladimir Braverman , Alexander Szalay

There is an increasing body of work exploring the integration of random projection into algorithms for numerical linear algebra. The primary motivation is to reduce the overall computational cost of processing large datasets. A suitably…

Numerical Analysis · Mathematics 2022-01-04 Daniel Ahfock , William J. Astle , Sylvia Richardson

Tensor regression has shown to be advantageous in learning tasks with multi-directional relatedness. Given massive multiway data, traditional methods are often too slow to operate on or suffer from memory bottleneck. In this paper, we…

Machine Learning · Computer Science 2016-07-12 Rose Yu , Yan Liu

Stochastic Neighbor Embedding (SNE) methods minimize the divergence between the similarity matrix of a high-dimensional data set and its counterpart from a low-dimensional embedding, leading to widely applied tools for data visualization.…

Machine Learning · Computer Science 2018-09-13 Yao Lu , Jukka Corander , Zhirong Yang

Stochastic neighbor embedding (SNE) methods $t$-SNE, UMAP are two most popular dimensionality reduction methods for data visualization. Contrastive learning, especially self-supervised contrastive learning (SSCL), has showed great success…

Machine Learning · Computer Science 2023-09-18 Yi Zhang

A first line of attack in exploratory data analysis is data visualization, i.e., generating a 2-dimensional representation of data that makes clusters of similar points visually identifiable. Standard Johnson-Lindenstrauss dimensionality…

Machine Learning · Computer Science 2018-06-08 Sanjeev Arora , Wei Hu , Pravesh K. Kothari

Modern methods in dimensionality reduction are dominated by nonlinear attraction-repulsion force-based methods (this includes t-SNE, UMAP, ForceAtlas2, LargeVis, and many more). The purpose of this paper is to demonstrate that all such…

Machine Learning · Computer Science 2022-08-16 Yulan Zhang , Anna C. Gilbert , Stefan Steinerberger

T-distributed stochastic neighbour embedding (t-SNE) is a widely used data visualisation technique. It differs from its predecessor SNE by the low-dimensional similarity kernel: the Gaussian kernel was replaced by the heavy-tailed Cauchy…

Machine Learning · Computer Science 2020-07-20 Dmitry Kobak , George Linderman , Stefan Steinerberger , Yuval Kluger , Philipp Berens

Stochastic Neighbor Embedding (SNE) algorithms like UMAP and tSNE often produce visualizations that do not preserve the geometry of noisy and high dimensional data. In particular, they can spuriously separate connected components of the…

Machine Learning · Computer Science 2025-09-05 Tristan Luca Saidi , Abigail Hickok , Bastian Rieck , Andrew J. Blumberg

As a typical dimensionality reduction technique, random projection can be simply implemented with linear projection, while maintaining the pairwise distances of high-dimensional data with high probability. Considering this technique is…

Machine Learning · Computer Science 2014-10-14 Weizhi Lu , Weiyu Li , Kidiyo Kpalma , Joseph Ronsin

Learning sentence embeddings is a fundamental problem in natural language processing. While existing research primarily focuses on enhancing the quality of sentence embeddings, the exploration of sentence embedding dimensions is limited.…

Computation and Language · Computer Science 2023-10-25 Hongwei Wang , Hongming Zhang , Dong Yu

This study proposes median consensus embedding (MCE) to address variability in low-dimensional embeddings caused by random initialization in nonlinear dimensionality reduction techniques such as $t$-distributed stochastic neighbor…

Machine Learning · Statistics 2025-12-10 Yui Tomo , Daisuke Yoneoka