English
Related papers

Related papers: Using Dimensionality Reduction to Optimize t-SNE

200 papers

This work proposes a novel tensor train random projection (TTRP) method for dimension reduction, where pairwise distances can be approximately preserved. Our TTRP is systematically constructed through a tensor train (TT) representation with…

Machine Learning · Statistics 2021-10-22 Yani Feng , Kejun Tang , Lianxing He , Pingqiang Zhou , Qifeng Liao

Subspace clustering refers to the problem of clustering unlabeled high-dimensional data points into a union of low-dimensional linear subspaces, whose number, orientations, and dimensions are all unknown. In practice one may have access to…

Machine Learning · Statistics 2015-12-15 Reinhard Heckel , Michael Tschannen , Helmut Bölcskei

The paper presents an O(N log N)-implementation of t-SNE -- an embedding technique that is commonly used for the visualization of high-dimensional data in scatter plots and that normally runs in O(N^2). The new implementation uses…

Machine Learning · Computer Science 2013-03-11 Laurens van der Maaten

t-distributed Stochastic Neighborhood Embedding (t-SNE), a clustering and visualization method proposed by van der Maaten & Hinton in 2008, has rapidly become a standard tool in a number of natural sciences. Despite its overwhelming…

Machine Learning · Computer Science 2017-06-09 George C. Linderman , Stefan Steinerberger

The t-distributed stochastic neighbor embedding (t- SNE) is a method for interpreting high dimensional (HD) data by mapping each point to a low dimensional (LD) space (usually two-dimensional). It seeks to retain the structure of the data.…

Machine Learning · Computer Science 2022-11-18 Prakash Chourasia , Sarwan Ali , Murray Patterson

Dimensional data reduction methods are fundamental to explore and visualize large data sets. Basic requirements for unsupervised data exploration are simplicity, flexibility and scalability. However, current methods show complex…

Machine Learning · Computer Science 2021-12-03 Joan Garriga , Frederic Bartumeus

We present a new method GTSNE to visualize high-dimensional data points in the two dimensional map. The technique is a variation of t-SNE that produces better visualizations by capturing both the local neighborhood structure and the macro…

Machine Learning · Computer Science 2021-08-04 Songting Shi

This work considers large-data asymptotics for t-distributed stochastic neighbor embedding (tSNE), a widely-used non-linear dimension reduction algorithm. We identify an appropriate continuum limit of the tSNE objective function, which can…

Statistics Theory · Mathematics 2024-10-18 Ryan Murray , Adam Pickarski

Hyperspectral Imagery (and Remote Sensing in general) captured from UAVs or satellites are highly voluminous in nature due to the large spatial extent and wavelengths captured by them. Since analyzing these images requires a huge amount of…

Image and Video Processing · Electrical Eng. & Systems 2020-05-12 Megh Shukla , Biplab Banerjee , Krishna Mohan Buddhiraju

We introduce an improved unsupervised clustering protocol specially suited for large-scale structured data. The protocol follows three steps: a dimensionality reduction of the data, a density estimation over the low dimensional…

Machine Learning · Computer Science 2019-11-05 Joan Garriga , Frederic Bartumeus

Fitting linear regression models can be computationally very expensive in large-scale data analysis tasks if the sample size and the number of variables are very large. Random projections are extensively used as a dimension reduction tool…

Statistics Theory · Mathematics 2017-01-20 Gian-Andrea Thanei , Christina Heinze , Nicolai Meinshausen

With the recent surge in big data analytics for hyper-dimensional data there is a renewed interest in dimensionality reduction techniques for machine learning applications. In order for these methods to improve performance gains and…

Machine Learning · Computer Science 2023-01-20 J. Derek Tucker , Matthew T. Martinez , Jose M. Laborde

Random Projection is a foundational research topic that connects a bunch of machine learning algorithms under a similar mathematical basis. It is used to reduce the dimensionality of the dataset by projecting the data points efficiently to…

Machine Learning · Computer Science 2017-10-10 Mahmoud Nabil

A representation technique that allows encoding music in a way that contains musical meaning would improve the results of any model trained for computer music tasks like generation of melodies and harmonies of better quality. The field of…

Computation and Language · Computer Science 2020-05-20 Sebastian Garcia-Valencia

Projection algorithms such as t-SNE or UMAP are useful for the visualization of high dimensional data, but depend on hyperparameters which must be tuned carefully. Unfortunately, iteratively recomputing projections to find the optimal…

Machine Learning · Computer Science 2021-06-28 Gabriel Appleby , Mateus Espadoto , Rui Chen , Samuel Goree , Alexandru Telea , Erik W Anderson , Remco Chang

Non-linear dimensionality reduction can be performed by \textit{manifold learning} approaches, such as Stochastic Neighbour Embedding (SNE), Locally Linear Embedding (LLE) and Isometric Feature Mapping (ISOMAP). These methods aim to produce…

Machine Learning · Statistics 2021-12-09 Theodoulos Rodosthenous , Vahid Shahrezaei , Marina Evangelou

This paper discusses the topic of dimensionality reduction for $k$-means clustering. We prove that any set of $n$ points in $d$ dimensions (rows in a matrix $A \in \RR^{n \times d}$) can be projected into $t = \Omega(k / \eps^2)$…

Artificial Intelligence · Computer Science 2011-05-05 Christos Boutsidis , Anastasios Zouzias , Petros Drineas

Random embeddings project high-dimensional spaces to low-dimensional ones; they are careful constructions which allow the approximate preservation of key properties, such as the pair-wise distances between points. Often in the field of…

Optimization and Control · Mathematics 2022-06-08 Zhen Shao

Stochastic Neighbor Embedding (SNE) is a manifold learning and dimensionality reduction method with a probabilistic approach. In SNE, every point is consider to be the neighbor of all other points with some probability and this probability…

Machine Learning · Statistics 2022-08-04 Benyamin Ghojogh , Ali Ghodsi , Fakhri Karray , Mark Crowley

We introduce sparse random projection, an important dimension-reduction tool from machine learning, for the estimation of discrete-choice models with high-dimensional choice sets. Initially, high-dimensional data are compressed into a…

Machine Learning · Statistics 2016-04-21 Khai X. Chiong , Matthew Shum