English
Related papers

Related papers: bigMap: Big Data Mapping with Parallelized t-SNE

200 papers

There has been an intense recent activity in embedding of very high dimensional and nonlinear data structures, much of it in the data science and machine learning literature. We survey this activity in four parts. In the first part we cover…

Machine Learning · Statistics 2022-09-01 Dag Tjøstheim , Martin Jullum , Anders Løland

Conditional t-SNE (ct-SNE) is a recent extension to t-SNE that allows removal of known cluster information from the embedding, to obtain a visualization revealing structure beyond label information. This is useful, for example, when one…

Machine Learning · Computer Science 2023-04-12 Edith Heiter , Bo Kang , Ruth Seurinck , Jefrey Lijffijt

Neighbor Embedding (NE) aims to preserve pairwise similarities between data items and has been shown to yield an effective principle for data visualization. However, even the best existing NE methods such as Stochastic Neighbor Embedding…

Machine Learning · Computer Science 2021-09-15 Zhirong Yang , Yuwei Chen , Denis Sedov , Samuel Kaski , Jukka Corander

Dimensionality reduction and manifold learning methods such as t-Distributed Stochastic Neighbor Embedding (t-SNE) are routinely used to map high-dimensional data into a 2-dimensional space to visualize and explore the data. However, two…

Machine Learning · Computer Science 2019-05-27 Bo Kang , Darío García García , Jefrey Lijffijt , Raúl Santos-Rodríguez , Tijl De Bie

Low-dimensional embeddings and visualizations are an indispensable tool for analysis of high-dimensional data. State-of-the-art methods, such as tSNE and UMAP, excel in unveiling local structures hidden in high-dimensional data and are…

Machine Learning · Computer Science 2023-02-01 Jonas Fischer , Rebekka Burkholz , Jilles Vreeken

High-dimensional data visualization is crucial in the big data era and these techniques such as t-SNE and UMAP have been widely used in science and engineering. Big data, however, is often distributed across multiple data centers and…

Machine Learning · Computer Science 2024-12-19 Dong Qiao , Xinxian Ma , Jicong Fan

Feature representation is an important aspect of remote-sensing based image classification. While deep convolutional neural networks are able to effectively amalgamate information, large numbers of parameters often make learned features…

Machine Learning · Computer Science 2022-03-07 Joshua Peeples , Sarah Walker , Connor McCurley , Alina Zare , James Keller , Weihuang Xu

The t-distributed Stochastic Neighbor Embedding (t-SNE) is a powerful and popular method for visualizing high-dimensional data. It minimizes the Kullback-Leibler (KL) divergence between the original and embedded data distributions. In this…

Machine Learning · Computer Science 2018-11-06 Daniel Jiwoong Im , Nakul Verma , Kristin Branson

Data are not only ubiquitous in society, but are increasingly complex both in size and dimensionality. Dimension reduction offers researchers and scholars the ability to make such complex, high dimensional data spaces simpler and more…

Machine Learning · Computer Science 2021-03-15 Philip D. Waggoner

Non-linear dimensionality reduction can be performed by \textit{manifold learning} approaches, such as Stochastic Neighbour Embedding (SNE), Locally Linear Embedding (LLE) and Isometric Feature Mapping (ISOMAP). These methods aim to produce…

Machine Learning · Statistics 2021-12-09 Theodoulos Rodosthenous , Vahid Shahrezaei , Marina Evangelou

The t-distributed stochastic neighbor embedding (t- SNE) is a method for interpreting high dimensional (HD) data by mapping each point to a low dimensional (LD) space (usually two-dimensional). It seeks to retain the structure of the data.…

Machine Learning · Computer Science 2022-11-18 Prakash Chourasia , Sarwan Ali , Murray Patterson

This paper introduces a novel K-means clustering algorithm, an advancement on the conventional Big-means methodology. The proposed method efficiently integrates parallel processing, stochastic sampling, and competitive optimization to…

Machine Learning · Computer Science 2024-03-28 Rustam Mussabayev , Ravil Mussabayev

Stochastic Neighbor Embedding (SNE) methods minimize the divergence between the similarity matrix of a high-dimensional data set and its counterpart from a low-dimensional embedding, leading to widely applied tools for data visualization.…

Machine Learning · Computer Science 2018-09-13 Yao Lu , Jukka Corander , Zhirong Yang

Visualization methods based on the nearest neighbor graph, such as t-SNE or UMAP, are widely used for visualizing high-dimensional data. Yet, these approaches only produce meaningful results if the nearest neighbors themselves are…

Machine Learning · Computer Science 2024-06-06 Jan Niklas Böhm , Philipp Berens , Dmitry Kobak

High-dimensional imaging is becoming increasingly relevant in many fields from astronomy and cultural heritage to systems biology. Visual exploration of such high-dimensional data is commonly facilitated by dimensionality reduction.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Alexander Vieth , Anna Vilanova , Boudewijn Lelieveldt , Elmar Eisemann , Thomas Höllt

Most existing graph visualization methods based on dimension reduction are limited to relatively small graphs due to performance issues. In this work, we propose a novel dimension reduction method for graph visualization, called…

Machine Learning · Computer Science 2023-10-18 Xinyu Li , Yao Xiao , Yuchen Zhou

Scientists in many fields have the common and basic need of dimensionality reduction: visualizing the underlying structure of the massive multivariate data in a low-dimensional space. However, many dimensionality reduction methods confront…

Machine Learning · Statistics 2015-03-19 Teng Qiu , Yongjie Li

Nowadays, as data becomes increasingly complex and distributed, data analyses often involve several related datasets that are stored on different servers and probably owned by different stakeholders. While there is an emerging need to…

Cryptography and Security · Computer Science 2020-07-31 Jiazhi Xia , Tianxiang Chen , Lei Zhang , Wei Chen , Yang Chen , Xiaolong Zhang , Cong Xie , Tobias Schreck

Modern datasets and models are notoriously difficult to explore and analyze due to their inherent high dimensionality and massive numbers of samples. Existing visualization methods which employ dimensionality reduction to two or three…

Machine Learning · Computer Science 2018-08-01 David M. Chan , Roshan Rao , Forrest Huang , John F. Canny

Dimension reduction (DR) algorithms have proven to be extremely useful for gaining insight into large-scale high-dimensional datasets, particularly finding clusters in transcriptomic data. The initial phase of these DR methods often…

Machine Learning · Computer Science 2025-10-15 Yingfan Wang , Yiyang Sun , Haiyang Huang , Cynthia Rudin