English
Related papers

Related papers: ActUp: Analyzing and Consolidating tSNE and UMAP

200 papers

The objective of ordinal embedding is to find a Euclidean representation of a set of abstract items, using only answers to triplet comparisons of the form "Is item $i$ closer to the item $j$ or item $k$?". In recent years, numerous…

Machine Learning · Computer Science 2021-10-22 Leena Chennuru Vankadara , Siavash Haghiri , Michael Lohaus , Faiz Ul Wahab , Ulrike von Luxburg

Dimensionality reduction techniques are fundamental for analyzing and visualizing high-dimensional data. With established methods like t-SNE and PCA presenting a trade-off between representational power and interpretability. This paper…

Machine Learning · Computer Science 2025-04-25 Erik Bergh

t-Distributed Stochastic Neighbor Embedding (t-SNE) is one of the most widely used dimensionality reduction methods for data visualization, but it has a perplexity hyperparameter that requires manual selection. In practice, proper tuning of…

Artificial Intelligence · Computer Science 2017-08-11 Yanshuai Cao , Luyu Wang

Stochastic Neighbor Embedding (SNE) is a manifold learning and dimensionality reduction method with a probabilistic approach. In SNE, every point is consider to be the neighbor of all other points with some probability and this probability…

Machine Learning · Statistics 2022-08-04 Benyamin Ghojogh , Ali Ghodsi , Fakhri Karray , Mark Crowley

Convolutional Neural Networks (CNNs) have advanced significantly in visual representation learning and recognition. However, they face notable challenges in performance and computational efficiency when dealing with real-world, multi-scale…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Wenzhuo Liu , Fei Zhu , Cheng-Lin Liu

Dimensionality reduction methods, also known as projections, are frequently used for exploring multidimensional data in machine learning, data science, and information visualization. Among these, t-SNE and its variants have become very…

Machine Learning · Computer Science 2019-02-22 Mateus Espadoto , Nina S. T. Hirata , Alexandru C. Telea

This paper introduces NN-STNE, a neural network using t-distributed stochastic neighbor embedding (t-SNE) as a hidden layer to reduce input dimensions by mapping long time-series data into shapelet membership probabilities. A Gaussian…

Machine Learning · Computer Science 2025-02-07 Zhicong Xian , Tabish Chaudhary , Jürgen Bock

In deep neural nets, lower level embedding layers account for a large portion of the total number of parameters. Tikhonov regularization, graph-based regularization, and hard parameter sharing are approaches that introduce explicit biases…

Machine Learning · Computer Science 2020-10-06 Liwei Wu , Shuqing Li , Cho-Jui Hsieh , James Sharpnack

Stochastic neighbor embedding (SNE) and related nonlinear manifold learning algorithms achieve high-quality low-dimensional representations of similarity data, but are notoriously slow to train. We propose a generic formulation of embedding…

Machine Learning · Computer Science 2012-06-22 Max Vladymyrov , Miguel Carreira-Perpinan

Improvements in computational and experimental capabilities are rapidly increasing the amount of scientific data that is routinely generated. In applications that are constrained by memory and computational intensity, excessively large…

Machine Learning · Computer Science 2023-02-28 Malik Hassanaly , Bruce A. Perry , Michael E. Mueller , Shashank Yellapantula

Embeddings mapping high-dimensional discrete input to lower-dimensional continuous vector spaces have been widely adopted in machine learning applications as a way to capture domain semantics. Interviewing 13 embedding users across…

Human-Computer Interaction · Computer Science 2022-03-07 Angie Boggust , Brandon Carter , Arvind Satyanarayan

Multimodal patch matching addresses the problem of finding the correspondences between image patches from two different modalities, e.g. RGB vs sketch or RGB vs near-infrared. The comparison of patches of different modalities can be done by…

Computer Vision and Pattern Recognition · Computer Science 2018-06-06 Sovann En , Alexis Lechervy , Frédéric Jurie

Dynamic network embedding methods transform nodes in a dynamic network into low-dimensional vectors while preserving network characteristics, facilitating tasks such as node classification and community detection. Several embedding methods…

Social and Information Networks · Computer Science 2025-03-27 Suchanuch Piriyasatit , Chaohao Yuan , Ercan Engin Kuruoglu

This work considers large-data asymptotics for t-distributed stochastic neighbor embedding (tSNE), a widely-used non-linear dimension reduction algorithm. We identify an appropriate continuum limit of the tSNE objective function, which can…

Statistics Theory · Mathematics 2024-10-18 Ryan Murray , Adam Pickarski

A growing number of problems in computational mathematics can be reduced to the solution of many linear systems that are related, often depending smoothly or slowly on a parameter $p$, that is, $A(p)x(p)=b(p)$. We introduce an efficient…

Numerical Analysis · Mathematics 2025-10-07 Eleanor Jones , Yuji Nakatsukasa

Despite the exceptional reasoning capabilities of Multimodal Large Language Models (MLLMs), their adaptation into universal embedding models is significantly impeded by task conflict. To address this, we propose TSEmbed, a universal…

Computation and Language · Computer Science 2026-03-06 Yebo Wu , Feng Liu , Ziwei Xie , Zhiyuan Liu , Changwang Zhang , Jun Wang , Li Li

Recent advances in learning aligned multimodal representations have been primarily driven by training large neural networks on massive, noisy paired-modality datasets. In this work, we ask whether it is possible to achieve similar results…

Machine Learning · Computer Science 2022-10-11 Elan Rosenfeld , Preetum Nakkiran , Hadi Pouransari , Oncel Tuzel , Fartash Faghri

Task And Motion Planning (TAMP) is the problem of finding a solution to an automated planning problem that includes discrete actions executable by low-level continuous motions. This field is gaining increasing interest within the robotics…

Robotics · Computer Science 2024-08-13 Elisa Tosello , Alessandro Valentini , Andrea Micheli

Point convolution operations rely on different embedding mechanisms to encode the neighborhood information of each point in order to detect patterns in 3D space. However, as convolutions are usually evaluated as a whole, not much work has…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Pedro Hermosilla

Embedding models in natural language processing (NLP) increasingly rely on deep architectures such as BERT, while simpler models such as Word2Vec provide efficient representations but limited interpretability. The Tsetlin Machine (TM)…

Machine Learning · Computer Science 2026-05-11 Ahmed K. Kadhim , Lei Jiao , Rishad Shafik , Ole-Christoffer Granmo , Mayur Kishor Shende