English
Related papers

Related papers: Towards One Model for Classical Dimensionality Red…

200 papers

UMAP has supplanted t-SNE as state-of-the-art for visualizing high-dimensional datasets in many disciplines, but the reason for its success is not well understood. In this work, we investigate UMAP's sampling based optimization scheme in…

Machine Learning · Computer Science 2021-04-23 Sebastian Damrich , Fred A. Hamprecht

This paper is concerned with the problem of exact MAP inference in general higher-order graphical models by means of a traditional linear programming relaxation approach. In fact, the proof that we have developed in this paper is a rather…

Optimization and Control · Mathematics 2026-03-23 Ikhlef Bechar

We propose maximum likelihood estimation for learning Gaussian graphical models with a Gaussian (ell_2^2) prior on the parameters. This is in contrast to the commonly used Laplace (ell_1) prior for encouraging sparseness. We show that our…

Machine Learning · Computer Science 2018-11-16 Jean Honorio , Tommi S. Jaakkola

We explore linear and non-linear dimensionality reduction techniques for statistical inference of parameters in cosmology. Given the importance of compressing the increasingly complex data vectors used in cosmology, we address questions…

Cosmology and Nongalactic Astrophysics · Physics 2025-02-12 Minsu Park , Marco Gatti , Bhuvnesh Jain

With the proliferation of Graph Neural Network (GNN) methods stemming from contrastive learning, unsupervised node representation learning for graph data is rapidly gaining traction across various fields, from biology to molecular dynamics,…

Machine Learning · Computer Science 2024-08-01 Jihee You , So Won Jeong , Claire Donnat

Dimensionality reduction algorithms are often used to visualise high-dimensional data. Previously, studies have used prior information to enhance or suppress expected patterns in projections. In this paper, we adapt such techniques for…

Machine Learning · Computer Science 2024-05-16 Daniel M. Bot , Jan Aerts

We present a new nonlinear dimensionality reduction method, MAPLE, that enhances UMAP by improving manifold modeling. MAPLE employs a self-supervised learning approach to more efficiently encode low-dimensional manifold geometry. Central to…

Machine Learning · Computer Science 2026-05-15 Zeyang Huang , Takanori Fujiwara , Angelos Chatzimparmpas , Wandrille Duchemin , Andreas Kerren

Laplacian mixture models identify overlapping regions of influence in unlabeled graph and network data in a scalable and computationally efficient way, yielding useful low-dimensional representations. By combining Laplacian eigenspace and…

Machine Learning · Statistics 2018-10-03 Daniel Korenblum

Dimensionality reduction methods such as t-SNE and UMAP are popular methods for visualizing data with a potential (latent) clustered structure. They are known to group data points at the same time as they embed them, resulting in…

Machine Learning · Computer Science 2025-09-04 Elizabeth Coda , Ery Arias-Castro , Gal Mishne

The central goal of this paper is to establish two commonly available dimensionality reduction (DR) methods i.e. t-distributed Stochastic Neighbor Embedding (t-SNE) and Multidimensional Scaling (MDS) in Matlab and to observe their…

Machine Learning · Computer Science 2020-11-19 Shadman Sakib , Md. Abu Bakr Siddique , Md. Abdur Rahman

Hyperspectral Imagery (and Remote Sensing in general) captured from UAVs or satellites are highly voluminous in nature due to the large spatial extent and wavelengths captured by them. Since analyzing these images requires a huge amount of…

Image and Video Processing · Electrical Eng. & Systems 2020-05-12 Megh Shukla , Biplab Banerjee , Krishna Mohan Buddhiraju

Dimension reduction is an important tool for analyzing high-dimensional data. The predictor envelope is a method of dimension reduction for regression that assumes certain linear combinations of the predictors are immaterial to the…

Methodology · Statistics 2022-01-07 Paul May , Hossein Moradi Rekabdarkolaee

In this work we address the problem of approximating high-dimensional data with a low-dimensional representation. We make the following contributions. We propose an inverse regression method which exchanges the roles of input and response,…

Machine Learning · Computer Science 2015-09-04 Antoine Deleforge , Florence Forbes , Radu Horaud

Dimensional reduction techniques have long been used to visualize the structure and geometry of high dimensional data. However, most widely used techniques are difficult to interpret due to nonlinearities and opaque optimization processes.…

Quantitative Methods · Quantitative Biology 2024-01-09 Andrew Baumgartner , Sui Huang , Jennifer Hadlock , Cory Funk

In 2018, McInnes et al. introduced a dimensionality reduction algorithm called UMAP, which enjoys wide popularity among data scientists. Their work introduces a finite variant of a functor called the metric realization, based on an…

Machine Learning · Statistics 2026-03-05 David Wegmann

UMAP is a non-parametric graph-based dimensionality reduction algorithm using applied Riemannian geometry and algebraic topology to find low-dimensional embeddings of structured data. The UMAP algorithm consists of two steps: (1) Compute a…

Machine Learning · Computer Science 2021-08-31 Tim Sainburg , Leland McInnes , Timothy Q Gentner

Dimensionality reduction is crucial both for visualization and preprocessing high dimensional data for machine learning. We introduce a novel method based on a hierarchy built on 1-nearest neighbor graphs in the original space which is used…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 M. Saquib Sarfraz , Marios Koulakis , Constantin Seibold , Rainer Stiefelhagen

Latent variable models are powerful tools for learning low-dimensional manifolds from high-dimensional data. However, when dealing with constrained data such as unit-norm vectors or symmetric positive-definite matrices, existing approaches…

Machine Learning · Computer Science 2025-03-10 Leonel Rozo , Miguel González-Duque , Noémie Jaquier , Søren Hauberg

Recently, Su and Cook proposed a dimension reduction technique called the inner envelope which can be substantially more efficient than the original envelope or existing dimension reduction techniques for multivariate regression. However,…

Methodology · Statistics 2022-05-25 Linquan Ma , Hyunseung Kang , Lan Liu

In regression tasks, aleatoric uncertainty is commonly addressed by considering a parametric distribution of the output variable, which is based on strong assumptions such as symmetry, unimodality or by supposing a restricted shape. These…

Machine Learning · Computer Science 2019-10-30 Axel Brando , Jose A. Rodríguez-Serrano , Jordi Vitrià , Alberto Rubio