English
Related papers

Related papers: A dimensionality reduction technique based on the …

200 papers

Both Dimensionality Reduction (DR) and Graph Drawing (GD) aim to visualize abstract, non-linear structures, yet rely on different optimization paradigms. This contrast is evident in Multidimensional Scaling (MDS), which typically depends on…

Machine Learning · Computer Science 2026-05-04 Daniel Hangan , Stephen Kobourov , Jacob Miller

The Gromov-Wasserstein (GW) distance, rooted in optimal transport (OT) theory, quantifies dissimilarity between metric measure spaces and provides a framework for aligning heterogeneous datasets. While computational aspects of the GW…

Statistics Theory · Mathematics 2023-10-02 Zhengxin Zhang , Ziv Goldfeld , Youssef Mroueh , Bharath K. Sriperumbudur

In this paper, we address the problem of predicting a response variable in the context of both, spatially correlated and high-dimensional data. To reduce the dimensionality of the predictor variables, we apply the sufficient dimension…

Methodology · Statistics 2025-02-06 Liliana Forzani , Rodrigo García Arancibia , Antonella Gieco , Pamela Llop , Anne Yao

We present a set of algorithms implementing multidimensional scaling (MDS) for large data sets. MDS is a family of dimensionality reduction techniques using a $n \times n$ distance matrix as input, where $n$ is the number of individuals,…

Computation · Statistics 2024-02-02 Pedro Delicado , Cristian Pachón-García

The Gromov--Wasserstein (GW) distance and its fused extension (FGW) are powerful tools for comparing heterogeneous data. Their computation is, however, challenging since both distances are based on non-convex, quadratic optimal transport…

Machine Learning · Computer Science 2025-11-14 Moritz Piening , Robert Beinert

The real-life data have a complex and non-linear structure due to their nature. These non-linearities and the large number of features can usually cause problems such as the empty-space phenomenon and the well-known curse of dimensionality.…

Machine Learning · Computer Science 2025-03-13 Kadir Özçoban , Murat Manguoğlu , Emrullah Fatih Yetkin

In this paper, we propose several new stochastic second-order algorithms for policy optimization that only require gradient and Hessian-vector product in each iteration, making them computationally efficient and comparable to policy…

Optimization and Control · Mathematics 2023-01-31 Jinsong Liu , Chenghan Xie , Qi Deng , Dongdong Ge , Yinyu Ye

The quest for simplification in physics drives the exploration of concise mathematical representations for complex systems. This Dissertation focuses on the concept of dimensionality reduction as a means to obtain low-dimensional…

Machine Learning · Computer Science 2024-10-31 Eslam Abdelaleem

In this paper, we propose Wasserstein Isometric Mapping (Wassmap), a nonlinear dimensionality reduction technique that provides solutions to some drawbacks in existing global nonlinear dimensionality reduction algorithms in imaging…

Machine Learning · Computer Science 2023-02-22 Keaton Hamm , Nick Henscheid , Shujie Kang

In this work, we study distance metric learning (DML) for high dimensional data. A typical approach for DML with high dimensional data is to perform the dimensionality reduction first before learning the distance metric. The main…

Machine Learning · Computer Science 2015-09-16 Qi Qian , Rong Jin , Lijun Zhang , Shenghuo Zhu

The Sliced Gromov-Wasserstein (SGW) distance, aiming to relieve the computational cost of solving a non-convex quadratic program that is the Gromov-Wasserstein distance, utilizes projecting directions sampled uniformly from unit…

Machine Learning · Statistics 2025-07-18 Dhruv Sarkar , Aprameyo Chakrabartty , Anish Chakrabarty , Swagatam Das

Metric Multidimensional scaling (MDS) is a classical method for generating meaningful (non-linear) low-dimensional embeddings of high-dimensional data. MDS has a long history in the statistics, machine learning, and graph drawing…

Machine Learning · Computer Science 2021-09-24 Erik Demaine , Adam Hesterberg , Frederic Koehler , Jayson Lynch , John Urschel

Recently, two concepts from optimal transport theory have successfully been brought to the Gromov--Wasserstein (GW) setting. This introduces a linear version of the GW distance and multi-marginal GW transport. The former can reduce the…

Numerical Analysis · Mathematics 2022-11-16 Florian Beier , Robert Beinert

This paper explores the extension of dimension reduction (DR) techniques to the multi-dimension case by using the Einstein product. Our focus lies on graph-based methods, encompassing both linear and nonlinear approaches, within both…

Numerical Analysis · Mathematics 2025-11-25 Alaeddine Zahir , Khalide Jbilou , Ahmed Ratnani

Dimension reduction (DR) aims to learn low-dimensional representations of high-dimensional data with the preservation of essential information. In the context of manifold learning, we define that the representation after…

Machine Learning · Computer Science 2021-07-01 Siyuan Li , Haitao Lin , Zelin Zang , Lirong Wu , Jun Xia , Stan Z. Li

Dimensionality reduction (DR) on the manifold includes effective methods which project the data from an implicit relational space onto a vectorial space. Regardless of the achievements in this area, these algorithms suffer from the lack of…

Machine Learning · Computer Science 2019-09-23 Babak Hosseini , Barbara Hammer

This paper presents a new distance metric to compare two continuous probability density functions. The main advantage of this metric is that, unlike other statistical measurements, it can provide an analytic, closed-form expression for a…

Machine Learning · Computer Science 2023-06-14 Ahmad Sajedi , Yuri A. Lawryshyn , Konstantinos N. Plataniotis

Density-based distances (DBDs) provide a principled approach to metric learning by defining distances in terms of the underlying data distribution. By employing a Riemannian metric that increases in regions of low probability density,…

Machine Learning · Computer Science 2025-06-02 Peter Sorrenson , Daniel Behrend-Uriarte , Christoph Schnörr , Ullrich Köthe

With the rapid development of data collection techniques, complex data objects that are not in the Euclidean space are frequently encountered in new statistical applications. Fr\'echet regression model (Peterson & M\"uller 2019) provides a…

Methodology · Statistics 2022-12-08 Qi Zhang , Lingzhou Xue , Bing Li

The Gromov-Wasserstein (GW) framework adapts ideas from optimal transport to allow for the comparison of probability distributions defined on different metric spaces. Scalable computation of GW distances and associated matchings on graphs…

Machine Learning · Computer Science 2021-05-05 Samir Chowdhury , David Miller , Tom Needham