English
Related papers

Related papers: Fast Dimensionality Reduction from $\ell_2$ to $\e…

200 papers

Near isometric orthogonal embeddings to lower dimensions are a fundamental tool in data science and machine learning. In this paper, we present the construction of such embeddings that minimizes the maximum distortion for a given set of…

Machine Learning · Statistics 2017-12-15 Kshiteej Sheth , Dinesh Garg , Anirban Dasgupta

In this paper, we propose a unified algorithmic framework for solving many known variants of \mds. Our algorithm is a simple iterative scheme with guaranteed convergence, and is \emph{modular}; by changing the internals of a single…

Machine Learning · Computer Science 2010-03-31 Arvind Agarwal , Jeff M. Phillips , Suresh Venkatasubramanian

In machine learning or statistics, it is often desirable to reduce the dimensionality of a sample of data points in a high dimensional space $\mathbb{R}^d$. This paper introduces a dimensionality reduction method where the embedding…

Machine Learning · Computer Science 2021-11-30 Michaël Fanuel , Antoine Aspeel , Jean-Charles Delvenne , Johan A. K. Suykens

Distance geometry explores the properties of distance spaces that can be exactly represented as the pairwise Euclidean distances between points in $\mathbb{R}^d$ ($d \geq 1$), or equivalently, distance spaces that can be isometrically…

Computational Geometry · Computer Science 2025-03-26 Matthias Bentert , Fedor V. Fomin , Petr A. Golovach , M. S. Ramanujan , Saket Saurabh

The distance metric plays an important role in nearest neighbor (NN) classification. Usually the Euclidean distance metric is assumed or a Mahalanobis distance metric is optimized to improve the NN performance. In this paper, we study the…

Machine Learning · Statistics 2007-06-26 Bharath K. Sriperumbudur , Gert R. G. Lanckriet

We consider a generalization of the classic linear regression problem to the case when the loss is an Orlicz norm. An Orlicz norm is parameterized by a non-negative convex function $G:\mathbb{R}_+\rightarrow\mathbb{R}_+$ with $G(0)=0$: the…

Data Structures and Algorithms · Computer Science 2018-06-19 Alexandr Andoni , Chengyu Lin , Ying Sheng , Peilin Zhong , Ruiqi Zhong

We study the problem of recovering a globally consistent Euclidean embedding of data, given only a local distance graph and propose a method that optimally represents these distances. The method operates solely on a neighborhood graph…

Machine Learning · Computer Science 2026-05-20 Dimitris Arabadjis

Dimensionality reduction is a fundamental task in modern data science. Several projection methods specifically tailored to take into account the non-linearity of the data via local embeddings have been proposed. Such methods are often based…

Machine Learning · Statistics 2026-01-28 Antonio Di Noia , Federico Ravenda , Antonietta Mira

The problem of finding suitable point embedding or geometric configurations given only Euclidean distance information of point pairs arises both as a core task and as a sub-problem in a variety of machine learning applications. In this…

Machine Learning · Computer Science 2024-10-23 Ipsita Ghosh , Abiy Tasissa , Christian Kümmerle

In this work, we propose an efficient two-metric adaptive projection method for solving the $\ell_1$-norm minimization problem. Our approach is inspired by the two-metric projection method, a simple yet elegant algorithm proposed by…

Optimization and Control · Mathematics 2026-04-16 Hanju Wu , Yue Xie

The Johnson-Lindenstrauss Lemma (J-L Lemma) is a cornerstone of dimension reduction techniques. We study it in the one-bit context, namely we consider the unit sphere $ \mathbb S ^{N-1}$, with normalized geodesic metric, and map a finite…

Functional Analysis · Mathematics 2019-03-07 Amadou Bah , Bryson Kagy , Emily Smith

We derive a dimensionally-reduced limit theory for an $n$-dimensional nonlinear elastic body that is slender along $k$ dimensions. The starting point is to view an elastic body as an $n$-dimensional Riemannian manifold together with a not…

Differential Geometry · Mathematics 2014-09-09 Raz Kupferman , Jake P. Solomon

We study integration and $L_2$-approximation on countable tensor products of function spaces of increasing smoothness. We obtain upper and lower bounds for the minimal errors, which are sharp in many cases including, e.g., Korobov, Walsh,…

Numerical Analysis · Mathematics 2021-09-21 M. Gnewuch , M. Hefter , A. Hinrichs , K. Ritter , G. W. Wasilkowski

We present an optimal O*(n^2) time algorithm for deciding if a metric space (X,d) on n points can be isometrically embedded into the plane endowed with the l_1-metric. It improves the O*(n^2 log^2 n) time algorithm of J. Edmonds (2008).…

Computational Geometry · Computer Science 2011-07-08 Nicolas Catusse , Victor Chepoi , Yann Vaxès

In this paper, we study the problem of approximately computing the product of two real matrices. In particular, we analyze a dimensionality-reduction-based approximation algorithm due to Sarlos [1], introducing the notion of nuclear rank as…

Statistics Theory · Mathematics 2014-04-01 Anastasios Kyrillidis , Michail Vlachos , Anastasios Zouzias

In this note, we show that one can use average embeddings, introduced recently in [Naor'20, arXiv:1905.01280], to obtain efficient algorithms for approximate nearest neighbor search. In particular, a metric $X$ embeds into $\ell_2$ on…

Data Structures and Algorithms · Computer Science 2021-05-13 Alexandr Andoni , David Cheikhi

An oblivious subspace embedding is a random $m\times n$ matrix $\Pi$ such that, for any $d$-dimensional subspace, with high probability $\Pi$ preserves the norms of all vectors in that subspace within a $1\pm\epsilon$ factor. In this work,…

Data Structures and Algorithms · Computer Science 2025-04-30 Shabarish Chenakkod , Michał Dereziński , Xiaoyu Dong

Recent works in dimensionality reduction for regression tasks have introduced the notion of sensitivity, an estimate of the importance of a specific datapoint in a dataset, offering provable guarantees on the quality of the approximation…

Machine Learning · Computer Science 2023-11-22 Swati Padmanabhan , David P. Woodruff , Qiuyi Zhang

Image ranking is to rank images based on some known ranked images. In this paper, we propose an improved linear ordinal distance metric learning approach based on the linear distance metric learning model. By decomposing the distance metric…

Machine Learning · Computer Science 2019-02-28 Panpan Yu , Qingna Li

Real-world data usually have high dimensionality and it is important to mitigate the curse of dimensionality. High-dimensional data are usually in a coherent structure and make the data in relatively small true degrees of freedom. There are…

Machine Learning · Computer Science 2021-03-12 Xiang Wang , Xiaoyong Li , Junxing Zhu , Zichen Xu , Kaijun Ren , Weiming Zhang , Xinwang Liu , Kui Yu