English
Related papers

Related papers: Dimension reduction techniques for $\ell_p$, $1 \l…

200 papers

We present a new technique for visualizing high-dimensional data called cluster MDS (cl-MDS), which addresses a common difficulty of dimensionality reduction methods: preserving both local and global structures of the original sample in a…

Graphics · Computer Science 2024-05-27 Patricia Hernández-León , Miguel A. Caro

For a family of interpolation norms $\| \cdot \|_{1,2,s}$ on $\mathbb{R}^n$, we provide a distribution over random matrices $\Phi_s \in \mathbb{R}^{m \times n}$ parametrized by sparsity level $s$ such that for a fixed set $X$ of $K$ points…

Data Structures and Algorithms · Computer Science 2015-06-03 Felix Krahmer , Rachel Ward

We show that every n-point tree metric admits a (1+eps)-embedding into a C(eps) log n-dimensional L_1 space, for every eps > 0, where C(eps) = O((1/eps)^4 log(1/eps)). This matches the natural volume lower bound up to a factor depending…

Metric Geometry · Mathematics 2011-09-07 James R. Lee , Arnaud de Mesmay , Mohammad Moharrami

The main goal of this paper is to develop a new embedding method which we use to show that some finite metric spaces admit low-distortion embeddings into all non-superreflexive spaces. This method is based on the theory of…

Functional Analysis · Mathematics 2018-11-13 Mikhail I. Ostrovskii , Beata Randrianantoanina

Let $X$ be a set of $n$ points of norm at most $1$ in the Euclidean space $R^k$, and suppose $\varepsilon>0$. An $\varepsilon$-distance sketch for $X$ is a data structure that, given any two points of $X$ enables one to recover the square…

Metric Geometry · Mathematics 2017-04-04 Noga Alon , Bo'az Klartag

Sobolev embeddings, of arbitrary order, are considered into function spaces on domains of $\mathbb R^n$ endowed with measures whose decay on balls is dominated by a power $d$ of their radius. Norms in arbitrary rearrangement-invariant…

Functional Analysis · Mathematics 2019-12-10 Andrea Cianchi , Luboš Pick , Lenka Slavíková

Given a set P of n points and a constant k, we are interested in computing the persistent homology of the Cech filtration of P for the k-distance, and investigate the effectiveness of dimensionality reduction for this problem, answering an…

Computational Geometry · Computer Science 2021-10-13 Shreya Arya , Jean-Daniel Boissonnat , Kunal Dutta , Martin Lotz

Real world re-identfication (ReID) algorithms aim to map new observations of an object to previously recorded instances. These systems are often constrained by quantity and size of the stored embeddings. To combat this scaling problem, we…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Luke McDermott

Lyapunov-Schmidt reduction is a dimensionality reduction technique in nonlinear systems analysis that is commonly utilised in the study of bifurcation problems in high-dimensional systems. The method is a systematic procedure for reducing…

Systems and Control · Electrical Eng. & Systems 2024-09-16 Pranav Gupta , Anastasia Bizyaeva , Ravi Banavar

Motivated by the problem of compressing point sets into as few bits as possible while maintaining information about approximate distances between points, we construct random nonlinear maps $\varphi_\ell$ that compress point sets in the…

Computational Geometry · Computer Science 2024-03-05 Brett Leroux , Luis Rademacher

We present a new approach to approximate nearest-neighbor queries in fixed dimension under a variety of non-Euclidean distances. We are given a set $S$ of $n$ points in $\mathbb{R}^d$, an approximation parameter $\varepsilon > 0$, and a…

Computational Geometry · Computer Science 2023-06-28 Ahmed Abdelkader , Sunil Arya , Guilherme D. da Fonseca , David M. Mount

Nonlinear dimensionality reduction or, equivalently, the approximation of high-dimensional data using a low-dimensional nonlinear manifold is an active area of research. In this paper, we will present a thematically different approach to…

Machine Learning · Computer Science 2019-12-21 Kelum Gajamannage , Randy Paffenroth

Data augmentation is one of the most popular techniques for improving the robustness of neural networks. In addition to directly training the model with original samples and augmented samples, a torrent of methods regularizing the distance…

Machine Learning · Computer Science 2020-11-30 Haohan Wang , Zeyi Huang , Xindi Wu , Eric P. Xing

The distance metric plays an important role in nearest neighbor (NN) classification. Usually the Euclidean distance metric is assumed or a Mahalanobis distance metric is optimized to improve the NN performance. In this paper, we study the…

Machine Learning · Statistics 2007-06-26 Bharath K. Sriperumbudur , Gert R. G. Lanckriet

The use of high-dimensional features has become a normal practice in many computer vision applications. The large dimension of these features is a limiting factor upon the number of data points which may be effectively stored and processed,…

Computer Vision and Pattern Recognition · Computer Science 2015-06-18 Sakrapee Paisitkriangkrai , Chunhua Shen , Anton van den Hengel

Embeddings play a pivotal role across various disciplines, offering compact representations of complex data structures. Randomized methods like Johnson-Lindenstrauss (JL) provide state-of-the-art and essentially unimprovable theoretical…

Machine Learning · Statistics 2024-12-11 Nikos Tsikouras , Constantine Caramanis , Christos Tzamos

The goal of ordinal embedding is to represent items as points in a low-dimensional Euclidean space given a set of constraints in the form of distance comparisons like "item $i$ is closer to item $j$ than item $k$". Ordinal constraints like…

Machine Learning · Statistics 2016-06-24 Lalit Jain , Kevin Jamieson , Robert Nowak

We consider the problem of constructing small coresets for $k$-Median in Euclidean spaces. Given a large set of data points $P\subset \mathbb{R}^d$, a coreset is a much smaller set $S\subset \mathbb{R}^d$, so that the $k$-Median costs of…

Data Structures and Algorithms · Computer Science 2023-02-28 Lingxiao Huang , Ruiyuan Huang , Zengfeng Huang , Xuan Wu

We provide several algorithms for constrained optimization of a large class of convex problems, including softmax, $\ell_p$ regression, and logistic regression. Central to our approach is the notion of width reduction, a technique which has…

Optimization and Control · Mathematics 2021-07-07 Deeksha Adil , Brian Bullins , Sushant Sachdeva

Ordinal embedding aims at finding a low dimensional representation of objects from a set of constraints of the form "item $j$ is closer to item $i$ than item $k$". Typically, each object is mapped onto a point vector in a low dimensional…

Machine Learning · Computer Science 2021-05-26 Aïssatou Diallo , Johannes Fürnkranz