English
Related papers

Related papers: Small Width, Low Distortions: Quantized Random Emb…

200 papers

Distance function to a compact set plays a central role in several areas of computational geometry. Methods that rely on it are robust to the perturbations of the data by the Hausdorff noise, but fail in the presence of outliers. The…

Computational Geometry · Computer Science 2011-02-25 Leonidas J. Guibas , Quentin Mérigot , Dmitriy Morozov

We consider the problem of embedding a finite set of points $\{x_1, \ldots, x_n\} \in \mathbb{R}^d$ that satisfy $\ell_2^2$ triangle inequalities into $\ell_1$, when the points are approximately low-dimensional. Goemans (unpublished,…

Data Structures and Algorithms · Computer Science 2017-06-22 Yuval Rabani , Rakesh Venkat

Spectral embedding based on the Singular Value Decomposition (SVD) is a widely used "preprocessing" step in many learning tasks, typically leading to dimensionality reduction by projecting onto a number of dominant singular vectors and…

Machine Learning · Statistics 2015-09-29 Dinesh Ramasamy , Upamanyu Madhow

The rate-distortion-perception (RDP) framework has attracted significant recent attention due to its application in neural compression. It is important to understand the underlying mechanism connecting procedures with common randomness and…

Information Theory · Computer Science 2024-06-28 Ruida Zhou , Chao Tian

Let $X$ be a $d$-dimensional random vector and $X_\theta$ its projection onto the span of a set of orthonormal vectors $\{\theta_1,...,\theta_k\}$. Conditions on the distribution of $X$ are given such that if $\theta$ is chosen according to…

Probability · Mathematics 2011-02-16 Elizabeth Meckes

Given a metric space $(X,d)$, a set of terminals $K\subseteq X$, and a parameter $t\ge 1$, we consider metric structures (e.g., spanners, distance oracles, embedding into normed spaces) that preserve distances for all pairs in $K\times X$…

Data Structures and Algorithms · Computer Science 2018-02-23 Michael Elkin , Ofer Neiman

Statistical distance measures have found wide applicability in information retrieval tasks that typically involve high dimensional datasets. In order to reduce the storage space and ensure efficient performance of queries, dimensionality…

Computational Geometry · Computer Science 2010-03-09 Arnab Bhattacharya , Purushottam Kar , Manjish Pal

Kernel mean embeddings are a popular tool that consists in representing probability measures by their infinite-dimensional mean embeddings in a reproducing kernel Hilbert space. When the kernel is characteristic, mean embeddings can be used…

Machine Learning · Computer Science 2021-06-29 Boris Muzellec , Francis Bach , Alessandro Rudi

The random sampling task performed by Google's Sycamore processor gave us a glimpse of the "Quantum Supremacy era". This has definitely shed some spotlight on the power of random quantum circuits in this abstract task of sampling outputs…

Quantum Physics · Physics 2024-01-23 Keerthi Kumaran , Manas Sajjan , Sangchul Oh , Sabre Kais

We propose a scheme for recycling Gaussian random vectors into structured matrices to approximate various kernel functions in sublinear time via random embeddings. Our framework includes the Fastfood construction as a special case, but also…

Machine Learning · Computer Science 2016-05-31 Krzysztof Choromanski , Vikas Sindhwani

In this paper, we present a unified analysis of matrix completion under general low-dimensional structural constraints induced by {\em any} norm regularization. We consider two estimators for the general problem of structured matrix…

Machine Learning · Statistics 2018-11-26 Suriya Gunasekar , Arindam Banerjee , Joydeep Ghosh

A map $\varphi:K\to R^2$ of a graph $K$ is approximable by embeddings, if for each $\varepsilon>0$ there is an $\varepsilon$-close to $\varphi$ embedding $f:K\to R^2$. Analogous notions were studied in computer science under the names of…

Geometric Topology · Mathematics 2018-10-02 Arkadiy Skopenkov

The fields of compressed sensing (CS) and matrix completion have shown that high-dimensional signals with sparse or low-rank structure can be effectively projected into a low-dimensional space (for efficient acquisition or processing) when…

Information Theory · Computer Science 2013-05-16 Han Lun Yap , Michael B. Wakin , Christopher J. Rozell

Wideband communication receivers often deal with the problems of detecting weak signals from distant sources received together with strong nearby interferers. When the techniques of random modulation are used in communication system…

Information Theory · Computer Science 2018-11-15 Dian Mo , Marco F. Duarte

Different types of two- and three-dimensional representations of a finite metric space are studied that focus on the accurate representation of the linear order among the distances rather than their actual values. Lower and upper bounds for…

Combinatorics · Mathematics 2007-05-23 Jobst Heitzig

Graphs with bounded highway dimension were introduced by Abraham et al. [SODA 2010] as a model of transportation networks. We show that any such graph can be embedded into a distribution over bounded treewidth graphs with arbitrarily small…

Data Structures and Algorithms · Computer Science 2019-06-20 Andreas Emil Feldmann , Wai Shing Fung , Jochen Könemann , Ian Post

We consider the problem of efficient randomized dimensionality reduction with norm-preservation guarantees. Specifically we prove data-dependent Johnson-Lindenstrauss-type geometry preservation guarantees for Ho's random subspace method:…

Machine Learning · Statistics 2017-05-19 Nick Lim , Robert J. Durrant

Finding sparse vectors is a fundamental problem that arises in several contexts including codes, subspaces, and lattices. In this work, we prove strong inapproximability results for all these variants using a novel approach that even…

Computational Complexity · Computer Science 2025-06-26 Vijay Bhattiprolu , Venkatesan Guruswami , Euiwoong Lee , Xuandi Ren

Low-dimensional embeddings are essential for machine learning tasks involving graphs, such as node classification, link prediction, community detection, network visualization, and network compression. Although recent studies have identified…

Machine Learning · Computer Science 2025-03-04 Nikolaos Nakis , Niels Raunkjær Holm , Andreas Lyhne Fiehn , Morten Mørup

In Compressive Sensing, the Restricted Isometry Property (RIP) ensures that robust recovery of sparse vectors is possible from noisy, undersampled measurements via computationally tractable algorithms. It is by now well-known that Gaussian…

Information Theory · Computer Science 2014-02-17 Armin Eftekhari , Han Lun Yap , Christopher J. Rozell , Michael B. Wakin