中文
相关论文

相关论文: A Sparse Johnson-Lindenstrauss Transform using Fas…

200 篇论文

Probabilistic proofs of the Johnson-Lindenstrauss lemma imply that random projection can reduce the dimension of a data set and approximately preserve pairwise distances. If a distance being approximately preserved is called a success, and…

统计理论 · 数学 2024-07-15 Jason Bernstein , Alec M. Dunton , Benjamin W. Priest

In this paper we revisit the deterministic version of the Sparse Fourier Transform problem, which asks to read only a few entries of $x \in \mathbb{C}^n$ and design a recovery algorithm such that the output of the algorithm approximates…

数据结构与算法 · 计算机科学 2020-05-08 Yi Li , Vasileios Nakos

The Johnson-Lindenstrauss Lemma allows for the projection of $n$ points in $p-$dimensional Euclidean space onto a $k-$dimensional Euclidean space, with $k \ge \frac{24\ln \emph{n}}{3\epsilon^2-2\epsilon^3}$, so that the pairwise distances…

机器学习 · 统计学 2010-05-11 Javier Rojo , Tuan Nguyen

The existing work on densification of one permutation hashing reduces the query processing cost of the $(K,L)$-parameterized Locality Sensitive Hashing (LSH) algorithm with minwise hashing, from $O(dKL)$ to merely $O(d + KL)$, where $d$ is…

统计方法学 · 统计学 2014-06-19 Anshumali Shrivastava , Ping Li

It is well known that the Johnson-Lindenstrauss dimensionality reduction method is optimal for worst case distortion. While in practice many other methods and heuristics are used, not much is known in terms of bounds on their performance.…

数据结构与算法 · 计算机科学 2022-03-17 Yair Bartal , Ora Nova Fandina , Kasper Green Larsen

This work suggests faster and space-efficient index construction algorithms for LSH for Euclidean distance (\textit{a.k.a.}~\ELSH) and cosine similarity (\textit{a.k.a.}~\SRP). The index construction step of these LSHs relies on grouping…

数据结构与算法 · 计算机科学 2025-07-18 Bhisham Dev Verma , Rameshwar Pratap

In recent years, a lot of attention has been devoted to efficient nearest neighbor search by means of similarity-preserving hashing. One of the plights of existing hashing techniques is the intrinsic trade-off between performance and…

计算机视觉与模式识别 · 计算机科学 2014-02-18 Jonathan Masci , Alex M. Bronstein , Michael M. Bronstein , Pablo Sprechmann , Guillermo Sapiro

This work constructs Jonson-Lindenstrauss embeddings with best accuracy, as measured by variance, mean-squared error and exponential concentration of the length distortion. Lower bounds for any data and embedding dimensions are determined,…

机器学习 · 计算机科学 2021-01-05 Maciej Skorski

The algorithmic tasks of computing the Hamming distance between a given pattern of length $m$ and each location in a text of length $n$ is one of the most fundamental algorithmic tasks in string algorithms. Unfortunately, there is evidence…

数据结构与算法 · 计算机科学 2015-12-15 Tsvi Kopelowitz , Ely Porat

The application that motivates this paper is molecular imaging at the atomic level. When discretized at sub-atomic distances, the volume is inherently sparse. Noiseless measurements from an imaging technology can be modeled by convolution…

数据分析、统计与概率 · 物理学 2015-05-13 Michael Ting , Raviv Raich , Alfred O. Hero

Consider the approximate sparse recovery problem: given Ax, where A is a known m-by-n dimensional matrix and x is an unknown (approximately) sparse n-dimensional vector, recover an approximation to x. The goal is to design the matrix A such…

数据结构与算法 · 计算机科学 2014-11-11 Arnab Bhattacharyya , Vineet Nair

Feature hashing, also known as {\em the hashing trick}, introduced by Weinberger et al. (2009), is one of the key techniques used in scaling-up machine learning algorithms. Loosely speaking, feature hashing uses a random sparse projection…

机器学习 · 计算机科学 2018-05-23 Casper Benjamin Freksen , Lior Kamma , Kasper Green Larsen

An "oblivious subspace embedding (OSE)" given some parameters eps,d is a distribution D over matrices B in R^{m x n} such that for any linear subspace W in R^n with dim(W) = d it holds that Pr_{B ~ D}(forall x in W ||B x||_2 in (1 +/-…

数据结构与算法 · 计算机科学 2012-11-07 Jelani Nelson , Huy L. Nguyen

Given $n$ noisy samples with $p$ dimensions, where $n \ll p$, we show that the multi-step thresholding procedure based on the Lasso -- we call it the {\it Thresholded Lasso}, can accurately estimate a sparse vector $\beta \in {\mathbb R}^p$…

统计理论 · 数学 2025-10-28 Shuheng Zhou

We study representations of data from an arbitrary metric space $\mathcal{X}$ in the space of univariate Gaussian mixtures with a transport metric (Delon and Desolneux 2020). We derive embedding guarantees for feature maps implemented by…

机器学习 · 计算机科学 2023-10-17 Anastasis Kratsios , Valentin Debarnot , Ivan Dokmanić

The paper by Alfons, Croux and Gelper (2013), Sparse least trimmed squares regression for analyzing high-dimensional large data sets, considered a combination of least trimmed squares (LTS) and lasso penalty for robust and sparse…

应用统计 · 统计学 2013-12-10 Yuao Hu , Ye Tian , Heng Lian

Consider a random matrix $H:\mathbb{R}^n\longrightarrow\mathbb{R}^m$. Let $D\geq2$ and let $\{W_l\}_{l=1}^{p}$ be a set of $k$-dimensional affine subspaces of $\mathbb{R}^n$. We ask what is the probability that for all $1\leq l\leq p$ and…

泛函分析 · 数学 2013-08-14 Alon Dmitriyuk , Yehoram Gordon

Let $A \subseteq \{0,1,\dots,N\}$ be a random set in which each element is included independently with probability $p=p(N)$. Fix an integer $h \geq 2$ and a linear form $$L(x_1,\dots,x_h) := u_1x_1 + \cdots + u_hx_h.$$ We study the random…

组合数学 · 数学 2026-01-30 Ryan Jeong , Steven J. Miller

This paper presents an improved analysis of a structured dimension-reduction map called the subsampled randomized Hadamard transform. This argument demonstrates that the map preserves the Euclidean geometry of an entire subspace of vectors.…

数值分析 · 数学 2014-04-29 Joel A. Tropp

Given an arbitrary matrix $A\in\mathbb{R}^{n\times n}$, we consider the fundamental problem of computing $Ax$ for any $x\in\mathbb{R}^n$ such that $Ax$ is $s$-sparse. While fast algorithms exist for particular choices of $A$, such as the…

计算复杂性 · 计算机科学 2021-05-14 Tim Fuchs , David Gross , Felix Krahmer , Richard Kueng , Dustin G. Mixon