English
Related papers

Related papers: On randomness reduction in the Johnson-Lindenstrau…

200 papers

In this paper, we study a fast approximation method for {\it large-scale high-dimensional} sparse least-squares regression problem by exploiting the Johnson-Lindenstrauss (JL) transforms, which embed a set of high-dimensional vectors into a…

Statistics Theory · Mathematics 2015-07-21 Tianbao Yang , Lijun Zhang , Qihang Lin , Rong Jin

For any $n>1$ and $0<\varepsilon<1/2$, we show the existence of an $n^{O(1)}$-point subset $X$ of $\mathbb{R}^n$ such that any linear map from $(X,\ell_2)$ to $\ell_2^m$ with distortion at most $1+\varepsilon$ must have $m = \Omega(\min\{n,…

Information Theory · Computer Science 2014-11-11 Kasper Green Larsen , Jelani Nelson

The \emph{Sparse Johnson-Lindenstrauss Transform} of Kane and Nelson (SODA 2012) provides a linear dimensionality-reducing map $A \in \mathbb{R}^{m \times u}$ in $\ell_2$ that preserves distances up to distortion of $1 + \varepsilon$ with…

Data Structures and Algorithms · Computer Science 2023-05-08 Jakob Bæk Tejs Houen , Mikkel Thorup

The Johnson-Lindenstrauss Lemma (J-L Lemma) is a cornerstone of dimension reduction techniques. We study it in the one-bit context, namely we consider the unit sphere $ \mathbb S ^{N-1}$, with normalized geodesic metric, and map a finite…

Functional Analysis · Mathematics 2019-03-07 Amadou Bah , Bryson Kagy , Emily Smith

We present a theoretical analysis of the approximation properties of convolutional architectures when applied to the modeling of temporal sequences. Specifically, we prove an approximation rate estimate (Jackson-type result) and an inverse…

Machine Learning · Computer Science 2023-05-31 Haotian Jiang , Qianxiao Li

In this article, we consider Poisson and Poisson convoluted geometric approximation to the sums of $n$ independent random variables under moment conditions. We use Stein's method to derive the approximation results in total variation…

Probability · Mathematics 2020-07-07 Pratima Eknath Kadu

New lower bounds on the total variation distance between the distribution of a sum of independent Bernoulli random variables and the Poisson random variable (with the same mean) are derived via the Chen-Stein method. The new bounds rely on…

Information Theory · Computer Science 2013-07-17 Igal Sason

In this paper we make a novel use of the Johnson-Lindenstrauss Lemma. The Lemma has an existential form saying that there exists a JL transformation $f$ of the data points into lower dimensional space such that all of them fall into…

Data Structures and Algorithms · Computer Science 2017-11-10 Mieczysław A. Kłopotek

Random events in space and time often exhibit a locally dependent structure. When the events are very rare and dependent structure is not too complicated, various studies in the literature have shown that Poisson and compound Poisson…

Probability · Mathematics 2011-02-22 Aihua Xia , Fuxi Zhang

Initially motivated by the study of the non-asymptotic properties of non-parametric tests based on permutation methods, concentration inequalities for uniformly permuted sums have been largely studied in the literature. Recently, Delyon et…

Probability · Mathematics 2018-05-10 Mélisande Albert

A Bayesian nonparametric method of James, Lijoi \& Prunster (2009) used to predict future values of observations from normalized random measures with independent increments is modified to a class of models based on negative binomial…

Methodology · Statistics 2024-02-20 Robert C. Griffiths , Ross A. Maller , Soudabeh Shemehsavar

A result of Chebyshev (1864) and Hoeffding1956}, on bounding an expectation of a given function with respect to a Bernoulli convolution (also called Poisson binomial law, or law of the number of successes in independent trials) with any…

Probability · Mathematics 2022-04-14 Lutz Mattner

Assuming a $q$-variant of the prime $k$-tuple conjecture uniformly, we compute mixed moments of the number of primes in disjoint short intervals and progressions, respectively. This involves estimating the mean of singular series along…

Number Theory · Mathematics 2024-11-26 Sun-Kai Leung

In this short note, we prove a version of the Johnson-Lindenstrauss flattening Lemma for point sets taking values in discrete subgroups. More precisely, given $d,\lambda_0,N_0\in\mathbb{N}$ and $\epsilon\in \left(0,\frac{1}{2}\right)$…

Metric Geometry · Mathematics 2025-01-22 Rodolfo Viera

Concentration inequalities, a major tool in probability theory, quantify how much a random variable deviates from a certain quantity. This paper proposes a systematic convex optimization approach to studying and generating concentration…

Probability · Mathematics 2024-08-30 Celine Moucer , Adrien Taylor , Francis Bach

This paper analyzes circulant Johnson-Lindenstrauss (JL) embeddings which, as an important class of structured random JL embeddings, are formed by randomizing the column signs of a circulant matrix generated by a random vector. With the…

Information Theory · Computer Science 2013-08-30 Hui Zhang , Lizhi Cheng

This paper considers the entropy of the sum of (possibly dependent and non-identically distributed) Bernoulli random variables. Upper bounds on the error that follows from an approximation of this entropy by the entropy of a Poisson random…

Information Theory · Computer Science 2016-11-17 Igal Sason

In the recent paper [Jin, Kolda & Ward, arXiv:1909.04801], it is proved that the Kronecker fast Johnson-Lindenstrauss transform (KFJLT) is, in fact, a Johnson-Lindenstrauss transform, which had previously only been conjectured. In this…

Numerical Analysis · Mathematics 2020-05-19 Osman Asif Malik , Stephen Becker

Spatial random permutations were originally studied due to their connections to Bose-Einstein condensation, but they possess many interesting properties of their own. For random permutations of a regular lattice with periodic boundary…

Probability · Mathematics 2015-06-17 Volker Betz

Dimensionality reduction-based dictionary learning methods in the literature have often used iterative random projections. The dimensionality of such a random projection matrix is a random number that might not lead to a separable subspace…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 G. Madhuri , Atul Negi , Kaluri V. Rangarao