English
Related papers

Related papers: Improving the Johnson-Lindenstrauss Lemma

200 papers

In this paper, we study a fast approximation method for {\it large-scale high-dimensional} sparse least-squares regression problem by exploiting the Johnson-Lindenstrauss (JL) transforms, which embed a set of high-dimensional vectors into a…

Statistics Theory · Mathematics 2015-07-21 Tianbao Yang , Lijun Zhang , Qihang Lin , Rong Jin

Embedding complex objects as vectors in low dimensional spaces is a longstanding problem in machine learning. We propose in this work an extension of that approach, which consists in embedding objects as elliptical probability…

Machine Learning · Statistics 2019-02-19 Boris Muzellec , Marco Cuturi

In this paper we improve the bounds for the Carath\'eodory number, especially on algebraic varieties and with small gaps (not all monomials are present). We provide explicit lower and upper bounds on algebraic varieties, $\mathbb{R}^n$, and…

Functional Analysis · Mathematics 2021-07-20 Philipp J. di Dio , Mario Kummer

Continuing work initiated in an earlier publication (Asada, MNRAS. 394 (2009) 818), we make a systematic attempt to determine, as a function of lens and source parameters, the positions of images by multi-plane gravitational lenses. By…

Cosmology and Nongalactic Astrophysics · Physics 2012-03-03 Koji Izumi , Hideki Asada

Random Projections have been widely used to generate embeddings for various graph learning tasks due to their computational efficiency. The majority of applications have been justified through the Johnson-Lindenstrauss Lemma. In this paper,…

Social and Information Networks · Computer Science 2024-07-30 Tvrtko Tadić , Cassiano Becker , Jennifer Neville

Johnson and Lindenstrauss (Contemporary Mathematics, 1984) showed that for $n > m$, a scaled random projection $\mathbf{A}$ from $\mathbb{R}^n$ to $\mathbb{R}^m$ is an approximate isometry on any set $S$ of size at most exponential in $m$.…

Computation · Statistics 2025-04-15 Andrej Bogdanov , Alon Rosen , Neekon Vafa , Vinod Vaikuntanathan

For a measurable function on a set which has a finite measure, an inequality holds between two Lp-norms. In this paper, we show similar inequalities for the Euclidean space and the Lebesgue measure by using a q-moment which is a moment of…

Statistics Theory · Mathematics 2019-02-21 Tomohiro Nishiyama

We derive new limits on the value of the cosmological constant, $\Lambda$, based on the Einstein bending of light by systems where the lens is a distant galaxy or a cluster of galaxies. We use an amended lens equation in which the…

Astrophysics · Physics 2009-11-13 Mustapha Ishak , Wolfgang Rindler , Jason Dossett , Jacob Moldenhauer , Chris Allison

Dimensionality reduction is in demand to reduce the complexity of solving large-scale problems with data lying in latent low-dimensional structures in machine learning and computer version. Motivated by such need, in this work we study the…

Information Theory · Computer Science 2018-01-31 Gen Li , Qinghua Liu , Yuantao Gu

Given a set of $n$ points in $d$ dimensions, the Euclidean $k$-means problem (resp. the Euclidean $k$-median problem) consists of finding $k$ centers such that the sum of squared distances (resp. sum of distances) from every point to its…

Computational Geometry · Computer Science 2022-11-17 Vincent Cohen-Addad , Kasper Green Larsen , David Saulpic , Chris Schwiegelshohn , Omar Ali Sheikh-Omar

We study the complexity of geometric problems on spaces of low fractal dimension. It was recently shown by [Sidiropoulos & Sridhar, SoCG 2017] that several problems admit improved solutions when the input is a pointset in Euclidean space…

Computational Complexity · Computer Science 2017-12-14 Anastasios Sidiropoulos , Kritika Singhal , Vijay Sridhar

Let $S \subset {\mathbb R}^d$ be contained in the unit ball. Let $\Delta(S)=\{||a-b||:a,b \in S\}$, the Euclidean distance set of $S$. Falconer conjectured that the $\Delta(S)$ has positive Lebesque measure if the Hausdorff dimension of $S$…

Classical Analysis and ODEs · Mathematics 2007-05-23 A. Iosevich , M. Rudnev

Interesting data often concentrate on low dimensional smooth manifolds inside a high dimensional ambient space. Random projections are a simple, powerful tool for dimensionality reduction of such data. Previous works have studied bounds on…

Machine Learning · Statistics 2016-09-13 Subhaneil Lahiri , Peiran Gao , Surya Ganguli

In this work, we explore modewise Johnson-Lindenstrauss embeddings (JLEs) as a tool to reduce the computational cost and memory requirements of nuclear many-body methods. JLEs are randomized projections of high-dimensional data tensors onto…

Nuclear Theory · Physics 2023-05-04 A. Zare , R. Wirth , C. A. Haselby , H. Hergert , M. Iwen

In this paper, we give a conditional lower bound of $n^{\Omega(k)}$ on running time for the classic k-median and k-means clustering objectives (where n is the size of the input), even in low-dimensional Euclidean space of dimension four,…

Data Structures and Algorithms · Computer Science 2017-11-06 Vincent Cohen-Addad , Arnaud de Mesmay , Eva Rotenberg , Alan Roytman

Randomized dimensionality reduction is a widely-used algorithmic technique for speeding up large-scale Euclidean optimization problems. In this paper, we study dimension reduction for a variety of maximization problems, including…

Data Structures and Algorithms · Computer Science 2025-06-03 Jie Gao , Rajesh Jayaram , Benedikt Kolbe , Shay Sapir , Chris Schwiegelshohn , Sandeep Silwal , Erik Waingarten

Combinatorial optimization is a fertile testing ground for statistical physics methods developed in the context of disordered systems, allowing one to confront theoretical mean field predictions with actual properties of finite dimensional…

Disordered Systems and Neural Networks · Physics 2009-10-31 J. Houdayer , J. H. Boutet de Monvel , O. C. Martin

The modern ability to collect vast quantities of data poses a challenge for parameter estimation problems. When posed as a nonlinear least squares problem fitting a model to data, the cost of each iteration grows linearly with the amount of…

Numerical Analysis · Mathematics 2019-03-01 Jeffrey M. Hokanson

Consider a random matrix $H:\mathbb{R}^n\longrightarrow\mathbb{R}^m$. Let $D\geq2$ and let $\{W_l\}_{l=1}^{p}$ be a set of $k$-dimensional affine subspaces of $\mathbb{R}^n$. We ask what is the probability that for all $1\leq l\leq p$ and…

Functional Analysis · Mathematics 2013-08-14 Alon Dmitriyuk , Yehoram Gordon

Let $\mathcal{P}$ be an $n$-point subset of Euclidean space and $d\geq 3$ be an integer. In this paper we study the following question: What is the smallest (normalized) relative change of the volume of subsets of $\mathcal{P}$ when it is…

Discrete Mathematics · Computer Science 2010-03-03 Anastasios Zouzias