English
Related papers

Related papers: A Derandomized Sparse Johnson-Lindenstrauss Transf…

200 papers

In this paper a deterministic sparse Fourier transform algorithm is presented which breaks the quadratic-in-sparsity runtime bottleneck for a large class of periodic functions exhibiting structured frequency support. These functions…

Numerical Analysis · Mathematics 2017-11-21 Sina Bittens , Ruochuan Zhang , Mark A. Iwen

This paper presents a significant modification to the Random Demodulator (RD) of Tropp et al. for sub-Nyquist sampling of frequency-sparse signals. The modification, termed constrained random demodulator, involves replacing the random…

Information Theory · Computer Science 2018-03-06 Andrew Harms , Waheed U. Bajwa , Robert Calderbank

Many finance, physics, and engineering phenomena are modeled by continuous-time dynamical systems driven by highly irregular (stochastic) inputs. A powerful tool to perform time series analysis in this context is rooted in rough path theory…

Machine Learning · Computer Science 2023-04-27 Enea Monzio Compagnoni , Anna Scampicchio , Luca Biggio , Antonio Orvieto , Thomas Hofmann , Josef Teichmann

We investigate the reconstruction of multivariate functions from samples using sparse recovery techniques. For Square Root Lasso, Orthogonal Matching Pursuit, and Compressive Sampling Matching Pursuit, we demonstrate both theoretically and…

Numerical Analysis · Mathematics 2026-01-21 Moritz Moeller , Sebastian Neumayer , Kateryna Pozharska , Tizian Sommerfeld , Tino Ullrich

Johnson and Lindenstrauss (Contemporary Mathematics, 1984) showed that for $n > m$, a scaled random projection $\mathbf{A}$ from $\mathbb{R}^n$ to $\mathbb{R}^m$ is an approximate isometry on any set $S$ of size at most exponential in $m$.…

Computation · Statistics 2025-04-15 Andrej Bogdanov , Alon Rosen , Neekon Vafa , Vinod Vaikuntanathan

This paper is devoted to give a simplified proof of the trace theorem for functions of bounded deformation defined on bounded Lipschitz domains of $\mathbb{R}^n$. As a consequence, the existence of one-sided Lebesgue limits on countably…

Functional Analysis · Mathematics 2014-04-14 Jean-François Babadjian

Reconstruction fidelity of sparse signals contaminated by sparse noise is considered. Statistical mechanics inspired tools are used to show that the l1-norm based convex optimization algorithm exhibits a phase transition between the…

Information Theory · Computer Science 2013-09-17 Mikko Vehkapera , Yoshiyuki Kabashima , Saikat Chatterjee

Uniform bounds on sketched inner products of vectors or matrices underpin several important computational and statistical results in machine learning and randomized algorithms, including the Johnson-Lindenstrauss (J-L) lemma, the Restricted…

Machine Learning · Computer Science 2025-09-29 Rohan Deb , Qiaobo Li , Mayank Shrivastava , Arindam Banerjee

In the SIGGRAPH 2014 paper [SvTSH14] an approach for animating deformable objects using sparse spacetime constraints is introduced. This report contains the proofs of two theorems presented in the paper.

Graphics · Computer Science 2014-05-09 Christian Schulz , Christoph von Tycowicz , Hans-Peter Seidel , Klaus Hildebrandt

We prove the Johnson-Lindenstrauss property for matrices $\Phi D_\xi$ where $\Phi$ has the restricted isometry property and $D_\xi$ is a diagonal matrix containing the entries of a Kronecker product $\xi = \xi^{(1)} \otimes \dots \otimes…

Data Structures and Algorithms · Computer Science 2021-06-28 Stefan Bamberger , Felix Krahmer , Rachel Ward

In this paper we extend the deterministic sublinear FFT algorithm in Plonka et al. (2018) for fast reconstruction of $M$-sparse vectors ${\mathbf x}$ of length $N= 2^J$, where we assume that all components of the discrete Fourier transform…

Numerical Analysis · Mathematics 2021-03-09 Gerlind Plonka , Therese von Wulffen

Sparsity-based methods are widely used in machine learning, statistics, and signal processing. There is now a rich class of structured sparsity approaches that expand the modeling power of the sparsity paradigm and incorporate constraints…

Data Structures and Algorithms · Computer Science 2017-12-22 Aleksander Mądry , Slobodan Mitrović , Ludwig Schmidt

We consider the problem of recursively and causally reconstructing time sequences of sparse signals (with unknown and time-varying sparsity patterns) from a limited number of noisy linear measurements. The sparsity pattern is assumed to…

Information Theory · Computer Science 2010-07-28 Namrata Vaswani

In this paper, a derandomized algorithm for sampling decoding is proposed to achieve near-optimal performance in lattice decoding. By setting a probability threshold to sample candidates, the whole sampling procedure becomes deterministic,…

Information Theory · Computer Science 2016-11-17 Zheng Wang , Shuiyin Liu , Cong Ling

Johnson-Lindenstrauss (JL) matrices implemented by sparse random synaptic connections are thought to be a prime candidate for how convergent pathways in the brain compress information. However, to date, there is no complete mathematical…

Neurons and Cognition · Quantitative Biology 2014-11-21 Zeyuan Allen-Zhu , Rati Gelashvili , Silvio Micali , Nir Shavit

Random linear codes are a workhorse in coding theory, and are used to show the existence of codes with the best known or even near-optimal trade-offs in many noise models. However, they have little structure besides linearity, and are not…

Computational Complexity · Computer Science 2024-07-11 Venkatesan Guruswami , Jonathan Mosheiff

We propose a new construction for low-density source codes with multiple parameters that can be tuned to optimize the performance of the code. In addition, we introduce a set of analysis techniques for deriving upper bounds for the expected…

Information Theory · Computer Science 2007-07-13 Emin Martinian , Martin J. Wainwright

The Johnson-Lindenstrauss (JL) lemma allows subsets of a high-dimensional space to be embedded into a lower-dimensional space while approximately preserving all pairwise Euclidean distances. This important result has inspired an extensive…

Data Structures and Algorithms · Computer Science 2025-01-27 Edem Boahen , March T. Boedihardjo , Rafael Chiclana , Mark Iwen

We propose two semiparametric versions of the debiased Lasso procedure for the model $Y_i = X_i\beta_0 + g_0(Z_i) + \epsilon_i$, where $\beta_0$ is high dimensional but sparse (exactly or approximately). Both versions are shown to have the…

Statistics Theory · Mathematics 2017-08-09 Ying Zhu , Zhuqing Yu , Guang Cheng

In this work, we obtain sufficient conditions for the ``stability" of our recently proposed algorithms, modified-CS (for noisy measurements) and Least Squares CS-residual (LS-CS), designed for recursive reconstruction of sparse signal…

Information Theory · Computer Science 2010-06-25 Namrata Vaswani