English
Related papers

Related papers: Sample-Optimal Average-Case Sparse Fourier Transfo…

200 papers

For every fixed constant $\alpha > 0$, we design an algorithm for computing the $k$-sparse Walsh-Hadamard transform of an $N$-dimensional vector $x \in \mathbb{R}^N$ in time $k^{1+\alpha} (\log N)^{O(1)}$. Specifically, the algorithm is…

Information Theory · Computer Science 2015-04-30 Mahdi Cheraghchi , Piotr Indyk

We advocate a compressed sensing strategy that consists of multiplying the signal of interest by a wide bandwidth modulation before projection onto randomly selected vectors of an orthonormal basis. Firstly, in a digital setting with random…

Information Theory · Computer Science 2012-03-13 Gilles Puy , Pierre Vandergheynst , Rémi Gribonval , Yves Wiaux

We propose a Gauss-Legendre quadrature based sampling on the rotation group for the representation of a band-limited signal such that the Fourier transform (FT) of a signal can be exactly computed from its samples. Our figure of merit is…

Information Theory · Computer Science 2017-11-27 Zubair Khalid , Salman Durrani , Rodney A. Kennedy , Yves Wiaux , Jason D. McEwen

We study the information-theoretic limits of exactly recovering the support of a sparse signal using noisy projections defined by various classes of measurement matrices. Our analysis is high-dimensional in nature, in which the number of…

Statistics Theory · Mathematics 2008-06-04 Wei Wang , Martin J. Wainwright , Kannan Ramchandran

Finding the sparse representation of a signal in an overcomplete dictionary has attracted a lot of attention over the past years. This paper studies ProSparse, a new polynomial complexity algorithm that solves the sparse representation…

Information Theory · Computer Science 2017-07-11 Yue M. Lu , Jon Oñativia , Pier Luigi Dragotti

We develop and analyze stochastic optimization algorithms for problems in which the expected loss is strongly convex, and the optimum is (approximately) sparse. Previous approaches are able to exploit only one of these two structures,…

Machine Learning · Statistics 2012-07-19 Alekh Agarwal , Sahand Negahban , Martin J. Wainwright

We study the problem of sampling a random signal with sparse support in frequency domain. Shannon famously considered a scheme that instantaneously samples the signal at equispaced times. He proved that the signal can be reconstructed as…

Information Theory · Computer Science 2012-11-22 Adel Javanmard , Andrea Montanari

Even though image signals are typically defined on a regular two-dimensional grid, there also exist many scenarios where this is not the case and the amplitude of the image signal only is available for a non-regular subset of pixel…

Image and Video Processing · Electrical Eng. & Systems 2022-04-28 Jürgen Seiler , Markus Jonscher , Michael Schöberl , André Kaup

In many applications in compressed sensing, the measurement matrix is a Fourier matrix, i.e., it measures the Fourier transform of the underlying signal at some specified `base' frequencies $\{u_i\}_{i=1}^M$, where $M$ is the number of…

Information Theory · Computer Science 2018-02-09 Eeshan Malhotra , Himanshu Pandotra , Ajit Rajwade , Karthik S. Gurumoorthy

This paper addresses the problem of sparse phase retrieval, a fundamental inverse problem in applied mathematics, physics, and engineering, where a signal need to be reconstructed using only the magnitude of its transformation while phase…

Machine Learning · Statistics 2025-04-15 The Tien Mai

Subexponential parameterized algorithms are known for a wide range of natural problems on planar graphs, but the techniques are usually highly problem specific. The goal of this paper is to introduce a framework for obtaining…

Data Structures and Algorithms · Computer Science 2021-10-29 Dániel Marx , Pranabendu Misra , Daniel Neuen , Prafullkumar Tale

In the second part of the series papers, we set out to study the algorithmic efficiency of sparse sensing. Stemmed from co-prime sensing, we propose a generalized framework, termed Diophantine sensing, which utilizes generic Diophantine…

Information Theory · Computer Science 2021-08-25 Hanshen Xiao , Beining Zhou , Guoqiang Xiao

In recent years, phase retrieval has received much attention in statistics, applied mathematics and optical engineering. In this paper, we propose an efficient algorithm, termed Subspace Phase Retrieval (SPR), which can accurately recover…

Information Theory · Computer Science 2024-04-09 Mengchu Xu , Dekuan Dong , Jian Wang

In this paper, we propose a novel normalized subband adaptive filter algorithm suited for sparse scenarios, which combines the proportionate and sparsity-aware mechanisms. The proposed algorithm is derived based on the proximal…

Signal Processing · Electrical Eng. & Systems 2021-08-24 Gang Guo , Yi Yu , Rodrigo C. de Lamare , Zongsheng Zheng , Lu Lu , Qiangming Cai

Wideband analog signals push contemporary analog-to-digital conversion systems to their performance limits. In many applications, however, sampling at the Nyquist rate is inefficient because the signals of interest contain only a small…

Information Theory · Computer Science 2016-11-15 Joel A. Tropp , Jason N. Laska , Marco F. Duarte , Justin K. Romberg , Richard G. Baraniuk

We present a sparse multidimensional FFT (sMFFT) randomized algorithm for real positive vectors. The algorithm works in any fixed dimension, requires (O(R log(R) log(N)) ) samples and runs in O( R log^2(R) log(N)) complexity (where N is the…

Data Structures and Algorithms · Computer Science 2016-12-08 Pierre-David Letourneau , Harper Langston , Benoit Meister , Richard Lethin

Mean field theory has provided theoretical insights into various algorithms by letting the problem size tend to infinity. We argue that the applications of mean-field theory go beyond theoretical insights as it can inspire the design of…

Machine Learning · Computer Science 2023-02-14 Hadi Daneshmand , Francis Bach

Sparse coding--that is, modelling data vectors as sparse linear combinations of basis elements--is widely used in machine learning, neuroscience, signal processing, and statistics. This paper focuses on the large-scale matrix factorization…

Machine Learning · Statistics 2010-02-11 Julien Mairal , Francis Bach , Jean Ponce , Guillermo Sapiro

The goal of (stable) sparse recovery is to recover a $k$-sparse approximation $x*$ of a vector $x$ from linear measurements of $x$. Specifically, the goal is to recover $x*$ such that ||x-x*||_p <= C min_{k-sparse x'} ||x-x'||_q for some…

Data Structures and Algorithms · Computer Science 2011-10-19 Piotr Indyk , Eric Price , David P. Woodruff

There are numerous examples of the so-called ``square root phenomenon'' in the field of parameterized algorithms: many of the most fundamental graph problems, parameterized by some natural parameter $k$, become significantly simpler when…

Data Structures and Algorithms · Computer Science 2022-10-03 Dániel Marx , Marcin Pilipczuk , Michał Pilipczuk