English
Related papers

Related papers: Model-adapted Fourier sampling for generative comp…

200 papers

We study the use of very sparse random projections for compressed sensing (sparse signal recovery) when the signal entries can be either positive or negative. In our setting, the entries of a Gaussian design matrix are randomly sparsified…

Methodology · Statistics 2014-08-12 Ping Li , Cun-Hui Zhang

Generative models can now produce photorealistic synthetic data which is virtually indistinguishable from the real data used to train it. This is a significant evolution over previous models which could produce reasonable facsimiles of the…

Machine Learning · Computer Science 2024-12-10 Debargha Ganguly , Warren Morningstar , Andrew Yu , Vipin Chaudhary

We provide guarantees for learning latent variable models emphasizing on the overcomplete regime, where the dimensionality of the latent space can exceed the observed dimensionality. In particular, we consider multiview mixtures, spherical…

Machine Learning · Computer Science 2014-12-18 Animashree Anandkumar , Rong Ge , Majid Janzamin

We improve existing results in the field of compressed sensing and matrix completion when sampled data may be grossly corrupted. We introduce three new theorems. 1) In compressed sensing, we show that if the m \times n sensing matrix has…

Information Theory · Computer Science 2012-01-19 Xiaodong Li

In its most elementary form, compressed sensing studies the design of decoding algorithms to recover a sufficiently sparse vector or code from a lower dimensional linear measurement vector. Typically it is assumed that the decoder has…

Machine Learning · Computer Science 2021-07-20 Michael Murray , Jared Tanner

Finding a suitable measurement matrix is an important topic in compressed sensing. Though the known random matrix, whose entries are drawn independently from a certain probability distribution, can be used as a measurement matrix and…

Information Theory · Computer Science 2013-07-09 Yi-Zheng Fan , Tao Huang , Ming Zhu

In this paper, a new communication-efficient federated learning (FL) framework is proposed, inspired by vector quantized compressed sensing. The basic strategy of the proposed framework is to compress the local model update at each device…

Information Theory · Computer Science 2023-07-04 Yongjeong Oh , Yo-Seb Jeon , Mingzhe Chen , Walid Saad

We consider the problem of recovering a function over the space of permutations (or, the symmetric group) over $n$ elements from given partial information; the partial information we consider is related to the group theoretic Fourier…

Statistics Theory · Mathematics 2011-06-21 Srikanth Jagabathula , Devavrat Shah

This paper provides new error bounds on "consistent" reconstruction methods for signals observed from quantized random projections. Those signal estimation techniques guarantee a perfect matching between the available quantized data and a…

Information Theory · Computer Science 2016-04-21 Laurent Jacques

Approximate message passing (AMP) is an efficient iterative signal recovery algorithm for compressed sensing (CS). For sensing matrices with independent and identically distributed (i.i.d.) Gaussian entries, the behavior of AMP can be…

Information Theory · Computer Science 2016-10-20 Zhipeng Xue , Junjie Ma , Xiaojun Yuan

Signal retrieval from a series of indirect measurements is a common task in many imaging, metrology and characterization platforms in science and engineering. Because most of the indirect measurement processes are well-described by physical…

Image and Video Processing · Electrical Eng. & Systems 2020-08-24 Zheyuan Zhu , Yangyang Sun , Johnathon White , Zenghu Chang , Shuo Pang

There are two main approaches in compressed sensing: the geometric approach and the combinatorial approach. In this paper we introduce an information theoretic approach and use results from the theory of Huffman codes to construct a…

Information Theory · Computer Science 2009-06-26 Akram Aldroubi , Haichao Wang , Kourosh Zarringhalam

Recovering a sparse signal from its low-pass projections in the Fourier domain is a problem of broad interest in science and engineering and is commonly referred to as super-resolution. In many cases, however, Fourier domain may not be the…

Information Theory · Computer Science 2019-02-20 Ayush Bhandari , Yonina C. Eldar

Kernel methods have recently attracted resurgent interest, showing performance competitive with deep neural networks in tasks such as speech recognition. The random Fourier features map is a technique commonly used to scale up kernel…

Machine Learning · Computer Science 2018-02-01 Tri Dao , Christopher De Sa , Christopher Ré

Compressive phase retrieval refers to the problem of recovering a structured $n$-dimensional complex-valued vector from its phase-less under-determined linear measurements. The non-linearity of measurements makes designing…

Information Theory · Computer Science 2020-06-11 Milad Bakhshizadeh , Arian Maleki , Shirin Jalali

We study the problem of estimating the best B term Fourier representation for a given frequency-sparse signal (i.e., vector) $\textbf{A}$ of length $N \gg B$. More explicitly, we investigate how to deterministically identify B of the…

Discrete Mathematics · Computer Science 2007-08-10 M. A. Iwen

We consider the problem of recovering a $K$-sparse complex signal $x$ from $m$ intensity measurements. We propose the PhaseCode algorithm, and show that in the noiseless case, PhaseCode can recover an arbitrarily-close-to-one fraction of…

Information Theory · Computer Science 2017-04-03 Ramtin Pedarsani , Dong Yin , Kangwook Lee , Kannan Ramchandran

The growing scarcity of spectrum resources, wideband spectrum sensing is required to process a prohibitive volume of data at a high sampling rate. For some applications, spectrum estimation only requires second-order statistics. In this…

Signal Processing · Electrical Eng. & Systems 2023-11-27 Kaili Jiang , Dechang Wang , Kailun Tian , Hancong Feng , Yuxin Zhao , Junyu Yuan , Bin Tang

Even though Deep Neural Networks (DNNs) are widely celebrated for their practical performance, they possess many intriguing properties related to depth that are difficult to explain both theoretically and intuitively. Understanding how…

Machine Learning · Computer Science 2020-03-18 Christopher Snyder , Sriram Vishwanath

This paper introduces the Reed Muller Sieve, a deterministic measurement matrix for compressed sensing. The columns of this matrix are obtained by exponentiating codewords in the quaternary second order Reed Muller code of length $N$. For…

Information Theory · Computer Science 2010-04-20 Robert Calderbank , Stephen Howard , Sina Jafarpour