English
Related papers

Related papers: On Support Recovery with Sparse CCA: Information T…

200 papers

We demonstrate that sub-wavelength optical images borne on partially-spatially-incoherent light can be recovered, from their far-field or from the blurred image, given the prior knowledge that the image is sparse, and only that. The…

Information Theory · Computer Science 2015-05-27 Yoav Shechtman , Yonina C. Eldar , Alexander Szameit , Mordechai Segev

Sparse support recovery arises in many applications in communications and signal processing. Existing methods tackle sparse support recovery problems for a given measurement matrix, and cannot flexibly exploit the properties of sparsity…

Information Theory · Computer Science 2019-10-11 Shuaichao Li , Wanqing Zhang , Ying Cui , Hei Victor Cheng , Wei Yu

Sparse recovery is one of the most fundamental and well-studied inverse problems. Standard statistical formulations of the problem are provably solved by general convex programming techniques and more practical, fast (nearly-linear time)…

Data Structures and Algorithms · Computer Science 2022-03-09 Jonathan A. Kelner , Jerry Li , Allen Liu , Aaron Sidford , Kevin Tian

We review connections between coding-theoretic objects and sparse learning problems. In particular, we show how seemingly different combinatorial objects such as error-correcting codes, combinatorial designs, spherical codes, compressed…

Information Theory · Computer Science 2012-02-13 Mahdi Cheraghchi

In this paper, we discuss application of iterative Stochastic Optimization routines to the problem of sparse signal recovery from noisy observation. Using Stochastic Mirror Descent algorithm as a building block, we develop a multistage…

Machine Learning · Statistics 2022-03-31 Anatoli Juditsky , Andrei Kulunchakov , Hlib Tsyntseus

Principal component analysis (PCA) is a classical method for dimensionality reduction based on extracting the dominant eigenvectors of the sample covariance matrix. However, PCA is well known to behave poorly in the ``large $p$, small $n$''…

Statistics Theory · Mathematics 2009-08-26 Arash A. Amini , Martin J. Wainwright

The growing need for uncertainty analysis of complex computational models has led to an expanding use of meta-models across engineering and sciences. The efficiency of meta-modeling techniques relies on their ability to provide…

Numerical Analysis · Mathematics 2016-08-24 Katerina Konakli , Bruno Sudret

Regularized variants of Principal Components Analysis, especially Sparse PCA and Functional PCA, are among the most useful tools for the analysis of complex high-dimensional data. Many examples of massive data, have both sparse and…

Machine Learning · Statistics 2019-08-21 Genevera I. Allen , Michael Weylandt

We propose a general framework for nonasymptotic covariance matrix estimation making use of concentration inequality-based confidence sets. We specify this framework for the estimation of large sparse covariance matrices through…

Methodology · Statistics 2020-12-17 Adam B Kashlak , Linglong Kong

Principal component analysis (PCA) is one of the most widely used dimensionality reduction tools in data analysis. The PCA direction is a linear combination of all features with nonzero loadings -- this impedes interpretability. Sparse PCA…

Optimization and Control · Mathematics 2021-08-18 Santanu S. Dey , Rahul Mazumder , Guanyi Wang

Sparse PCA is one of the most well-studied problems in high-dimensional statistics. In this problem, we are given samples from a distribution with covariance $\Sigma$, whose top eigenvector $v \in R^d$ is $s$-sparse. Existing sparse PCA…

Machine Learning · Statistics 2026-03-04 Syamantak Kumar , Purnamrita Sarkar , Kevin Tian , Peiyuan Zhang

We consider asymptotically exact inference on the leading canonical correlation directions and strengths between two high dimensional vectors under sparsity restrictions. In this regard, our main contribution is the development of a loss…

Statistics Theory · Mathematics 2022-02-10 Nilanjana Laha , Nathan Huey , Brent Coull , Rajarshi Mukherjee

We consider the problem of recovering the support of a sparse signal using noisy projections. While extensive work has been done on the dense measurement matrix setting, the sparse setting remains less explored. In this work, we establish…

Machine Learning · Statistics 2025-09-03 Youssef Chaabouni , David Gamarnik

Compressed Sensing (CS) is an effective approach to reduce the required number of samples for reconstructing a sparse signal in an a priori basis, but may suffer severely from the issue of basis mismatch. In this paper we study the problem…

Information Theory · Computer Science 2014-02-04 Yuejie Chi

In this paper, a new method is proposed for sparse PCA based on the recursive divide-and-conquer methodology. The main idea is to separate the original sparse PCA problem into a series of much simpler sub-problems, each having a closed-form…

Computer Vision and Pattern Recognition · Computer Science 2012-12-03 Qian Zhao , Deyu Meng , Zongben Xu

We propose robust and efficient algorithms for the joint sparse recovery problem in compressed sensing, which simultaneously recover the supports of jointly sparse signals from their multiple measurement vectors obtained through a common…

Information Theory · Computer Science 2016-11-17 Kiryung Lee , Yoram Bresler , Marius Junge

We study the support recovery problem for compressed sensing, where the goal is to reconstruct the a high-dimensional $K$-sparse signal $\mathbf{x}\in\mathbb{R}^N$, from low-dimensional linear measurements with and without noise. Our key…

Information Theory · Computer Science 2018-02-27 Xiao Li , Dong Yin , Sameer Pawar , Ramtin Pedarsani , Kannan Ramchandran

Given an overcomplete dictionary $A$ and a signal $b$ that is a linear combination of a few linearly independent columns of $A$, classical sparse recovery theory deals with the problem of recovering the unique sparse representation $x$ such…

Machine Learning · Statistics 2015-07-07 C. You , R. Vidal

From a numerical analysis perspective, assessing the robustness of l1-minimization is a fundamental issue in compressed sensing and sparse regularization. Yet, the recovery guarantees available in the literature usually depend on a priori…

Numerical Analysis · Mathematics 2017-05-10 Simone Brugiapaglia , Ben Adcock , Richard K. Archibald

In recent years, unfolding iterative algorithms as neural networks has become an empirical success in solving sparse recovery problems. However, its theoretical understanding is still immature, which prevents us from fully utilizing the…

Machine Learning · Computer Science 2018-11-06 Xiaohan Chen , Jialin Liu , Zhangyang Wang , Wotao Yin
‹ Prev 1 4 5 6 7 8 10 Next ›