English
Related papers

Related papers: Dictionary Learning for the Almost-Linear Sparsity…

200 papers

Recovery of the sparsity pattern (or support) of an unknown sparse vector from a limited number of noisy linear measurements is an important problem in compressed sensing. In the high-dimensional setting, it is known that recovery with a…

Information Theory · Computer Science 2012-06-26 Galen Reeves , Michael Gastpar

We study the information-theoretic limits of exactly recovering the support of a sparse signal using noisy projections defined by various classes of measurement matrices. Our analysis is high-dimensional in nature, in which the number of…

Statistics Theory · Mathematics 2008-06-04 Wei Wang , Martin J. Wainwright , Kannan Ramchandran

This paper addresses the structurally-constrained sparse decomposition of multi-dimensional signals onto overcomplete families of vectors, called dictionaries. The contribution of the paper is threefold. Firstly, a generic spatio-temporal…

Data Structures and Algorithms · Computer Science 2016-10-03 Yoann Isaac , Quentin Barthélemy , Cédric Gouy-Pailler , Michèle Sebag , Jamal Atif

Many techniques in computer vision, machine learning, and statistics rely on the fact that a signal of interest admits a sparse representation over some dictionary. Dictionaries are either available analytically, or can be learned from a…

Computer Vision and Pattern Recognition · Computer Science 2013-03-22 Simon Hawe , Matthias Seibert , Martin Kleinsteuber

Sparsity and low-rank models have been popular for reconstructing images and videos from limited or corrupted measurements. Dictionary or transform learning methods are useful in applications such as denoising, inpainting, and medical image…

Machine Learning · Statistics 2019-07-23 Brian E. Moore , Saiprasad Ravishankar , Raj Rao Nadakuditi , Jeffrey A. Fessler

This paper considers the problem of simultaneously learning the Sensing Matrix and Sparsifying Dictionary (SMSD) on a large training dataset. To address the formulated joint learning problem, we propose an online algorithm that consists of…

Machine Learning · Computer Science 2018-06-05 Tao Hong , Zhihui Zhu

We give an efficient algorithm for finding sparse approximate solutions to linear systems of equations with nonnegative coefficients. Unlike most known results for sparse recovery, we do not require {\em any} assumption on the matrix other…

Data Structures and Algorithms · Computer Science 2015-01-09 Aditya Bhaskara , Ananda Theertha Suresh , Morteza Zadimoghaddam

Recent advances in computer vision and machine learning suggest that a wide range of problems can be addressed more appropriately by considering non-Euclidean geometry. In this paper we explore sparse dictionary learning over the space of…

Computer Vision and Pattern Recognition · Computer Science 2013-10-21 Mehrtash Harandi , Conrad Sanderson , Chunhua Shen , Brian C. Lovell

We consider support recovery in the quadratic logistic regression setting - where the target depends on both p linear terms $x_i$ and up to $p^2$ quadratic terms $x_i x_j$. Quadratic terms enable prediction/modeling of higher-order effects…

Machine Learning · Statistics 2017-03-09 Karthikeyan Shanmugam , Murat Kocaoglu , Alexandros G. Dimakis , Sujay Sanghavi

Symbolic regression (SR) is an emerging branch of machine learning focused on discovering simple and interpretable mathematical expressions from data. Although a wide-variety of SR methods have been developed, they often face challenges…

Machine Learning · Computer Science 2025-02-06 Madhav R. Muthyala , Farshud Sorourifar , You Peng , Joel A. Paulson

We study the support recovery problem for compressed sensing, where the goal is to reconstruct the a high-dimensional $K$-sparse signal $\mathbf{x}\in\mathbb{R}^N$, from low-dimensional linear measurements with and without noise. Our key…

Information Theory · Computer Science 2018-02-27 Xiao Li , Dong Yin , Sameer Pawar , Ramtin Pedarsani , Kannan Ramchandran

Super-resolution theory aims to estimate the discrete components lying in a continuous space that constitute a sparse signal with optimal precision. This work investigates the potential of recent super-resolution techniques for spectral…

Information Theory · Computer Science 2016-11-24 M. Ferreira Da Costa , W. Dai

Wavefront reconstruction is a critical component in various optical systems, including adaptive optics, interferometry, and phase contrast imaging. Traditional reconstruction methods often employ either the Cartesian (pixel) basis or the…

Optics · Physics 2024-11-06 S. Howard , N. Weisse , J. Schroeder , C. Barbero , B. Alonso , I. Sola , P. Norreys , A. Döpp

The orthogonal matching pursuit (OMP) algorithm is a commonly used algorithm for recovering $K$-sparse signals $\x\in \mathbb{R}^{n}$ from linear model $\y=\A\x$, where $\A\in \mathbb{R}^{m\times n}$ is a sensing matrix. A fundamental…

Information Theory · Computer Science 2019-04-23 Jinming Wen , Wei Yu

Although deep learning (DL) methods are powerful for solving inverse problems, their reliance on high-quality training data is a major hurdle. This is significant in high-dimensional (dynamic/volumetric) magnetic resonance imaging (MRI),…

Image and Video Processing · Electrical Eng. & Systems 2024-05-24 Frederic Wang , Han Qi , Alfredo De Goyeneche , Reinhard Heckel , Michael Lustig , Efrat Shimron

Classification methods based on sparse estimation have drawn much attention recently, due to their effectiveness in processing high-dimensional data such as images. In this paper, a method to improve the performance of a sparse…

Machine Learning · Statistics 2018-10-24 Babak Barazandeh , Mohammadhussein Rafieisakhaei , Sunwook Kim , Zhenyu , Kong , Maury A. Nussbaum

We study statistical restricted isometry, a property closely related to sparse signal recovery, of deterministic sensing matrices of size $m \times N$. A matrix is said to have a statistical restricted isometry property (StRIP) of order $k$…

Information Theory · Computer Science 2016-11-17 Alexander Barg , Arya Mazumdar , Rongrong Wang

In the synthesis model signals are represented as a sparse combinations of atoms from a dictionary. Dictionary learning describes the acquisition process of the underlying dictionary for a given set of training samples. While ideally this…

Machine Learning · Statistics 2015-03-11 Matthias Seibert , Martin Kleinsteuber , Rémi Gribonval , Rodolphe Jenatton , Francis Bach

The constrained $\ell_p^p/\ell_q^p$ ratio model is scale invariant and is therefore attractive for sparse signal recovery. However, its nonconvex, nonsmooth, and fractional structure makes a unified theoretical and algorithmic analysis…

Optimization and Control · Mathematics 2026-05-26 Lang Yu , Nan-jing Huang

Sparse regression has emerged as a popular technique for learning dynamical systems from temporal data, beginning with the SINDy (Sparse Identification of Nonlinear Dynamics) framework proposed by arXiv:1509.03580. Quantifying the…

Methodology · Statistics 2023-08-21 Sara Venkatraman , Sumanta Basu , Martin T. Wells