English
Related papers

Related papers: Analysis of Sparse Representations Using Bi-Orthog…

200 papers

Mixture models are widely used to fit complex and multimodal datasets. In this paper we study mixtures with high dimensional sparse latent parameter vectors and consider the problem of support recovery of those vectors. While parameter…

Machine Learning · Computer Science 2022-09-13 Arya Mazumdar , Soumyabrata Pal

Dictionary learning, the problem of recovering a sparsely used matrix $\mathbf{D} \in \mathbb{R}^{M \times K}$ and $N$ $s$-sparse vectors $\mathbf{x}_i \in \mathbb{R}^{K}$ from samples of the form $\mathbf{y}_i = \mathbf{D}\mathbf{x}_i$, is…

Machine Learning · Computer Science 2023-03-29 Alexei Novikov , Stephen White

Signal modeling lies at the core of numerous signal and image processing applications. A recent approach that has drawn considerable attention is sparse representation modeling, in which the signal is assumed to be generated as a…

Information Theory · Computer Science 2016-11-17 Tomer Peleg , Yonina C. Eldar , Michael Elad

Sparse representation of astronomical images is discussed. It is shown that a significant gain in sparsity is achieved when particular mixed dictionaries are used for approximating these types of images with greedy selection strategies.…

Mathematical Physics · Physics 2015-06-11 Laura Rebollo-Neira , James Bowley

The achievable and converse regions for sparse representation of white Gaussian noise based on an overcomplete dictionary are derived in the limit of large systems. Furthermore, the marginal distribution of such sparse representations is…

Information Theory · Computer Science 2017-02-13 Ori Shental

We consider high dimensional sparse regression, and develop strategies able to deal with arbitrary -- possibly, severe or coordinated -- errors in the covariance matrix $X$. These may come from corrupted data, persistent experimental…

Machine Learning · Statistics 2013-01-15 Yudong Chen , Constantine Caramanis , Shie Mannor

The recovery of signals that are sparse not in a basis, but rather sparse with respect to an over-complete dictionary is one of the most flexible settings in the field of compressed sensing with numerous applications. As in the standard…

Information Theory · Computer Science 2021-10-01 Pedro Abdalla , Christian Kümmerle

Recently, considerable research efforts have been devoted to the design of methods to learn from data overcomplete dictionaries for sparse coding. However, learned dictionaries require the solution of an optimization problem for coding new…

Machine Learning · Computer Science 2010-11-17 Curzio Basso , Matteo Santoro , Alessandro Verri , Silvia Villa

Is it possible to find the sparsest vector (direction) in a generic subspace $\mathcal{S} \subseteq \mathbb{R}^p$ with $\mathrm{dim}(\mathcal{S})= n < p$? This problem can be considered a homogeneous variant of the sparse recovery problem,…

Information Theory · Computer Science 2016-09-21 Qing Qu , Ju Sun , John Wright

The problem of how to find a sparse representation of a signal is an important one in applied and computational harmonic analysis. It is closely related to the problem of how to reconstruct a sparse vector from its projection in a much…

Functional Analysis · Mathematics 2018-04-13 Enrico Au-Yeung

In sparse recovery we are given a matrix $A$ (the dictionary) and a vector of the form $A X$ where $X$ is sparse, and the goal is to recover $X$. This is a central notion in signal processing, statistics and machine learning. But in…

Data Structures and Algorithms · Computer Science 2014-05-27 Sanjeev Arora , Rong Ge , Ankur Moitra

In this paper, we discuss application of iterative Stochastic Optimization routines to the problem of sparse signal recovery from noisy observation. Using Stochastic Mirror Descent algorithm as a building block, we develop a multistage…

Machine Learning · Statistics 2022-03-31 Anatoli Juditsky , Andrei Kulunchakov , Hlib Tsyntseus

This paper deals with sparse phase retrieval, i.e., the problem of estimating a vector from quadratic measurements under the assumption that few components are nonzero. In particular, we consider the problem of finding the sparsest vector…

Information Theory · Computer Science 2014-02-25 Fabien Lauer , Henrik Ohlsson

The role of sparse representations in the context of structured noise filtering is discussed. A strategy, especially conceived so as to address problems of an ill posed nature, is presented. The proposed approach revises and extends the…

Functional Analysis · Mathematics 2007-09-18 Bishnu P. Lamichhane , Laura Rebollo-Neira

We investigate the sparse recovery problem of reconstructing a high-dimensional non-negative sparse vector from lower dimensional linear measurements. While much work has focused on dense measurement matrices, sparse measurement schemes are…

Information Theory · Computer Science 2009-02-25 M. Amin Khajehnejad , Alexandros G. Dimakis , Weiyu Xu , Babak Hassibi

Many natural signals exhibit a sparse representation, whenever a suitable describing model is given. Here, a linear generative model is considered, where many sparsity-based signal processing techniques rely on such a simplified model. As…

Machine Learning · Computer Science 2013-06-11 Mehrdad Yaghoobi , Laurent Daudet , Michael E. Davies

Compressive sensing (CS) has recently emerged as a powerful framework for acquiring sparse signals. The bulk of the CS literature has focused on the case where the acquired signal has a sparse or compressible representation in an…

Information Theory · Computer Science 2013-06-24 Mark A. Davenport , Deanna Needell , Michael B. Wakin

This paper addresses an ill-posed problem of recovering a color image from its compressively sensed measurement data. Differently from the typical 1D vector-based approach of the state-of-the-art methods, we exploit the nonlocal…

Image and Video Processing · Electrical Eng. & Systems 2017-11-28 Khanh Quoc Dinh , Thuong Nguyen Canh , Byeungwoo Jeon

We present a novel binary convex reformulation of the sparse regression problem that constitutes a new duality perspective. We devise a new cutting plane method and provide evidence that it can solve to provable optimality the sparse…

Optimization and Control · Mathematics 2017-09-29 Dimitris Bertsimas , Bart Van Parys

Mixture of linear regressions is a popular learning theoretic model that is used widely to represent heterogeneous data. In the simplest form, this model assumes that the labels are generated from either of two different linear models and…

Machine Learning · Statistics 2020-07-15 Arya Mazumdar , Soumyabrata Pal
‹ Prev 1 3 4 5 6 7 10 Next ›