English
Related papers

Related papers: An Open Problem on Sparse Representations in Union…

200 papers

Consider the problem of recovering an unknown signal from undersampled measurements, given the knowledge that the signal has a sparse representation in a specified dictionary $D$. This problem is now understood to be well-posed and…

Information Theory · Computer Science 2015-06-09 Felix Krahmer , Deanna Needell , Rachel Ward

In this study, the problem of computing a sparse representation of multi-dimensional visual data is considered. In general, such data e.g., hyperspectral images, color images or video data consists of signals that exhibit strong local…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Alexandros Gkillas , Dimitris Ampeliotis , Kostas Berberidis

In an incoherent dictionary, most signals that admit a sparse representation admit a unique sparse representation. In other words, there is no way to express the signal without using strictly more atoms. This work demonstrates that sparse…

Information Theory · Computer Science 2016-11-18 Joel A. Tropp

This paper addresses the problem of identifying a lower dimensional space where observed data can be sparsely represented. This under-complete dictionary learning task can be formulated as a blind separation problem of sparse sources…

Methodology · Statistics 2010-08-30 Nicolas Dobigeon , Jean-Yves Tourneret

This paper aims to illustrate the concept-emerging phenomenon in a trained DNN. Specifically, we find that the inference score of a DNN can be disentangled into the effects of a few interactive concepts. These concepts can be understood as…

Machine Learning · Computer Science 2023-04-04 Jie Ren , Mingjie Li , Qirui Chen , Huiqi Deng , Quanshi Zhang

This paper continues the study of orthonormal bases (ONB) of $L^2[0,1]$ introduced in \cite{DPS14} by means of Cuntz algebra $\mathcal{O}_N$ representations on $L^2[0,1]$. For $N=2$, one obtains the classic Walsh system. We show that the…

Functional Analysis · Mathematics 2018-03-02 Dorin Ervin Dutkay , Gabriel Picioroaga , Sergei Silvestrov

This chapter provides a principled introduction to uncertainty relations underlying sparse signal recovery. We start with the seminal work by Donoho and Stark, 1989, which defines uncertainty relations as upper bounds on the operator norm…

Information Theory · Computer Science 2020-03-27 Erwin Riegler , Helmut Bölcskei

Sparse representation of structured signals requires modelling strategies that maintain specific signal properties, in addition to preserving original information content and achieving simpler signal representation. Therefore, the major…

Computer Vision and Pattern Recognition · Computer Science 2018-10-30 Branko Brkljač , Željen Trpovski

This paper studies sparse super-resolution in arbitrary dimensions. More precisely, it develops a theoretical analysis of support recovery for the so-called BLASSO method, which is an off-the-grid generalisation of l1 regularization (also…

Numerical Analysis · Mathematics 2017-09-12 Clarice Poon , Gabriel Peyré

Thus far, sparse representations have been exploited largely in the context of robustly estimating functions in a noisy environment from a few measurements. In this context, the existence of a basis in which the signal class under…

Data Structures and Algorithms · Computer Science 2009-06-26 Mohamed-Ali Belabbas , Patrick J. Wolfe

More competent learning models are demanded for data processing due to increasingly greater amounts of data available in applications. Data that we encounter often have certain embedded sparsity structures. That is, if they are represented…

Numerical Analysis · Mathematics 2022-07-28 Yuesheng Xu , Taishan Zeng

This article extends the concept of compressed sensing to signals that are not sparse in an orthonormal basis but rather in a redundant dictionary. It is shown that a matrix, which is a composition of a random matrix of certain type and a…

Probability · Mathematics 2010-11-10 Holger Rauhut , Karin Schnass , Pierre Vandergheynst

In the first part of the series papers, we set out to answer the following question: given specific restrictions on a set of samplers, what kind of signal can be uniquely represented by the corresponding samples attained, as the foundation…

Information Theory · Computer Science 2021-08-25 Hanshen Xiao , Yaowen Zhang , Guoqiang Xiao

Signal models formed as linear combinations of few atoms from an over-complete dictionary or few frame vectors from a redundant frame have become central to many applications in high dimensional signal processing and data analysis. A core…

Information Theory · Computer Science 2024-08-30 Xuemei Chen , Christian Kümmerle , Rongrong Wang

The problem of signal detection using a flexible and general model is considered. Due to applicability and flexibility of sparse signal representation and approximation, it has attracted a lot of attention in many signal processing areas.…

Information Theory · Computer Science 2016-02-17 Mohsen Joneidi , Parvin Ahmadi , Mostafa Sadeghi , Nazanin Rahnavard

The celebrated sparse representation model has led to remarkable results in various signal processing tasks in the last decade. However, despite its initial purpose of serving as a global prior for entire signals, it has been commonly used…

Information Theory · Computer Science 2017-02-23 Vardan Papyan , Jeremias Sulam , Michael Elad

The role of sparse representations in the context of structured noise filtering is discussed. A strategy, especially conceived so as to address problems of an ill posed nature, is presented. The proposed approach revises and extends the…

Functional Analysis · Mathematics 2007-09-18 Bishnu P. Lamichhane , Laura Rebollo-Neira

The past several years have witnessed a surge of research investigating various aspects of sparse representations and compressed sensing. Most of this work has focused on the finite-dimensional setting in which the goal is to decompose a…

Information Theory · Computer Science 2016-11-17 Yonina C. Eldar

Sparse dictionary coding represents signals as linear combinations of a few dictionary atoms. It has been applied to images, time series, graph signals and multi-way spatio-temporal data by jointly employing temporal and spatial…

Machine Learning · Computer Science 2025-09-15 Boya Ma , Abram Magner , Maxwell McNeil , Petko Bogdanov

We take an information theoretic perspective on a classical sparse-sampling noisy linear model and present an analytical expression for the mutual information, which plays central role in a variety of communications/processing problems.…

Information Theory · Computer Science 2014-03-25 Wasim Huleihel , Neri Merhav , Shlomo Shamai