English
Related papers

Related papers: Fast Orthonormal Sparsifying Transforms Based on H…

200 papers

In this paper we consider the dictionary learning problem for sparse representation. We first show that this problem is NP-hard by polynomial time reduction of the densest cut problem. Then, using successive convex approximation strategies,…

Machine Learning · Computer Science 2015-11-06 Meisam Razaviyayn , Hung-Wei Tseng , Zhi-Quan Luo

In sparse recovery, the unique sparsest solution to an under-determined system of linear equations is of main interest. This scheme is commonly proposed to be applied to signal acquisition. In most cases, the signals are not sparse…

Information Theory · Computer Science 2013-07-16 Henning Zörlein , Faisal Akram , Martin Bossert

Learning dictionaries suitable for sparse coding instead of using engineered bases has proven effective in a variety of image processing tasks. This paper studies the optimization of dictionaries on image data where the representation is…

Machine Learning · Computer Science 2016-04-19 Markus Thom , Matthias Rapp , Günther Palm

Modeling data with linear combinations of a few elements from a learned dictionary has been the focus of much recent research in machine learning, neuroscience and signal processing. For signals such as natural images that admit such sparse…

Machine Learning · Statistics 2013-09-10 Julien Mairal , Francis Bach , Jean Ponce

Learning expressive representations for high-dimensional yet sparse features has been a longstanding problem in information retrieval. Though recent deep learning methods can partially solve the problem, they often fail to handle the…

Information Retrieval · Computer Science 2023-05-30 Kaize Ding , Albert Jiongqian Liang , Bryan Perrozi , Ting Chen , Ruoxi Wang , Lichan Hong , Ed H. Chi , Huan Liu , Derek Zhiyuan Cheng

There has been a growing interest in the use of data-driven regularizers to solve inverse problems associated with computational imaging systems. The convolutional sparse representation model has recently gained attention, driven by the…

Image and Video Processing · Electrical Eng. & Systems 2021-03-25 Singanallur Venkatakrishnan , Brendt Wohlberg

We consider tomographic reconstruction using priors in the form of a dictionary learned from training images. The reconstruction has two stages: first we construct a tensor dictionary prior from our training data, and then we pose the…

Computer Vision and Pattern Recognition · Computer Science 2015-06-17 Sara Soltani , Misha E. Kilmer , Per Christian Hansen

Phaseless diffraction measurements recorded by a CCD detector are often affected by Poisson noise. In this paper, we propose a dictionary learning model by employing patches based sparsity to denoise Poisson phaseless measurement. The model…

Optimization and Control · Mathematics 2019-06-10 Huibin Chang , Stefano Marchesini

We propose a compressed sampling and dictionary learning framework for fiber-optic sensing using wavelength-tunable lasers. A redundant dictionary is generated from a model for the reflected sensor signal. Imperfect prior knowledge is…

Methodology · Statistics 2017-06-13 Christian Weiss , Abdelhak M. Zoubir

In this paper, we propose several dictionary learning algorithms for sparse representations that also impose specific structures on the learned dictionaries such that they are numerically efficient to use: reduced number of…

Machine Learning · Computer Science 2020-12-08 Cristian Rusu

The problem of learning long-term dependencies in sequences using Recurrent Neural Networks (RNNs) is still a major challenge. Recent methods have been suggested to solve this problem by constraining the transition matrix to be unitary…

Machine Learning · Computer Science 2017-06-14 Zakaria Mhammedi , Andrew Hellicar , Ashfaqur Rahman , James Bailey

In sparse coding, we attempt to extract features of input vectors, assuming that the data is inherently structured as a sparse superposition of basic building blocks. Similarly, neural networks perform a given task by learning features of…

Machine Learning · Computer Science 2022-02-16 Deborah Pereg , Israel Cohen , Anthony A. Vassiliou

Convolutional sparse representations are a form of sparse representation with a structured, translation invariant dictionary. Most convolutional dictionary learning algorithms to date operate in batch mode, requiring simultaneous access to…

Machine Learning · Computer Science 2018-06-19 Jialin Liu , Cristina Garcia-Cardona , Brendt Wohlberg , Wotao Yin

This paper tackles algorithmic and theoretical aspects of dictionary learning from incomplete and random block-wise image measurements and the performance of the adaptive dictionary for sparse image recovery. This problem is related to…

Computer Vision and Pattern Recognition · Computer Science 2015-08-04 Mohammad Aghagolzadeh , Hayder Radha

This paper proposes a novel approach to image deblurring and digital zooming using sparse local models of image appearance. These models, where small image patches are represented as linear combinations of a few elements drawn from some…

Machine Learning · Computer Science 2011-10-07 Florent Couzinie-Devy , Julien Mairal , Francis Bach , Jean Ponce

The aim of this paper is to introduce a novel dictionary learning algorithm for sparse representation of signals defined over combinatorial topological spaces, specifically, regular cell complexes. Leveraging Hodge theory, we embed topology…

Signal Processing · Electrical Eng. & Systems 2025-03-17 Enrico Grimaldi , Claudio Battiloro , Paolo Di Lorenzo

Sparse representations using learned dictionaries are being increasingly used with success in several data processing and machine learning applications. The availability of abundant training data necessitates the development of efficient,…

Computer Vision and Pattern Recognition · Computer Science 2013-09-26 Jayaraman J. Thiagarajan , Karthikeyan Natesan Ramamurthy , Andreas Spanias

Many applications in signal processing benefit from the sparsity of signals in a certain transform domain or dictionary. Synthesis sparsifying dictionaries that are directly adapted to data have been popular in applications such as image…

Machine Learning · Statistics 2015-06-23 Saiprasad Ravishankar , Yoram Bresler

Interpretability benefits the theoretical understanding of representations. Existing word embeddings are generally dense representations. Hence, the meaning of latent dimensions is difficult to interpret. This makes word embeddings like a…

Computation and Language · Computer Science 2023-06-27 Minxue Xia , Hao Zhu

It is now well established that sparse signal models are well suited to restoration tasks and can effectively be learned from audio, image, and video data. Recent research has been aimed at learning discriminative sparse models instead of…

Computer Vision and Pattern Recognition · Computer Science 2009-09-29 Julien Mairal , Francis Bach , Jean Ponce , Guillermo Sapiro , Andrew Zisserman