English
Related papers

Related papers: Model-based Sparse Coding beyond Gaussian Independ…

200 papers

Non-negative sparse coding is a method for decomposing multivariate data into non-negative sparse components. In this paper we briefly describe the motivation behind this type of data representation and its relation to standard sparse…

Neural and Evolutionary Computing · Computer Science 2007-05-23 Patrik O. Hoyer

State-of-the-art approaches toward image restoration can be classified into model-based and learning-based. The former - best represented by sparse coding techniques - strive to exploit intrinsic prior knowledge about the unknown…

Image and Video Processing · Electrical Eng. & Systems 2018-11-29 Fangfang Wu , Weisheng Dong , Guangming Shi , Xin Li

Convolutional sparse coding (CSC) has been popularly used for the learning of shift-invariant dictionaries in image and signal processing. However, existing methods have limited scalability. In this paper, instead of convolving with a…

Computer Vision and Pattern Recognition · Computer Science 2018-06-08 Yaqing Wang , Quanming Yao , James T. Kwok , Lionel M. Ni

In this paper, we explore an efficient variant of convolutional sparse coding with unit norm code vectors where reconstruction quality is evaluated using an inner product (cosine distance). To use these codes for discriminative…

Computer Vision and Pattern Recognition · Computer Science 2017-10-06 Bailey Kong , Charless C. Fowlkes

Convolutional Sparse Coding (CSC) is an increasingly popular model in the signal and image processing communities, tackling some of the limitations of traditional patch-based sparse representations. Although several works have addressed the…

Computer Vision and Pattern Recognition · Computer Science 2017-05-10 Vardan Papyan , Yaniv Romano , Jeremias Sulam , Michael Elad

We define and discuss the first sparse coding algorithm based on closed-form EM updates and continuous latent variables. The underlying generative model consists of a standard `spike-and-slab' prior and a Gaussian noise model. Closed-form…

Machine Learning · Statistics 2012-03-05 Jörg Lücke , Abdul-Saboor Sheikh

We propose a new approach for metric learning by framing it as learning a sparse combination of locally discriminative metrics that are inexpensive to generate from the training data. This flexible framework allows us to naturally derive…

Machine Learning · Computer Science 2019-01-25 Yuan Shi , Aurélien Bellet , Fei Sha

Sparse coding--that is, modelling data vectors as sparse linear combinations of basis elements--is widely used in machine learning, neuroscience, signal processing, and statistics. This paper focuses on the large-scale matrix factorization…

Machine Learning · Statistics 2010-02-11 Julien Mairal , Francis Bach , Jean Ponce , Guillermo Sapiro

Sparse coding is a basic task in many fields including signal processing, neuroscience and machine learning where the goal is to learn a basis that enables a sparse representation of a given set of data, if one exists. Its standard…

Machine Learning · Computer Science 2015-03-04 Sanjeev Arora , Rong Ge , Tengyu Ma , Ankur Moitra

Sparse superimposed coding (SSC) has emerged as a promising technique for short-packet transmission in ultra-reliable low-latency communication scenarios. However, conventional SSC schemes often suffer from high encoding and decoding…

Signal Processing · Electrical Eng. & Systems 2026-01-23 Yanfeng Zhang , Xi'an Fan , Xu Zhu , Jinkai Zheng , Hui Liang , Weiwei Yang , Tom H. Luan

Sparse coding algorithms are about finding a linear basis in which signals can be represented by a small number of active (non-zero) coefficients. Such coding has many applications in science and engineering and is believed to play an…

Neural and Evolutionary Computing · Computer Science 2016-08-14 András Lőrincz , Zsolt Palotai , Gábor Szirtes

We consider the scenario where one observes an outcome variable and sets of features from multiple assays, all measured on the same set of samples. One approach that has been proposed for dealing with this type of data is ``sparse multiple…

Quantitative Methods · Quantitative Biology 2014-01-24 Samuel M. Gross , Robert Tibshirani

The sparse coding algorithm has served as a model for early processing in mammalian vision. It has been assumed that the brain uses sparse coding to exploit statistical properties of the sensory stream. We hypothesize that sparse coding…

Computer Vision and Pattern Recognition · Computer Science 2021-01-28 Gerrit A. Ecke , Harald M. Papp , Hanspeter A. Mallot

There is increasing realization in neuroscience that information is represented in the brain, e.g., neocortex, hippocampus, in the form sparse distributed codes (SDCs), a kind of cell assembly. Two essential questions are: a) how are such…

Machine Learning · Computer Science 2020-10-22 Rod Rinkus

Over the past decade, the celebrated sparse representation model has achieved impressive results in various signal and image processing tasks. A convolutional version of this model, termed convolutional sparse coding (CSC), has been…

Signal Processing · Electrical Eng. & Systems 2018-10-03 Ives Rey-Otero , Jeremias Sulam , Michael Elad

The sparse modeling is an evident manifestation capturing the parsimony principle just described, and sparse models are widespread in statistics, physics, information sciences, neuroscience, computational mathematics, and so on. In…

Machine Learning · Computer Science 2023-08-29 Jianyi Lin

Subspace sparse coding (SSC) algorithms have proven to be beneficial to clustering problems. They provide an alternative data representation in which the underlying structure of the clusters can be better captured. However, most of the…

Machine Learning · Computer Science 2019-03-14 Babak Hosseini , Barbara Hammer

Sparse principal component analysis (SPCA) has emerged as a powerful technique for modern data analysis, providing improved interpretation of low-rank structures by identifying localized spatial structures in the data and disambiguating…

Inspired by recent work on convex formulations of clustering (Lashkari & Golland, 2008; Nowozin & Bakir, 2008) we investigate a new formulation of the Sparse Coding Problem (Olshausen & Field, 1997). In sparse coding we attempt to…

Machine Learning · Computer Science 2012-05-14 David M. Bradley , J Andrew Bagnell

An image super-resolution method from multiple observation of low-resolution images is proposed. The method is based on sub-pixel accuracy block matching for estimating relative displacements of observed images, and sparse signal…

Computer Vision and Pattern Recognition · Computer Science 2014-02-18 Toshiyuki Kato , Hideitsu Hino , Noboru Murata