English
Related papers

Related papers: Non-negative sparse coding

200 papers

Sparse coding is a basic task in many fields including signal processing, neuroscience and machine learning where the goal is to learn a basis that enables a sparse representation of a given set of data, if one exists. Its standard…

Machine Learning · Computer Science 2015-03-04 Sanjeev Arora , Rong Ge , Tengyu Ma , Ankur Moitra

Sparse coding algorithms are about finding a linear basis in which signals can be represented by a small number of active (non-zero) coefficients. Such coding has many applications in science and engineering and is believed to play an…

Neural and Evolutionary Computing · Computer Science 2016-08-14 András Lőrincz , Zsolt Palotai , Gábor Szirtes

Multi-way data arises in many applications such as electroencephalography (EEG) classification, face recognition, text mining and hyperspectral data analysis. Tensor decomposition has been commonly used to find the hidden factors and elicit…

Optimization and Control · Mathematics 2014-05-07 Yangyang Xu

This paper proposes a binarization scheme for vectors of high dimension based on the recent concept of anti-sparse coding, and shows its excellent performance for approximate nearest neighbor search. Unlike other binarization schemes, this…

Computer Vision and Pattern Recognition · Computer Science 2011-10-27 Hervé Jégou , Teddy Furon , Jean-Jacques Fuchs

Existing nonnegative matrix factorization methods focus on learning global structure of the data to construct basis and coefficient matrices, which ignores the local structure that commonly exists among data. In this paper, we propose a new…

Machine Learning · Computer Science 2019-07-10 Chong Peng , Zhao Kang , Chenglizhao Chen , Qiang Cheng

Distributed computation is a framework used to break down a complex computational task into smaller tasks and distributing them among computational nodes. Erasure correction codes have recently been introduced and have become a popular…

Information Theory · Computer Science 2021-08-17 Royee Yosibash , Ram Zamir

Sparse coding, which refers to modeling a signal as sparse linear combinations of the elements of a learned dictionary, has proven to be a successful (and interpretable) approach in applications such as signal processing, computer vision,…

Machine Learning · Computer Science 2023-06-02 Muthu Chidambaram , Chenwei Wu , Yu Cheng , Rong Ge

Sparse coding is an unsupervised learning algorithm that learns a succinct high-level representation of the inputs given only unlabeled data; it represents each input as a sparse linear combination of a set of basis functions. Originally…

Machine Learning · Computer Science 2012-06-26 Roger Grosse , Rajat Raina , Helen Kwong , Andrew Y. Ng

In recent years, a large amount of multi-disciplinary research has been conducted on sparse models and their applications. In statistics and machine learning, the sparsity principle is used to perform model selection---that is,…

Computer Vision and Pattern Recognition · Computer Science 2014-12-09 Julien Mairal , Francis Bach , Jean Ponce

Sparse storage formats are techniques for storing and processing the sparse matrix data efficiently. The performance of these storage formats depend upon the distribution of non-zeros, within the matrix in different dimensions. In order to…

Mathematical Software · Computer Science 2012-02-28 Muhammad Taimoor Khan , Anila Usman

Inpainting-based compression represents images in terms of a sparse subset of its pixel data. Storing the carefully optimised positions of known data creates a lossless compression problem on sparse and often scattered binary images. This…

Image and Video Processing · Electrical Eng. & Systems 2021-08-03 Rahul Mohideen Kaja Mohideen , Pascal Peter , Joachim Weickert

We propose computationally efficient encoders and decoders for lossy compression using a Sparse Regression Code. The codebook is defined by a design matrix and codewords are structured linear combinations of columns of this matrix. The…

Information Theory · Computer Science 2014-05-20 Ramji Venkataramanan , Tuhin Sarkar , Sekhar Tatikonda

Nonnegative Matrix Factorization consists in (approximately) factorizing a nonnegative data matrix by the product of two low-rank nonnegative matrices. It has been successfully applied as a data analysis technique in numerous domains, e.g.,…

Optimization and Control · Mathematics 2012-08-13 Nicolas Gillis , François Glineur

Non-negative Matrix Factorization (NMF) is an intensively used technique for obtaining parts-based, lower dimensional and non-negative representation. Researchers in biology, medicine, pharmacy and other fields often prefer NMF over other…

Machine Learning · Computer Science 2025-02-04 Matej Mihelčić , Pauli Miettinen

Compressive sensing has been successfully used for optimized operations in wireless sensor networks. However, raw data collected by sensors may be neither originally sparse nor easily transformed into a sparse data representation. This…

Networking and Internet Architecture · Computer Science 2016-08-16 Mohammad Abu Alsheikh , Shaowei Lin , Hwee-Pink Tan , Dusit Niyato

Sparse coding refers to the pursuit of the sparsest representation of a signal in a typically overcomplete dictionary. From a Bayesian perspective, sparse coding provides a Maximum a Posteriori (MAP) estimate of the unknown vector under a…

Signal Processing · Electrical Eng. & Systems 2019-09-04 Dror Simon , Jeremias Sulam , Yaniv Romano , Yue M. Lu , Michael Elad

Nonnegative matrix factorization can be used to automatically detect topics within a corpus in an unsupervised fashion. The technique amounts to an approximation of a nonnegative matrix as the product of two nonnegative matrices of lower…

Computation and Language · Computer Science 2022-12-21 Michael R. Lindstrom , Xiaofu Ding , Feng Liu , Anand Somayajula , Deanna Needell

Data-driven approaches have been proposed as effective strategies for the inverse design and optimization of photonic structures in recent years. In order to assist data-driven methods for the design of topology of photonic devices, we…

Optics · Physics 2020-03-18 Zhaocheng Liu , Zhaoming Zhu , Wenshan Cai

In compressed sensing, we wish to reconstruct a sparse signal $x$ from observed data $y$. In sparse coding, on the other hand, we wish to find a representation of an observed signal $y$ as a sparse linear combination, with coefficients $x$,…

Computer Vision and Pattern Recognition · Computer Science 2013-11-25 Will Landecker , Rick Chartrand , Simon DeDeo

This paper introduces a new multivariate convolutional sparse coding based on tensor algebra with a general model enforcing both element-wise sparsity and low-rankness of the activations tensors. By using the CP decomposition, this model…

Machine Learning · Statistics 2019-08-12 Pierre Humbert , Julien Audiffren , Laurent Oudre , Nicolas Vayatis