English
Related papers

Related papers: Sparse superposition codes under VAMP decoding wit…

200 papers

The generalized linear system (GLS) has been widely used in wireless communications to evaluate the effect of nonlinear preprocessing on receiver performance. Generalized approximation message passing (AMP) is a state-of-the-art algorithm…

Information Theory · Computer Science 2023-05-16 Lei Liu , Yuhao Chi , Ying Li , Zhaoyang Zhang

The celebrated sparse representation model has led to remarkable results in various signal processing tasks in the last decade. However, despite its initial purpose of serving as a global prior for entire signals, it has been commonly used…

Information Theory · Computer Science 2017-10-11 Vardan Papyan , Jeremias Sulam , Michael Elad

Sparse coding is an unsupervised learning algorithm that learns a succinct high-level representation of the inputs given only unlabeled data; it represents each input as a sparse linear combination of a set of basis functions. Originally…

Machine Learning · Computer Science 2012-06-26 Roger Grosse , Rajat Raina , Helen Kwong , Andrew Y. Ng

This paper considers a generalized multiple-input multiple-output (GMIMO) with practical assumptions, such as massive antennas, practical channel coding, arbitrary input distributions, and general right-unitarily-invariant channel matrices…

Information Theory · Computer Science 2023-10-30 Yufei Chen , Lei Liu , Yuhao Chi , Ying Li , Zhaoyang Zhang

In this work, we formulate the fixed-length distribution matching as a Bayesian inference problem. Our proposed solution is inspired from the compressed sensing paradigm and the sparse superposition (SS) codes. First, we introduce sparsity…

Information Theory · Computer Science 2018-11-27 Mohamad Dia , Vahid Aref , Laurent Schmalen

Approximate message passing (AMP) is a low-cost iterative parameter-estimation technique for certain high-dimensional linear systems with non-Gaussian distributions. However, AMP only applies to independent identically distributed (IID)…

Information Theory · Computer Science 2021-06-07 Lei Liu , Shunqi Huang , Brian M. Kurkoski

In compressed sensing, we wish to reconstruct a sparse signal $x$ from observed data $y$. In sparse coding, on the other hand, we wish to find a representation of an observed signal $y$ as a sparse linear combination, with coefficients $x$,…

Computer Vision and Pattern Recognition · Computer Science 2013-11-25 Will Landecker , Rick Chartrand , Simon DeDeo

Sparse codes in neuroscience have been suggested to offer certain computational advantages over other neural representations of sensory data. To explore this viewpoint, a sparse code is used to represent natural images in an optimal control…

Machine Learning · Computer Science 2021-01-08 Peter N. Loxley

Sparse coding networks, which utilize unsupervised learning to maximize coding efficiency, have successfully reproduced response properties found in primary visual cortex \cite{AN:OlshausenField96}. However, conventional sparse coding…

Neurons and Cognition · Quantitative Biology 2011-05-25 William K. Coulter , Christopher J. Hillar , Friedrich T. Sommer

Block orthogonal sparse superposition (BOSS) code is a class of joint coded modulation methods, which can closely achieve the finite-blocklength capacity with a low-complexity decoder at a few coding rates under Gaussian channels. However,…

Information Theory · Computer Science 2024-03-26 Donghwa Han , Bowhyung Lee , Min Jang , Donghun Lee , Seho Myung , Namyoon Lee

Inverse problems are fundamental to many scientific and engineering disciplines; they arise when one seeks to reconstruct hidden, underlying quantities from noisy measurements. Many applications demand not just point estimates but…

Machine Learning · Computer Science 2026-02-11 Jack Michael Solomon , Rishi Leburu , Matthias Chung

Sparse coding (SC) is attracting more and more attention due to its comprehensive theoretical studies and its excellent performance in many signal processing applications. However, most existing sparse coding algorithms are nonconvex and…

Machine Learning · Computer Science 2017-09-12 Xiaodong Feng , Zhiwei Tang , Sen Wu

We investigate the use of sparse coding and dictionary learning in the context of multitask and transfer learning. The central assumption of our learning method is that the tasks parameters are well approximated by sparse linear…

Machine Learning · Computer Science 2014-06-17 Andreas Maurer , Massimiliano Pontil , Bernardino Romera-Paredes

The celebrated sparse representation model has led to remarkable results in various signal processing tasks in the last decade. However, despite its initial purpose of serving as a global prior for entire signals, it has been commonly used…

Information Theory · Computer Science 2017-02-23 Vardan Papyan , Jeremias Sulam , Michael Elad

We present a novel sparse modeling approach to non-rigid shape matching using only the ability to detect repeatable regions. As the input to our algorithm, we are given only two sets of regions in two shapes; no descriptors are provided so…

Graphics · Computer Science 2012-10-01 J. Pokrass , A. M. Bronstein , M. M. Bronstein , P. Sprechmann , G. Sapiro

The generalized linear model (GLM), where a random vector $\boldsymbol{x}$ is observed through a noisy, possibly nonlinear, function of a linear transform output $\boldsymbol{z}=\boldsymbol{Ax}$, arises in a range of applications such as…

Information Theory · Computer Science 2016-12-06 Philip Schniter , Sundeep Rangan , Alyson K. Fletcher

Sparse coding algorithm is an learning algorithm mainly for unsupervised feature for finding succinct, a little above high - level Representation of inputs, and it has successfully given a way for Deep learning. Our objective is to use High…

Machine Learning · Computer Science 2014-04-08 R. Vidya , Dr. G. M. Nasira , R. P. Jaia Priyankka

Sparse coding is a basic task in many fields including signal processing, neuroscience and machine learning where the goal is to learn a basis that enables a sparse representation of a given set of data, if one exists. Its standard…

Machine Learning · Computer Science 2015-03-04 Sanjeev Arora , Rong Ge , Tengyu Ma , Ankur Moitra

In this paper we consider the generalized approximate message passing (GAMP) algorithm for recovering a sparse signal from modulo samples of randomized projections of the unknown signal. The modulo samples are obtained by a self-reset (SR)…

Signal Processing · Electrical Eng. & Systems 2018-07-10 Osman Musa , Peter Jung , Norbert Goertz

In recent years, a large amount of multi-disciplinary research has been conducted on sparse models and their applications. In statistics and machine learning, the sparsity principle is used to perform model selection---that is,…

Computer Vision and Pattern Recognition · Computer Science 2014-12-09 Julien Mairal , Francis Bach , Jean Ponce
‹ Prev 1 3 4 5 6 7 10 Next ›