English
Related papers

Related papers: Sparse Coding with Multi-Layer Decoders using Vari…

200 papers

Sparse coding has been popularly used as an effective data representation method in various applications, such as computer vision, medical imaging and bioinformatics, etc. However, the conventional sparse coding algorithms and its manifold…

Computer Vision and Pattern Recognition · Computer Science 2013-04-04 Jing-Yan Wang

The most widely used form of convolutional sparse coding uses an $\ell_1$ regularization term. While this approach has been successful in a variety of applications, a limitation of the $\ell_1$ penalty is that it is homogeneous across the…

Computer Vision and Pattern Recognition · Computer Science 2017-11-09 Brendt Wohlberg

As a powerful statistical image modeling technique, sparse representation has been successfully used in various image restoration applications. The success of sparse representation owes to the development of l1-norm optimization techniques,…

Computer Vision and Pattern Recognition · Computer Science 2015-05-20 Weisheng Dong , Lei Zhang , Guangming Shi , Xiaolin Wu

Many imaging science tasks can be modeled as a discrete linear inverse problem. Solving linear inverse problems is often challenging, with ill-conditioned operators and potentially non-unique solutions. Embedding prior knowledge, such as…

Numerical Analysis · Mathematics 2023-12-07 Elizabeth Newman , Jack Michael Solomon , Matthias Chung

Sparse representations using overcomplete dictionaries have proved to be a powerful tool in many signal processing applications such as denoising, super-resolution, inpainting, compression or classification. The sparsity of the…

Machine Learning · Statistics 2018-03-01 Jeremy Aghaei Mazaheri , Elif Vural , Claude Labit , Christine Guillemot

While deep neural networks (DNNs) have proven to be efficient for numerous tasks, they come at a high memory and computation cost, thus making them impractical on resource-limited devices. However, these networks are known to contain a…

Neural and Evolutionary Computing · Computer Science 2020-07-21 Anthony Berthelier , Yongzhe Yan , Thierry Chateau , Christophe Blanc , Stefan Duffner , Christophe Garcia

Sparse dictionary coding represents signals as linear combinations of a few dictionary atoms. It has been applied to images, time series, graph signals and multi-way spatio-temporal data by jointly employing temporal and spatial…

Machine Learning · Computer Science 2025-09-15 Boya Ma , Abram Magner , Maxwell McNeil , Petko Bogdanov

A fundamental problem faced by object recognition systems is that objects and their features can appear in different locations, scales and orientations. Current deep learning methods attempt to achieve invariance to local translations via…

Computer Vision and Pattern Recognition · Computer Science 2017-12-12 Dimitrios C. Gklezakos , Rajesh P. N. Rao

Sparse coding in learned dictionaries has been established as a successful approach for signal denoising, source separation and solving inverse problems in general. A dictionary learning method adapts an initial dictionary to a particular…

Machine Learning · Statistics 2012-10-18 Christian D. Sigg , Tomas Dikk , Joachim M. Buhmann

Sparse coding algorithms are about finding a linear basis in which signals can be represented by a small number of active (non-zero) coefficients. Such coding has many applications in science and engineering and is believed to play an…

Neural and Evolutionary Computing · Computer Science 2016-08-14 András Lőrincz , Zsolt Palotai , Gábor Szirtes

This work presents an approach for image reconstruction in clinical low-dose tomography that combines principles from sparse signal processing with ideas from deep learning. First, we describe sparse signal representation in terms of…

Machine Learning · Statistics 2023-11-27 Jevgenija Rudzusika , Thomas Koehler , Ozan Öktem

We propose a sparse reconstruction framework for solving inverse problems. Opposed to existing sparse regularization techniques that are based on frame representations, we train an encoder-decoder network by including an $\ell^1$-penalty.…

Numerical Analysis · Mathematics 2019-08-07 Daniel Obmann , Johannes Schwab , Markus Haltmeier

Continual learning enables large language models to adapt to evolving tasks without retraining from scratch, yet catastrophic forgetting remains a central obstacle. Among continual learning methods, regularization-based approaches are…

Machine Learning · Computer Science 2026-05-26 Mingxu Zhang , Yuhan Li , Lujundong Li , Dazhong Shen , Hui Xiong , Ying Sun

In the field of face recognition, Sparse Representation (SR) has received considerable attention during the past few years. Most of the relevant literature focuses on holistic descriptors in closed-set identification applications. The…

Computer Vision and Pattern Recognition · Computer Science 2014-12-19 Yongkang Wong , Mehrtash T. Harandi , Conrad Sanderson

During the inversion of discrete linear systems noise in data can be amplified and result in meaningless solutions. To combat this effect, characteristics of solutions that are considered desirable are mathematically implemented during…

Numerical Analysis · Mathematics 2023-02-07 Michael J. Byrne , Rosemary A. Renaut

Autoencoding has achieved great empirical success as a framework for learning generative models for natural images. Autoencoders often use generic deep networks as the encoder or decoder, which are difficult to interpret, and the learned…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Xili Dai , Ke Chen , Shengbang Tong , Jingyuan Zhang , Xingjian Gao , Mingyang Li , Druv Pai , Yuexiang Zhai , XIaojun Yuan , Heung-Yeung Shum , Lionel M. Ni , Yi Ma

Many applications in signal processing benefit from the sparsity of signals in a certain transform domain or dictionary. Synthesis sparsifying dictionaries that are directly adapted to data have been popular in applications such as image…

Machine Learning · Statistics 2015-06-23 Saiprasad Ravishankar , Yoram Bresler

Dictionary learning is a challenge topic in many image processing areas. The basic goal is to learn a sparse representation from an overcomplete basis set. Due to combining the advantages of generic multiscale representations with learning…

Computer Vision and Pattern Recognition · Computer Science 2017-04-17 Rui Chen , Huizhu Jia , Xiaodong Xie , Wen Gao

We propose and analyze a novel framework for learning sparse representations, based on two statistical techniques: kernel smoothing and marginal regression. The proposed approach provides a flexible framework for incorporating feature…

Machine Learning · Statistics 2012-10-04 Krishnakumar Balasubramanian , Kai Yu , Guy Lebanon

Sparse coding (SC) is an automatic feature extraction and selection technique that is widely used in unsupervised learning. However, conventional SC vectorizes the input images, which breaks apart the local proximity of pixels and destructs…

Computer Vision and Pattern Recognition · Computer Science 2017-03-29 Fei Jiang , Xiao-Yang Liu , Hongtao Lu , Ruimin Shen