English
Related papers

Related papers: A Greedy Approach to $\ell_{0,\infty}$ Based Convo…

200 papers

Sparse coding algorithms are about finding a linear basis in which signals can be represented by a small number of active (non-zero) coefficients. Such coding has many applications in science and engineering and is believed to play an…

Neural and Evolutionary Computing · Computer Science 2016-08-14 András Lőrincz , Zsolt Palotai , Gábor Szirtes

We propose and analyze a novel framework for learning sparse representations, based on two statistical techniques: kernel smoothing and marginal regression. The proposed approach provides a flexible framework for incorporating feature…

Machine Learning · Statistics 2012-10-04 Krishnakumar Balasubramanian , Kai Yu , Guy Lebanon

A fundamental problem faced by object recognition systems is that objects and their features can appear in different locations, scales and orientations. Current deep learning methods attempt to achieve invariance to local translations via…

Computer Vision and Pattern Recognition · Computer Science 2017-12-12 Dimitrios C. Gklezakos , Rajesh P. N. Rao

Many applications in signal processing benefit from the sparsity of signals in a certain transform domain or dictionary. Synthesis sparsifying dictionaries that are directly adapted to data have been popular in applications such as image…

Machine Learning · Statistics 2015-06-23 Saiprasad Ravishankar , Yoram Bresler

A popular approach within the signal processing and machine learning communities consists in modelling signals as sparse linear combinations of atoms selected from a learned dictionary. While this paradigm has led to numerous empirical…

Machine Learning · Computer Science 2015-08-25 Rémi Gribonval , Rodolphe Jenatton , Francis Bach

In this paper, we propose a novel sparse coding and counting method under Bayesian framwork for visual tracking. In contrast to existing methods, the proposed method employs the combination of L0 and L1 norm to regularize the linear…

Computer Vision and Pattern Recognition · Computer Science 2017-02-08 Risheng Liu , Jing Wang , Yiyang Wang , Zhixun Su , Yu Cai

Greedy Pursuits are very popular in Compressed Sensing for sparse signal recovery. Though many of the Greedy Pursuits possess elegant theoretical guarantees for performance, it is well known that their performance depends on the statistical…

Applications · Statistics 2012-06-20 Sooraj K. Ambat , Saikat Chatterjee , K. V. S. Hari

Matching pursuits are a class of greedy algorithms commonly used in signal processing, for solving the sparse approximation problem. They rely on an atom selection step that requires the calculation of numerous projections, which can be…

Data Structures and Algorithms · Computer Science 2012-04-06 Manuel Moussallam , Laurent Daudet , Gaël Richard

We study here sparse recovery problems in the presence of additive noise. We analyze a thresholding version of the CoSaMP algorithm, named Thresholding Greedy Pursuit (TGP). We demonstrate that an appropriate choice of thresholding…

Signal Processing · Electrical Eng. & Systems 2021-03-23 Hai Le , Alexei Novikov

Sparse subspace clustering methods, such as Sparse Subspace Clustering (SSC) \cite{ElhamifarV13} and $\ell^{1}$-graph \cite{YanW09,ChengYYFH10}, are effective in partitioning the data that lie in a union of subspaces. Most of those methods…

Machine Learning · Computer Science 2015-11-19 Yingzhen Yang , Jiashi Feng , Jianchao Yang , Thomas S. Huang

Convolutional sparse coding (CSC) improves sparse coding by learning a shift-invariant dictionary from the data. However, existing CSC algorithms operate in the batch mode and are expensive, in terms of both space and time, on large…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Yaqing Wang , Quanming Yao , James T. Kwok , Lionel M. Ni

In this paper, we propose a new greedy algorithm for sparse approximation, called SLS for Single L_1 Selection. SLS essentially consists of a greedy forward strategy, where the selection rule of a new component at each iteration is based on…

Optimization and Control · Mathematics 2021-02-12 Ramzi Ben Mhenni , Sébastien Bourguignon , Jérôme Idier

In recent years, a large amount of multi-disciplinary research has been conducted on sparse models and their applications. In statistics and machine learning, the sparsity principle is used to perform model selection---that is,…

Computer Vision and Pattern Recognition · Computer Science 2014-12-09 Julien Mairal , Francis Bach , Jean Ponce

Cutting planes are crucial for the performance of branch-and-cut algorithms for solving mixed-integer programming (MIP) problems, and linear row aggregation has been successfully applied to better leverage the potential of several major…

Optimization and Control · Mathematics 2025-02-05 Liding Xu , Gioni Mexi , Ksenia Bestuzheva

Approximating field variables and data vectors from sparse samples is a key challenge in computational science. Widely used methods such as gappy proper orthogonal decomposition and empirical interpolation rely on linear approximation…

Numerical Analysis · Mathematics 2024-12-16 Paul Schwerdtner , Serkan Gugercin , Benjamin Peherstorfer

Detection of a signal under noise is a classical signal processing problem. When monitoring spatial phenomena under a fixed budget, i.e., either physical, economical or computational constraints, the selection of a subset of available…

Signal Processing · Electrical Eng. & Systems 2018-08-01 Mario Coutino , Sundeep Prabhakar Chepuri , Geert Leus

Sparse estimation methods are aimed at using or obtaining parsimonious representations of data or models. They were first dedicated to linear variable selection but numerous extensions have now emerged such as structured sparsity or kernel…

Machine Learning · Computer Science 2011-11-24 Francis Bach , Rodolphe Jenatton , Julien Mairal , Guillaume Obozinski

We consider the problem of sparse coding, where each sample consists of a sparse linear combination of a set of dictionary atoms, and the task is to learn both the dictionary elements and the mixing coefficients. Alternating minimization is…

Machine Learning · Computer Science 2014-07-30 Alekh Agarwal , Animashree Anandkumar , Prateek Jain , Praneeth Netrapalli

Sparse high dimensional graphical model selection is a popular topic in contemporary machine learning. To this end, various useful approaches have been proposed in the context of $\ell_1$-penalized estimation in the Gaussian framework.…

Computation · Statistics 2022-02-04 Sang-Yun Oh , Onkar Dalal , Kshitij Khare , Bala Rajaratnam

In this paper, we consider the problem of collaboratively estimating the sparsity pattern of a sparse signal with multiple measurement data in distributed networks. We assume that each node makes Compressive Sensing (CS) based measurements…

Information Theory · Computer Science 2012-11-29 Thakshila Wimalajeewa , Pramod K. Varshney