English
Related papers

Related papers: Screening Tests for Lasso Problems

200 papers

Recent advances suggest that a wide range of computer vision problems can be addressed more appropriately by considering non-Euclidean geometry. This paper tackles the problem of sparse coding and dictionary learning in the space of…

Machine Learning · Computer Science 2013-04-17 Mehrtash T. Harandi , Conrad Sanderson , Richard Hartley , Brian C. Lovell

In the dictionary learning (or sparse coding) problem, we are given a collection of signals (vectors in $\mathbb{R}^d$), and the goal is to find a "basis" in which the signals have a sparse (approximate) representation. The problem has…

Machine Learning · Computer Science 2019-05-30 Aditya Bhaskara , Wai Ming Tai

Sparse coding and dictionary learning are popular techniques for linear inverse problems such as denoising or inpainting. However in many cases, the measurement process is nonlinear, for example for clipped, quantized or 1-bit measurements.…

Signal Processing · Electrical Eng. & Systems 2020-01-08 Lucas Rencker , Francis Bach , Wenwu Wang , Mark D. Plumbley

Modeling data with linear combinations of a few elements from a learned dictionary has been the focus of much recent research in machine learning, neuroscience and signal processing. For signals such as natural images that admit such sparse…

Machine Learning · Statistics 2013-09-10 Julien Mairal , Francis Bach , Jean Ponce

The high-dimensional linear model $y = X \beta^0 + \epsilon$ is considered and the focus is put on the problem of recovering the support $S^0$ of the sparse vector $\beta^0.$ We introduce Lasso-Zero, a new $\ell_1$-based estimator whose…

Methodology · Statistics 2019-04-15 Pascaline Descloux , Sylvain Sardy

Sparse representations using data dictionaries provide an efficient model particularly for signals that do not enjoy alternate analytic sparsifying transformations. However, solving inverse problems with sparsifying dictionaries can be…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Vishwanath Saragadam , Xin Li , Aswin Sankaranarayanan

We propose a new framework for deriving screening rules for convex optimization problems. Our approach covers a large class of constrained and penalized optimization formulations, and works in two steps. First, given any approximate point,…

Optimization and Control · Mathematics 2016-09-26 Anant Raj , Jakob Olbrich , Bernd Gärtner , Bernhard Schölkopf , Martin Jaggi

Dictionary learning is a branch of signal processing and machine learning that aims at finding a frame (called dictionary) in which some training data admits a sparse representation. The sparser the representation, the better the…

Machine Learning · Computer Science 2015-02-27 Luc Le Magoarou , Rémi Gribonval

Sparse representation-based classifiers have shown outstanding accuracy and robustness in image classification tasks even with the presence of intense noise and occlusion. However, it has been discovered that the performance degrades…

Computer Vision and Pattern Recognition · Computer Science 2015-12-22 Xiaoxia Sun , Nasser M. Nasrabadi , Trac D. Tran

The problems of Lasso regression and optimal design of experiments share a critical property: their optimal solutions are typically \emph{sparse}, i.e., only a small fraction of the optimal variables are non-zero. Therefore, the…

Methodology · Statistics 2023-12-07 Guillaume Sagnol , Luc Pronzato

In ill-posed dynamic inverse problems expected spatial features and temporal correlation between frames can be leveraged to improve the quality of the computed solution, in particular when the available data are limited and the…

Dictionary learning is a cutting-edge area in imaging processing, that has recently led to state-of-the-art results in many signal processing tasks. The idea is to conduct a linear decomposition of a signal using a few atoms of a learned…

Machine Learning · Statistics 2016-05-26 Simeng Qu , Xiao Wang

Constrained tensor and matrix factorization models allow to extract interpretable patterns from multiway data. Therefore identifiability properties and efficient algorithms for constrained low-rank approximations are nowadays important…

Machine Learning · Computer Science 2022-01-24 Jeremy E. Cohen

Screening is an effective technique for speeding up the training process of a sparse learning model by removing the features that are guaranteed to be inactive the process. In this paper, we present a efficient screening technique for…

Machine Learning · Computer Science 2013-11-01 Zheng Zhao , Jun Liu

In sparse recovery, the unique sparsest solution to an under-determined system of linear equations is of main interest. This scheme is commonly proposed to be applied to signal acquisition. In most cases, the signals are not sparse…

Information Theory · Computer Science 2013-07-16 Henning Zörlein , Faisal Akram , Martin Bossert

In dictionary learning, also known as sparse coding, the algorithm is given samples of the form $y = Ax$ where $x\in \mathbb{R}^m$ is an unknown random sparse vector and $A$ is an unknown dictionary matrix in $\mathbb{R}^{n\times m}$…

Data Structures and Algorithms · Computer Science 2014-01-06 Sanjeev Arora , Aditya Bhaskara , Rong Ge , Tengyu Ma

We consider the problem of dictionary learning under the assumption that the observed signals can be represented as sparse linear combinations of the columns of a single large dictionary matrix. In particular, we analyze the minimax risk of…

Machine Learning · Statistics 2014-06-30 Alexander Jung , Yonina C. Eldar , Norbert Görtz

In the present paper we consider application of overcomplete dictionaries to solution of general ill-posed linear inverse problems. Construction of an adaptive optimal solution for such problems usually relies either on a singular value…

Methodology · Statistics 2015-04-03 Marianna Pensky

The l1-regularized logistic regression (or sparse logistic regression) is a widely used method for simultaneous classification and feature selection. Although many recent efforts have been devoted to its efficient implementation, its…

Machine Learning · Computer Science 2013-07-22 Jie Wang , Jiayu Zhou , Jun Liu , Peter Wonka , Jieping Ye

Sparse coding, which refers to modeling a signal as sparse linear combinations of the elements of a learned dictionary, has proven to be a successful (and interpretable) approach in applications such as signal processing, computer vision,…

Machine Learning · Computer Science 2023-06-02 Muthu Chidambaram , Chenwei Wu , Yu Cheng , Rong Ge