English
Related papers

Related papers: Learning $\ell_1$-based analysis and synthesis spa…

200 papers

This paper introduces a novel approach to learning sparsity-promoting regularizers for solving linear inverse problems. We develop a bilevel optimization framework to select an optimal synthesis operator, denoted as $B$, which regularizes…

Machine Learning · Statistics 2026-03-03 Giovanni S. Alberti , Ernesto De Vito , Tapio Helin , Matti Lassas , Luca Ratti , Matteo Santacesaria

Compressed sensing with sparse frame representations is seen to have much greater range of practical applications than that with orthonormal bases. In such settings, one approach to recover the signal is known as $\ell_1$-analysis. We…

Information Theory · Computer Science 2015-03-19 Yulong Liu , Tiebin Mi , Shidong Li

The optimization problem with sparsity arises in many areas of science and engineering such as compressed sensing, image processing, statistical learning and data sparse approximation. In this paper, we study the dual-density-based…

Optimization and Control · Mathematics 2021-01-08 Jialiang Xu , Yun-Bin Zhao

Sparse representation learning has recently gained a great success in signal and image processing, thanks to recent advances in dictionary learning. To this end, the $\ell_0$-norm is often used to control the sparsity level. Nevertheless,…

Computer Vision and Pattern Recognition · Computer Science 2017-09-19 Yuan Liu , Stéphane Canu , Paul Honeine , Su Ruan

We present a method for supervised learning of sparsity-promoting regularizers for denoising signals and images. Sparsity-promoting regularization is a key ingredient in solving modern signal reconstruction problems; however, the operators…

Machine Learning · Computer Science 2023-09-07 Avrajit Ghosh , Michael T. McCann , Madeline Mitchell , Saiprasad Ravishankar

Sparse estimation methods are aimed at using or obtaining parsimonious representations of data or models. While naturally cast as a combinatorial optimization problem, variable or feature selection admits a convex relaxation through the…

Machine Learning · Computer Science 2012-04-23 Francis Bach , Rodolphe Jenatton , Julien Mairal , Guillaume Obozinski

We consider the problem of learning a low-dimensional signal model from a collection of training samples. The mainstream approach would be to learn an overcomplete dictionary to provide good approximations of the training samples using…

Numerical Analysis · Mathematics 2015-06-05 Mehrdad Yaghoobi , Sangnam Nam , Remi Gribonval , Mike E. Davies

Exploiting a priori known structural information lies at the core of many image reconstruction methods that can be stated as inverse problems. The synthesis model, which assumes that images can be decomposed into a linear combination of…

Machine Learning · Computer Science 2015-06-04 Simon Hawe , Martin Kleinsteuber , Klaus Diepold

The sparsity of natural signals and images in a transform domain or dictionary has been extensively exploited in several applications such as compression, denoising and inverse problems. More recently, data-driven adaptation of synthesis…

Machine Learning · Computer Science 2017-04-24 Saiprasad Ravishankar , Raj Rao Nadakuditi , Jeffrey A. Fessler

Methods exploiting sparsity have been popular in imaging and signal processing applications including compression, denoising, and imaging inverse problems. Data-driven approaches such as dictionary learning and transform learning enable one…

Machine Learning · Computer Science 2018-02-05 Saiprasad Ravishankar , Anna Ma , Deanna Needell

In this work, we study the affine-constrained $\ell_1$ regularizers, which frequently arise in statistical and machine learning problems across a variety of applications, including microbiome compositional data analysis and sparse subspace…

Optimization and Control · Mathematics 2025-10-09 Xudong Li , Meixia Lin , Kim-Chuan Toh

Sparsity-based models and techniques have been exploited in many signal processing and imaging applications. Data-driven methods based on dictionary and sparsifying transform learning enable learning rich image features from data, and can…

Machine Learning · Computer Science 2019-09-25 Saiprasad Ravishankar , Anna Ma , Deanna Needell

Many applications in signal processing benefit from the sparsity of signals in a certain transform domain or dictionary. Synthesis sparsifying dictionaries that are directly adapted to data have been popular in applications such as image…

Machine Learning · Statistics 2015-06-23 Saiprasad Ravishankar , Yoram Bresler

Sparse manifold learning algorithms combine techniques in manifold learning and sparse optimization to learn features that could be utilized for downstream tasks. The standard setting of compressive sensing can not be immediately applied to…

Signal Processing · Electrical Eng. & Systems 2024-08-05 Abiy Tasissa , Pranay Tankala , Demba Ba

Recently, considerable research efforts have been devoted to the design of methods to learn from data overcomplete dictionaries for sparse coding. However, learned dictionaries require the solution of an optimization problem for coding new…

Machine Learning · Computer Science 2010-11-17 Curzio Basso , Matteo Santoro , Alessandro Verri , Silvia Villa

Sparsity and rank functions are important ways of regularizing under-determined linear systems. Optimization of the resulting formulations is made difficult since both these penalties are non-convex and discontinuous. The most common remedy…

Optimization and Control · Mathematics 2019-01-01 Carl Olsson , Marcus Carlsson , Daniele Gerosa

Sparse learning is an important topic in many areas such as machine learning, statistical estimation, signal processing, etc. Recently, there emerges a growing interest on structured sparse learning. In this paper we focus on the…

Information Theory · Computer Science 2015-03-10 Shubao Zhang , Hui Qian , Zhihua Zhang

We present a probabilistic modeling and inference framework for discriminative analysis dictionary learning under a weak supervision setting. Dictionary learning approaches have been widely used for tasks such as low-level signal denoising…

Signal Processing · Electrical Eng. & Systems 2018-05-09 Zeyu You , Raviv Raich , Xiaoli Z. Fern , Jinsub Kim

This paper addresses a new learning algorithm for the recently introduced co-sparse analysis model. First, we give new insights into the co-sparse analysis model by establishing connections to filter-based MRF models, such as the Field of…

Computer Vision and Pattern Recognition · Computer Science 2014-01-14 Yunjin Chen , René Ranftl , Thomas Pock

We consider a discrete optimization formulation for learning sparse classifiers, where the outcome depends upon a linear combination of a small subset of features. Recent work has shown that mixed integer programming (MIP) can be used to…

Machine Learning · Statistics 2021-06-08 Antoine Dedieu , Hussein Hazimeh , Rahul Mazumder
‹ Prev 1 2 3 10 Next ›