English
Related papers

Related papers: Using the LASSO's Dual for Regularization in Spars…

200 papers

In inverse problems, it is widely recognized that the incorporation of a sparsity prior yields a regularization effect on the solution. This approach is grounded on the a priori assumption that the unknown can be appropriately represented…

Machine Learning · Statistics 2025-06-13 Giovanni S. Alberti , Luca Ratti , Matteo Santacesaria , Silvia Sciutto

Estimating the direction of arrival (DOA) of sources is an important problem in aerospace and vehicular communication, localization and radar. In this paper, we consider a challenging multi-source DOA estimation task, where the receiving…

Signal Processing · Electrical Eng. & Systems 2022-02-17 Tom Tirer , Oded Bialer

Received signal strength (RSS) based source localization method is popular due to its simplicity and low cost. However, this method is highly dependent on the propagation model which is not easy to be captured in practice. Moreover, most…

Signal Processing · Electrical Eng. & Systems 2020-08-26 Kangyong You , Wenbin Guo , Tao Peng , Yueliang Liu , Peiliang Zuo , Wenbo Wang

In this paper, we recover sparse signals from their noisy linear measurements by solving nonlinear differential inclusions, which is based on the notion of inverse scale space (ISS) developed in applied mathematics. Our goal here is to…

Statistics Theory · Mathematics 2016-01-22 Stanley Osher , Feng Ruan , Jiechao Xiong , Yuan Yao , Wotao Yin

In this paper, we consider the classic measurement error regression scenario in which our independent, or design, variables are observed with several sources of additive noise. We will show that our motivating example's replicated…

Applications · Statistics 2012-07-10 David J. Biagioni , Ryan Elmore , Wesley Jones

Inverse problems and regularization theory is a central theme in contemporary signal processing, where the goal is to reconstruct an unknown signal from partial indirect, and possibly noisy, measurements of it. A now standard method for…

Optimization and Control · Mathematics 2014-12-09 Samuel Vaiter , Gabriel Peyré , Jalal M. Fadili

We consider the problem of recovering an unknown effectively $(s_1,s_2)$-sparse low-rank-$R$ matrix $X$ with possibly non-orthogonal rank-$1$ decomposition from incomplete and inaccurate linear measurements of the form $y = \mathcal A (X) +…

Numerical Analysis · Mathematics 2020-07-29 Massimo Fornasier , Johannes Maly , Valeriya Naumova

Regularization is a well studied problem in the context of neural networks. It is usually used to improve the generalization performance when the number of input samples is relatively small or heavily contaminated with noise. The…

Artificial Intelligence · Computer Science 2011-04-19 Salah Rifai , Xavier Glorot , Yoshua Bengio , Pascal Vincent

This document contains an educational introduction to the problem of sparsifying parametric models with L0 regularization. We utilize this approach together with dictionary learning to learn sparse polynomial policies for deep reinforcement…

Machine Learning · Computer Science 2024-09-06 Nicolò Botteghi , Urban Fasel

Regularization is a common tool in variational inverse problems to impose assumptions on the parameters of the problem. One such assumption is sparsity, which is commonly promoted using lasso and total variation-like regularization.…

Statistics Theory · Mathematics 2023-02-15 Jasper Marijn Everink , Yiqiu Dong , Martin Skovgaard Andersen

We compute approximate solutions to L0 regularized linear regression using L1 regularization, also known as the Lasso, as an initialization step. Our algorithm, the Lass-0 ("Lass-zero"), uses a computationally efficient stepwise search to…

Machine Learning · Statistics 2016-02-18 William Herlands , Maria De-Arteaga , Daniel Neill , Artur Dubrawski

Distorted sensors could occur randomly and may lead to the breakdown of a sensor array system. We consider an array model within which a small number of sensors are distorted by unknown sensor gain and phase errors. With such an array…

Signal Processing · Electrical Eng. & Systems 2024-10-28 Huiping Huang , Qi Liu , Hing Cheung So , Abdelhak M. Zoubir

In dynamic MRI, sufficient time resolution can often only be obtained using imaging protocols which produce undersampled data for each image in the time series. This has led to the popularity of compressed sensing (CS) based image…

The SPS-LASSO has recently been introduced as a solution to the problem of regularization parameter selection in the complex-valued LASSO problem. Still, the dependence on the grid size and the polynomial time of performing convex…

Information Theory · Computer Science 2012-07-31 Ashkan Panahi , Mats Viberg

Variational regularization of ill-posed inverse problems is based on minimizing the sum of a data fidelity term and a regularization term. The balance between them is tuned using a positive regularization parameter, whose automatic choice…

Numerical Analysis · Mathematics 2025-11-12 Markus Juvonen , Bjørn Jensen , Ilmari Pohjola , Yiqiu Dong , Samuli Siltanen

Inspired by several recent developments in regularization theory, optimization, and signal processing, we present and analyze a numerical approach to multi-penalty regularization in spaces of sparsely represented functions. The sparsity…

Numerical Analysis · Mathematics 2014-11-25 Valeriya Naumova , Steffen Peter

Sparse modeling is one of the efficient techniques for imaging that allows recovering lost information. In this paper, we present a novel iterative phase-retrieval algorithm using a sparse representation of the object amplitude and phase.…

Computer Vision and Pattern Recognition · Computer Science 2011-08-17 Artem Migukin , Vladimir Katkovnik , Jaakko Astola

Within the statistical and machine learning literature, regularization techniques are often used to construct sparse (predictive) models. Most regularization strategies only work for data where all predictors are treated identically, such…

Computation · Statistics 2020-12-16 Sander Devriendt , Katrien Antonio , Tom Reynkens , Roel Verbelen

Sparse modelling or model selection with categorical data is challenging even for a moderate number of variables, because one parameter is roughly needed to encode one category or level. The Group Lasso is a well known efficient algorithm…

Methodology · Statistics 2022-11-14 Szymon Nowakowski , Piotr Pokarowski , Wojciech Rejchel , Agnieszka Sołtys

Direction of Arrival (DOA) estimation of mixed uncorrelated and coherent sources is a long existing challenge in array signal processing. Application of compressive sensing to array signal processing has opened up an exciting class of…

Signal Processing · Electrical Eng. & Systems 2018-09-10 Abhishek Aich , P. Palanisamy