English
Related papers

Related papers: Sparse approximate solution of fitting surface to …

200 papers

Recent research has shown that performance in signal processing tasks can often be significantly improved by using signal models based on sparse representations, where a signal is approximated using a small number of elements from a fixed…

Optimization and Control · Mathematics 2011-11-18 Adam S. Charles , Pierre Garrigues , Christopher J. Rozell

Sparsity promoting norms are frequently used in high dimensional regression. A limitation of such Lasso-type estimators is that the optimal regularization parameter depends on the unknown noise level. Estimators such as the concomitant…

Machine Learning · Statistics 2020-09-04 Quentin Bertrand , Mathurin Massias , Alexandre Gramfort , Joseph Salmon

A robust algorithm is proposed to reconstruct the spatial support and the Lam\'e parameters of multiple inclusions in a homogeneous background elastic material using a few measurements of the displacement field over a finite collection of…

Numerical Analysis · Mathematics 2017-02-27 Jaejun Yoo , Younghoon Jung , Mikyoung Lim , Jong Chul Ye , Abdul Wahab

The performance of machine learning and pattern recognition algorithms generally depends on data representation. That is why, much of the current effort in performing machine learning algorithms goes into the design of preprocessing…

Machine Learning · Computer Science 2025-10-28 Fadi Dornaika , Ahmad Khoder , Abdelmalik Moujahid , Wassim Khoder

Finite mixture regression models are useful for modeling the relationship between response and predictors, arising from different subpopulations. In this article, we study high-dimensional predic- tors and high-dimensional response, and…

Statistics Theory · Mathematics 2016-01-07 Emilie Devijver

In this article, we propose an algorithm, NESTA-LASSO, for the LASSO problem, i.e., an underdetermined linear least-squares problem with a 1-norm constraint on the solution. We prove under the assumption of the restricted isometry property…

Optimization and Control · Mathematics 2012-04-03 Ming Gu , Lek-Heng Lim , Cinna Julie Wu

The least squares problem with L1-regularized regressors, called Lasso, is a widely used approach in optimization problems where sparsity of the regressors is desired. This formulation is fundamental for many applications in signal…

Optimization and Control · Mathematics 2021-04-26 Andreea B. Alexandru , Anastasios Tsiamis , George J. Pappas

The aim of this paper is to extend the approximate quasi-interpolation on a uniform grid by dilated shifts of a smooth and rapidly decaying function on a uniform grid to scattered data quasi-interpolation. It is shown that high order…

Numerical Analysis · Mathematics 2007-05-23 F. Lanzara , V. Maz'ya , G. Schmidt

Sparsity-constrained optimization underlies many problems in signal processing, statistics, and machine learning. State-of-the-art hard-thresholding (HT) algorithms rely on an appropriately selected continuous step-size parameter to ensure…

Machine Learning · Statistics 2026-05-13 Jin Zhu , Junxian Zhu , Zezhi Wang , Borui Tang , Hongmei Lin , Xueqin Wang

Sparse representation has attracted much attention from researchers in fields of signal processing, image processing, computer vision and pattern recognition. Sparse representation also has a good reputation in both theoretical research and…

Computer Vision and Pattern Recognition · Computer Science 2016-02-24 Zheng Zhang , Yong Xu , Jian Yang , Xuelong Li , David Zhang

Sparse coding refers to the pursuit of the sparsest representation of a signal in a typically overcomplete dictionary. From a Bayesian perspective, sparse coding provides a Maximum a Posteriori (MAP) estimate of the unknown vector under a…

Signal Processing · Electrical Eng. & Systems 2019-09-04 Dror Simon , Jeremias Sulam , Yaniv Romano , Yue M. Lu , Michael Elad

L1-minimization refers to finding the minimum L1-norm solution to an underdetermined linear system b=Ax. Under certain conditions as described in compressive sensing theory, the minimum L1-norm solution is also the sparsest solution. In…

Computer Vision and Pattern Recognition · Computer Science 2012-08-28 Allen Y. Yang , Zihan Zhou , Arvind Ganesh , S. Shankar Sastry , Yi Ma

This paper is concerned with high-dimensional panel data models where the number of regressors can be much larger than the sample size. Under the assumption that the true parameter vector is sparse we propose a panel-Lasso estimator and…

Statistics Theory · Mathematics 2014-02-14 Anders Bredahl Kock

Sparse linear regression (SLR) is a well-studied problem in statistics where one is given a design matrix $X\in\mathbb{R}^{m\times n}$ and a response vector $y=X\theta^*+w$ for a $k$-sparse vector $\theta^*$ (that is, $\|\theta^*\|_0\leq…

Machine Learning · Computer Science 2025-02-06 Aparna Gupte , Neekon Vafa , Vinod Vaikuntanathan

We compute approximate solutions to L0 regularized linear regression using L1 regularization, also known as the Lasso, as an initialization step. Our algorithm, the Lass-0 ("Lass-zero"), uses a computationally efficient stepwise search to…

Machine Learning · Statistics 2016-02-18 William Herlands , Maria De-Arteaga , Daniel Neill , Artur Dubrawski

We study multiscale scattered data interpolation schemes for globally supported radial basis functions with focus on the Mat\'ern class. The multiscale approximation is constructed through a sequence of residual corrections, where radial…

Numerical Analysis · Mathematics 2025-03-18 Sara Avesani , Rüdiger Kempf , Michael Multerer , Holger Wendland

The sparse group Lasso is a widely used statistical model which encourages the sparsity both on a group and within the group level. In this paper, we develop an efficient augmented Lagrangian method for large-scale non-overlapping sparse…

Optimization and Control · Mathematics 2020-10-23 Yangjing Zhang , Ning Zhang , Defeng Sun , Kim-Chuan Toh

In this paper, we propose a model's sparse representation based on reduced mixed generalized multiscale finite element (GMsFE) basis methods for elliptic PDEs with random inputs. Mixed generalized multiscale finite element method (GMsFEM)…

Numerical Analysis · Mathematics 2017-04-05 Lijian Jiang , Qiuqi Li

Sparse modelling or model selection with categorical data is challenging even for a moderate number of variables, because one parameter is roughly needed to encode one category or level. The Group Lasso is a well known efficient algorithm…

Methodology · Statistics 2022-11-14 Szymon Nowakowski , Piotr Pokarowski , Wojciech Rejchel , Agnieszka Sołtys

This paper examines a general class of noisy matrix completion tasks where the goal is to estimate a matrix from observations obtained at a subset of its entries, each of which is subject to random noise or corruption. Our specific focus is…

Machine Learning · Statistics 2016-11-18 Akshay Soni , Swayambhoo Jain , Jarvis Haupt , Stefano Gonella