English
Related papers

Related papers: A Unified Framework for Pattern Recovery in Penali…

200 papers

Estimating covariance parameters for multivariate spatial Gaussian random fields is computationally challenging, as the number of parameters grows rapidly with the number of variables, and likelihood evaluation requires operations of order…

Methodology · Statistics 2026-04-10 Francisco Cuevas-Pacheco , Gabriel Riffo , Xavier Emery

Nonconvex penalty methods for sparse modeling in linear regression have been a topic of fervent interest in recent years. Herein, we study a family of nonconvex penalty functions that we call the trimmed Lasso and that offers exact control…

Methodology · Statistics 2017-08-16 Dimitris Bertsimas , Martin S. Copenhaver , Rahul Mazumder

One of the most prominent methods for uncertainty quantification in high-dimen-sional statistics is the desparsified LASSO that relies on unconstrained $\ell_1$-minimization. The majority of initial works focused on real (sub-)Gaussian…

Information Theory · Computer Science 2023-09-14 Frederik Hoppe , Felix Krahmer , Claudio Mayrink Verdun , Marion I. Menzel , Holger Rauhut

There are many settings where researchers are interested in estimating average treatment effects and are willing to rely on the unconfoundedness assumption, which requires that the treatment assignment be as good as random conditional on…

Methodology · Statistics 2018-02-02 Susan Athey , Guido W. Imbens , Stefan Wager

This paper studies the problems of identifiability and estimation in high-dimensional nonparametric latent structure models. We introduce an identifiability theorem that generalizes existing conditions, establishing a unified framework…

Statistics Theory · Mathematics 2025-08-06 Yichen Lyu , Pengkun Yang

In this paper, we propose a new method for estimation and constructing confidence intervals for low-dimensional components in a high-dimensional model. The proposed estimator, called Constrained Lasso (CLasso) estimator, is obtained by…

Methodology · Statistics 2017-04-19 Yun Yang

Given $n$ noisy samples with $p$ dimensions, where $n \ll p$, we show that the multi-step thresholding procedure based on the Lasso -- we call it the {\it Thresholded Lasso}, can accurately estimate a sparse vector $\beta \in \R^p$ in a…

Statistics Theory · Mathematics 2010-02-11 Shuheng Zhou

We consider sparsity-based techniques for the approximation of high-dimensional functions from random pointwise evaluations. To date, almost all the works published in this field contain some a priori assumptions about the error corrupting…

Numerical Analysis · Mathematics 2019-05-10 Ben Adcock , Anyi Bao , Simone Brugiapaglia

Sorted $\ell_1$ Penalized Estimator (SLOPE) is a relatively new convex regularization method for fitting high-dimensional regression models. SLOPE allows to reduce the model dimension by shrinking some estimates of the regression…

Statistics Theory · Mathematics 2022-06-17 Tomasz Skalski , Piotr Graczyk , Bartosz Kołodziejek , Maciej Wilczyński

Basis Pursuit (BP), Basis Pursuit DeNoising (BPDN), and LASSO are popular methods for identifying important predictors in the high-dimensional linear regression model, i.e. when the number of rows of the design matrix X is smaller than the…

Methodology · Statistics 2021-09-01 Patrick J. C. Tardivel , Malgorzata Bogdan

We consider the problem of recovering an unknown effectively $(s_1,s_2)$-sparse low-rank-$R$ matrix $X$ with possibly non-orthogonal rank-$1$ decomposition from incomplete and inaccurate linear measurements of the form $y = \mathcal A (X) +…

Numerical Analysis · Mathematics 2020-07-29 Massimo Fornasier , Johannes Maly , Valeriya Naumova

Large-scale generalized linear array models (GLAMs) can be challenging to fit. Computation and storage of its tensor product design matrix can be impossible due to time and memory constraints, and previously considered design matrix free…

Computation · Statistics 2016-09-05 Adam Lund , Martin Vincent , Niels Richard Hansen

Inspired by several real-life applications in audio processing and medical image analysis, where the quantity of interest is generated by several sources to be accurately modeled and separated, as well as by recent advances in…

Numerical Analysis · Mathematics 2016-09-21 Markus Grasmair , Valeriya Naumova

We consider model selection and estimation for partial spline models and propose a new regularization method in the context of smoothing splines. The regularization method has a simple yet elegant form, consisting of roughness penalty on…

Methodology · Statistics 2013-11-25 Guang Cheng , Hao Helen Zhang , Zuofeng Shang

We propose a new penalty, the springback penalty, for constructing models to recover an unknown signal from incomplete and inaccurate measurements. Mathematically, the springback penalty is a weakly convex function. It bears various…

Numerical Analysis · Mathematics 2022-08-22 Congpei An , Hao-Ning Wu , Xiaoming Yuan

Using the $\ell_1$-norm to regularize the estimation of the parameter vector of a linear model leads to an unstable estimator when covariates are highly correlated. In this paper, we introduce a new penalty function which takes into account…

Machine Learning · Computer Science 2011-09-14 Edouard Grave , Guillaume Obozinski , Francis Bach

We study the problem of learning a sparse linear regression vector under additional conditions on the structure of its sparsity pattern. This problem is relevant in machine learning, statistics and signal processing. It is well known that a…

Machine Learning · Statistics 2015-03-17 Charles A. Micchelli , Jean M. Morales , Massimiliano Pontil

The problems of Lasso regression and optimal design of experiments share a critical property: their optimal solutions are typically \emph{sparse}, i.e., only a small fraction of the optimal variables are non-zero. Therefore, the…

Methodology · Statistics 2023-12-07 Guillaume Sagnol , Luc Pronzato

We propose a new framework -- Square Root Principal Component Pursuit -- for low-rank matrix recovery from observations corrupted with noise and outliers. Inspired by the square root Lasso, this new formulation does not require prior…

Machine Learning · Computer Science 2021-11-01 Junhui Zhang , Jingkai Yan , John Wright

We proposed a new penalized method in this paper to solve sparse Poisson Regression problems. Being different from $\ell_1$ penalized log-likelihood estimation, our new method can be viewed as penalized weighted score function method. We…

Statistics Theory · Mathematics 2017-03-14 Jinzhu Jia , Fang Xie , Lihu Xu