English
Related papers

Related papers: Simultaneous analysis of Lasso and Dantzig selecto…

200 papers

The Dantzig selector (Candes and Tao, 2007) is a popular l1-regularization method for variable selection and estimation in linear regression. We present a very weak geometric condition on the observed predictors which is related to…

Statistics Theory · Mathematics 2012-06-06 Lee Dicker , Xihong Lin

We consider a high-dimensional regression model with a possible change-point due to a covariate threshold and develop the Lasso estimator of regression coefficients as well as the threshold parameter. Our Lasso estimator not only selects…

Statistics Theory · Mathematics 2019-08-23 Sokbae Lee , Myung Hwan Seo , Youngki Shin

We consider high-dimensional generalized linear models with Lipschitz loss functions, and prove a nonasymptotic oracle inequality for the empirical risk minimizer with Lasso penalty. The penalty is based on the coefficients in the linear…

Statistics Theory · Mathematics 2008-12-18 Sara A. van de Geer

We propose a generalized version of the Dantzig selector. We show that it satisfies sparsity oracle inequalities in prediction and estimation. We consider then the particular case of high-dimensional linear regression model selection with…

Statistics Theory · Mathematics 2008-11-17 Karim Lounici

We consider the linear regression problem, where the number $p$ of covariates is possibly larger than the number $n$ of observations $(x_{i},y_{i})_{i\leq i \leq n}$, under sparsity assumptions. On the one hand, several methods have been…

Statistics Theory · Mathematics 2009-06-08 Pierre Alquier , Mohamed Hebiri

The abundance of high-dimensional data in the modern sciences has generated tremendous interest in penalized estimators such as the lasso, scaled lasso, square-root lasso, elastic net, and many others. In this paper, we establish a general…

Statistics Theory · Mathematics 2018-03-14 Johannes Lederer , Lu Yu , Irina Gaynanova

We consider the theory for the high-dimensional generalized linear model with the Lasso. After a short review on theoretical results in literature, we present an extension of the oracle results to the case of quasi-likelihood loss. We prove…

Statistics Theory · Mathematics 2013-01-07 Sara van de Geer , Patric Müller

We consider the sparse regression model where the number of parameters $p$ is larger than the sample size $n$. The difficulty when considering high-dimensional problems is to propose estimators achieving a good compromise between…

Statistics Theory · Mathematics 2011-03-15 Pierre Alquier , Karim Lounici

Lasso and Dantzig selector are standard procedures able to perform variable selection and estimation simultaneously. This paper is concerned with extending these procedures to spatial point process intensity estimation. We propose adaptive…

Methodology · Statistics 2022-05-24 Achmad Choiruddin , Jean-François Coeurjolly , Frédérique Letué

In many problems involving generalized linear models, the covariates are subject to measurement error. When the number of covariates p exceeds the sample size n, regularized methods like the lasso or Dantzig selector are required. Several…

Methodology · Statistics 2018-01-23 Øystein Sørensen , Arnoldo Frigessi , Magne Thoresen

For consistency (even oracle properties) of estimation and model prediction, almost all existing methods of variable/feature selection critically depend on sparsity of models. However, for ``large $p$ and small $n$" models sparsity…

Methodology · Statistics 2010-08-10 Lu Lin , Lixing Zhu , Yujie Gai

We show that two polynomial time methods, a Lasso estimator with adaptively chosen tuning parameter and a Slope estimator, adaptively achieve the exact minimax prediction and $\ell_2$ estimation rate $(s/n)\log (p/s)$ in high-dimensional…

Statistics Theory · Mathematics 2017-05-26 Pierre C. Bellec , Guillaume Lecué , Alexandre B. Tsybakov

We focus on the high dimensional linear regression $Y\sim\mathcal{N}(X\beta^{*},\sigma^{2}I_{n})$, where $\beta^{*}\in\mathds{R}^{p}$ is the parameter of interest. In this setting, several estimators such as the LASSO and the Dantzig…

Statistics Theory · Mathematics 2011-07-06 Pierre Alquier , Mohamed Hebiri

The Lasso has attracted the attention of many authors these last years. While many efforts have been made to prove that the Lasso behaves like a variable selection procedure at the price of strong (though unavoidable) assumptions on the…

Statistics Theory · Mathematics 2010-08-31 Pascal Massart , Caroline Meynet

The Lasso is a computationally efficient regression regularization procedure that can produce sparse estimators when the number of predictors (p) is large. Oracle inequalities provide probability loss bounds for the Lasso estimator at a…

Machine Learning · Statistics 2017-07-21 Cheryl J. Flynn , Clifford M. Hurvich , Jeffrey S. Simonoff

The paper considers a linear regression model with multiple change-points occurring at unknown times. The LASSO technique is very interesting since it allows the parametric estimation, including the change-points, and automatic variable…

Statistics Theory · Mathematics 2012-04-19 Gabriela Ciuperca

We study high-dimensional linear models and the $\ell_1$-penalized least squares estimator, also known as the Lasso estimator. In literature, oracle inequalities have been derived under restricted eigenvalue or compatibility conditions. In…

Methodology · Statistics 2011-07-04 Sara van de Geer , Johannes Lederer

In this paper we revisit the risk bounds of the lasso estimator in the context of transductive and semi-supervised learning. In other terms, the setting under consideration is that of regression with random design under partial labeling.…

Statistics Theory · Mathematics 2016-11-09 Pierre C. Bellec , Arnak S. Dalalyan , Edwin Grappin , Quentin Paris

We consider a general high-dimensional additive hazard model in a non-asymptotic setting, including regression for censored-data. In this context, we consider a Lasso estimator with a fully data-driven $\ell_1$ penalization, which is tuned…

Statistics Theory · Mathematics 2012-03-06 Séphane Gaïffas , Agathe Guilloux

We propose a general family of algorithms for regression estimation with quadratic loss. Our algorithms are able to select relevant functions into a large dictionary. We prove that a lot of algorithms that have already been studied for this…

Statistics Theory · Mathematics 2008-11-25 Pierre Alquier
‹ Prev 1 2 3 10 Next ›