English
Related papers

Related papers: High-dimensional stochastic optimization with the …

200 papers

The Dantzig selector has received popularity for many applications such as compressed sensing and sparse modeling, thanks to its computational efficiency as a linear programming problem and its nice sampling properties. Existing results…

Methodology · Statistics 2016-05-12 Yinfei Kong , Zemin Zheng , Jinchi Lv

In this paper we present new theoretical results for the Dantzig and Lasso estimators of the drift in a high dimensional Ornstein-Uhlenbeck model under sparsity constraints. Our focus is on oracle inequalities for both estimators and error…

Statistics Theory · Mathematics 2020-08-04 Gabriela Ciolek , Dmytro Marushkevych , Mark Podolskij

In this paper, we consider statistical inference with generalized linear models in high dimensions under a longitudinal clustered data framework. Specifically, we propose a de-sparsified version of an initial Dantzig-type regularized…

Methodology · Statistics 2025-08-13 Nathan Huey

This paper studies a Dantzig-selector type regularized estimator for linear functionals of high-dimensional linear processes. Explicit rates of convergence of the proposed estimator are obtained and they cover the broad regime from i.i.d.…

Statistics Theory · Mathematics 2016-11-23 Xiaohui Chen , Mengyu Xu , Wei Biao Wu

For consistency (even oracle properties) of estimation and model prediction, almost all existing methods of variable/feature selection critically depend on sparsity of models. However, for ``large $p$ and small $n$" models sparsity…

Methodology · Statistics 2010-08-10 Lu Lin , Lixing Zhu , Yujie Gai

Transductive methods are useful in prediction problems when the training dataset is composed of a large number of unlabeled observations and a smaller number of labeled observations. In this paper, we propose an approach for developing…

Statistics Theory · Mathematics 2010-06-16 Pierre Alquier , Mohamed Hebiri

We exhibit an approximate equivalence between the Lasso estimator and Dantzig selector. For both methods we derive parallel oracle inequalities for the prediction risk in the general nonparametric regression model, as well as bounds on the…

Statistics Theory · Mathematics 2010-11-10 Peter J. Bickel , Ya'acov Ritov , Alexandre B. Tsybakov

In this paper we are concerned with fully automatic and locally adaptive estimation of functions in a "signal + noise"-model where the regression function may additionally be blurred by a linear operator, e.g. by a convolution. To this end,…

Applications · Statistics 2015-03-17 Klaus Frick , Philipp Marnitz , Axel Munk

We derive the $l_{\infty}$ convergence rate simultaneously for Lasso and Dantzig estimators in a high-dimensional linear regression model under a mutual coherence assumption on the Gram matrix of the design and two different assumptions on…

Statistics Theory · Mathematics 2008-02-12 Karim Lounici

We focus on the high dimensional linear regression $Y\sim\mathcal{N}(X\beta^{*},\sigma^{2}I_{n})$, where $\beta^{*}\in\mathds{R}^{p}$ is the parameter of interest. In this setting, several estimators such as the LASSO and the Dantzig…

Statistics Theory · Mathematics 2011-07-06 Pierre Alquier , Mohamed Hebiri

We consider the sparse estimation for stochastic processes with possibly infinite-dimensional nuisance parameters, by using the Dantzig selector which is a sparse estimation method similar to $Z$-estimation. When a consistent estimator for…

Statistics Theory · Mathematics 2026-02-24 Kou Fujimori , Koji Tsukuda

We consider new formulations and methods for sparse quantile regression in the high-dimensional setting. Quantile regression plays an important role in many applications, including outlier-robust exploratory analysis in gene selection. In…

Machine Learning · Statistics 2014-02-20 Aleksandr Y. Aravkin , Anju Kambadur , Aurelie C. Lozano , Ronny Luss

We consider a class of linear-programming based estimators in reconstructing a sparse signal from linear measurements. Specific formulations of the reconstruction problem considered here include Dantzig selector, basis pursuit (for the case…

Computation · Statistics 2019-08-20 Rahul Mazumder , Stephen Wright , Andrew Zheng

This paper deals with the proportional hazards model proposed by D. R. Cox in a high-dimensional and sparse setting for a regression parameter. To estimate the regression parameter, the Dantzig selector is applied. The variable selection…

Statistics Theory · Mathematics 2017-10-31 Kou Fujimori

This paper deals with the problem of density estimation. We aim at building an estimate of an unknown density as a linear combination of functions of a dictionary. Inspired by Cand\`es and Tao's approach, we propose an $\ell_1$-minimization…

Statistics Theory · Mathematics 2009-05-07 Karine Bertin , Erwan Le Pennec , Vincent Rivoirard

We consider high-dimensional generalized linear models with Lipschitz loss functions, and prove a nonasymptotic oracle inequality for the empirical risk minimizer with Lasso penalty. The penalty is based on the coefficients in the linear…

Statistics Theory · Mathematics 2008-12-18 Sara A. van de Geer

Popular sparse estimation methods based on $\ell_1$-relaxation, such as the Lasso and the Dantzig selector, require the knowledge of the variance of the noise in order to properly tune the regularization parameter. This constitutes a major…

Machine Learning · Statistics 2013-04-17 Arnak S. Dalalyan , Mohamed Hebiri , Katia Méziani , Joseph Salmon

The estimation of a sparse vector in the linear model is a fundamental problem in signal processing, statistics, and compressive sensing. This paper establishes a lower bound on the mean-squared error, which holds regardless of the…

Information Theory · Computer Science 2013-03-04 Emmanuel J. Candès , Mark A. Davenport

We consider the linear regression problem, where the number $p$ of covariates is possibly larger than the number $n$ of observations $(x_{i},y_{i})_{i\leq i \leq n}$, under sparsity assumptions. On the one hand, several methods have been…

Statistics Theory · Mathematics 2009-06-08 Pierre Alquier , Mohamed Hebiri

To successfully work on variable selection, sparse model structure has become a basic assumption for all existing methods. However, this assumption is questionable as it is hard to hold in most of cases and none of existing methods may…

Methodology · Statistics 2011-12-06 Lu Lin , Lixing Zhu , Yujie Gai
‹ Prev 1 2 3 10 Next ›