中文
相关论文

相关论文: The Dantzig selector: Statistical estimation when …

200 篇论文

Let \[Y_j=f_*(X_j)+\xi_j,\qquad j=1,...,n,\] where $X,X_1,...,X_n$ are i.i.d. random variables in a measurable space $(S,\mathcal{A})$ with distribution $\Pi$ and $\xi,\xi_1,... ,\xi_n$ are i.i.d. random variables with ${\mathbb{E}}\xi=0$…

统计理论 · 数学 2009-09-07 Vladimir Koltchinskii

We consider a class of linear-programming based estimators in reconstructing a sparse signal from linear measurements. Specific formulations of the reconstruction problem considered here include Dantzig selector, basis pursuit (for the case…

统计计算 · 统计学 2019-08-20 Rahul Mazumder , Stephen Wright , Andrew Zheng

We consider a high dimensional linear regression problem where the goal is to efficiently recover an unknown vector $\beta^*$ from $n$ noisy linear observations $Y=X\beta^*+W \in \mathbb{R}^n$, for known $X \in \mathbb{R}^{n \times p}$ and…

统计理论 · 数学 2018-11-12 David Gamarnik , Ilias Zadik

Given $n$ noisy samples with $p$ dimensions, where $n \ll p$, we show that the multi-step thresholding procedure based on the Lasso -- we call it the {\it Thresholded Lasso}, can accurately estimate a sparse vector $\beta \in \R^p$ in a…

统计理论 · 数学 2010-02-11 Shuheng Zhou

We consider the linear regression model with observation error in the design. In this setting, we allow the number of covariates to be much larger than the sample size. Several new estimation methods have been recently introduced for this…

统计理论 · 数学 2016-07-05 Alexandre Belloni , Mathieu Rosenbaum , Alexandre Tsybakov

We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the…

统计方法学 · 统计学 2019-09-09 Alexandre Belloni , Abhishek Kaul , Mathieu Rosenbaum

In classical statistics and distribution testing, it is often assumed that elements can be sampled from some distribution $P$, and that when an element $x$ is sampled, the probability $P$ of sampling $x$ is also known. Recent work in…

数据结构与算法 · 计算机科学 2022-08-03 Talya Eden , Jakob Bæk Tejs Houen , Shyam Narayanan , Will Rosenbaum , Jakub Tětek

In this paper, we study a simple iterative method for finding the Dantzig selector, which was designed for linear regression problems. The method consists of two main stages. The first stage is to approximate the Dantzig selector through a…

数值分析 · 数学 2015-02-20 Ashley Prater , Lixin Shen , Bruce W. Suter

Suppose that we observe $y \in \mathbb{R}^f$ and $X \in \mathbb{R}^{f \times m}$ in the following errors-in-variables model: \begin{eqnarray*} y & = & X_0 \beta^* + \epsilon \\ X & = & X_0 + W \end{eqnarray*} where $X_0$ is a $f \times m$…

统计理论 · 数学 2015-12-21 Mark Rudelson , Shuheng Zhou

In this paper, a linear model of diffusion processes with unknown drift and diagonal diffusion matrices is discussed. We will consider the estimation problems for unknown parameters based on the discrete time observation in high-dimensional…

统计理论 · 数学 2017-09-05 Kou Fujimori

In many applications one may acquire a composition of several signals that may be corrupted by noise, and it is a challenging problem to reliably separate the components from one another without sacrificing significant details. Adding to…

数值分析 · 数学 2015-01-21 Ashley Prater , Lixin Shen

Here we present an expository, general analysis of valid post-selection or post-regularization inference about a low-dimensional target parameter, $\alpha$, in the presence of a very high-dimensional nuisance parameter, $\eta$, which is…

统计理论 · 数学 2017-10-03 Victor Chernozhukov , Christian Hansen , Martin Spindler

This article introduces a subbagging (subsample aggregating) approach for variable selection in regression within the context of big data. The proposed subbagging approach not only ensures that variable selection is scalable given the…

统计方法学 · 统计学 2025-03-10 Xian Li , Xuan Liang , Tao Zou

We consider learning high-dimensional multi-response linear models with structured parameters. By exploiting the noise correlations among responses, we propose an alternating estimation (AltEst) procedure to estimate the model parameters…

机器学习 · 统计学 2016-06-30 Sheng Chen , Arindam Banerjee

We study parameter estimation and asymptotic inference for sparse nonlinear regression. More specifically, we assume the data are given by $y = f( x^\top \beta^* ) + \epsilon$, where $f$ is nonlinear. To recover $\beta^*$, we propose an…

机器学习 · 统计学 2015-11-17 Zhuoran Yang , Zhaoran Wang , Han Liu , Yonina C. Eldar , Tong Zhang

In this paper, we consider statistical inference with generalized linear models in high dimensions under a longitudinal clustered data framework. Specifically, we propose a de-sparsified version of an initial Dantzig-type regularized…

统计方法学 · 统计学 2025-08-13 Nathan Huey

Causal inference is known to be very challenging when only observational data are available. Randomized experiments are often costly and impractical and in instrumental variable regression the number of instruments has to exceed the number…

统计方法学 · 统计学 2018-06-19 Dominik Rothenhäusler , Peter Bühlmann , Nicolai Meinshausen

We study linear subset regression in the context of the high-dimensional overall model $y = \vartheta+\theta' z + \epsilon$ with univariate response $y$ and a $d$-vector of random regressors $z$, independent of $\epsilon$. Here,…

统计理论 · 数学 2019-02-13 Hannes Leeb , Lukas Steinberger

We propose a novel high-dimensional linear regression estimator: the Discrete Dantzig Selector, which minimizes the number of nonzero regression coefficients subject to a budget on the maximal absolute correlation between the features and…

统计方法学 · 统计学 2017-01-20 Rahul Mazumder , Peter Radchenko

Although a majority of the theoretical literature in high-dimensional statistics has focused on settings which involve fully-observed data, settings with missing values and corruptions are common in practice. We consider the problems of…

机器学习 · 统计学 2017-11-06 Yining Wang , Jialei Wang , Sivaraman Balakrishnan , Aarti Singh