English
Related papers

Related papers: Ill-posed Estimation in High-Dimensional Models wi…

200 papers

Penalized regression methods, most notably the lasso, are a popular approach to analyzing high-dimensional data. An attractive property of the lasso is that it naturally performs variable selection. An important area of concern, however, is…

Methodology · Statistics 2026-05-13 Ryan Miller , Patrick Breheny

A multiple interval-valued linear regression model considering all the cross-relationships between the mids and spreads of the intervals has been introduced recently. A least-squares estimation of the regression parameters has been carried…

Statistics Theory · Mathematics 2016-02-09 Marta García Bárzana , Ana Colubi , Erricos John Kontoghiorghes

We consider a high dimensional linear regression problem where the goal is to efficiently recover an unknown vector $\beta^*$ from $n$ noisy linear observations $Y=X\beta^*+W \in \mathbb{R}^n$, for known $X \in \mathbb{R}^{n \times p}$ and…

Statistics Theory · Mathematics 2018-11-12 David Gamarnik , Ilias Zadik

High-dimensional regression models with regularized sparse estimation are widely applied. For statistical inferences, debiased methods are available about single coefficients or predictions with sparse new covariate vectors (also called…

Statistics Theory · Mathematics 2025-07-16 Libin Liang , Zhiqiang Tan

Censored data are quite common in statistics and have been studied in depth in the last years. In this paper we consider censored high-dimensional data. High-dimensional models are in some way more complex than their low-dimensional…

Statistics Theory · Mathematics 2014-05-06 Patric Müller , Sara van de Geer

We propose a pointwise inference algorithm for high-dimensional linear models with time-varying coefficients. The method is based on a novel combination of the nonparametric kernel smoothing technique and a Lasso bias-corrected ridge…

Methodology · Statistics 2017-03-17 Xiaohui Chen , Yifeng He

Recently emerging large-scale biomedical data pose exciting opportunities for scientific discoveries. However, the ultrahigh dimensionality and non-negligible measurement errors in the data may create difficulties in estimation. There are…

Methodology · Statistics 2022-10-28 Xin Ma , Suprateek Kundu

We discuss the fundamental issue of identification in linear instrumental variable (IV) models with unknown IV validity. With the assumption of the "sparsest rule", which is equivalent to the plurality rule but becomes operational in…

Methodology · Statistics 2023-12-06 Yiqi Lin , Frank Windmeijer , Xinyuan Song , Qingliang Fan

In observational studies, instrumental variable (IV) methods are commonly applied when there exists some unmeasured covariates. In Mendelian Randomization (MR), constructing an allele score by using many single nucleotide polymorphisms…

Methodology · Statistics 2022-08-22 Shunichiro Orihara

Suppose that we observe $y \in \mathbb{R}^n$ and $X \in \mathbb{R}^{n \times m}$ in the following errors-in-variables model: \begin{eqnarray*} y & = & X_0 \beta^* +\epsilon \\ X & = & X_0 + W, \end{eqnarray*} where $X_0$ is an $n \times m$…

Machine Learning · Statistics 2017-04-04 Mark Rudelson , Shuheng Zhou

To perform regression analysis in high dimensions, lasso or ridge estimation are a common choice. However, it has been shown that these methods are not robust to outliers. Therefore, alternatives as penalized M-estimation or the sparse…

Statistics Theory · Mathematics 2025-02-03 Viktoria Öllerer , Christophe Croux , Andreas Alfons

LASSO inflicts shrinkage bias on estimated coefficients, which undermines asymptotic normality and invalidates standard inferential procedures based on the t-statistic. Given cross sectional data, the desparsified LASSO has emerged as a…

Methodology · Statistics 2026-04-21 Zhan Gao , Ji Hyung Lee , Ziwei Mei , Zhentao Shi

In this paper, we develop a novel high-dimensional coefficient estimation procedure based on high-frequency data. Unlike usual high-dimensional regression procedures such as LASSO, we additionally handle the heavy-tailedness of…

Methodology · Statistics 2025-10-22 Minseok Shin , Donggyu Kim

We propose an $\ell_1$-penalized estimator for high-dimensional models of Expected Shortfall (ES). The estimator is obtained as the solution to a least-squares problem for an auxiliary dependent variable, which is defined as a…

Econometrics · Economics 2024-01-25 Sander Barendse

The Lasso is a method for high-dimensional regression, which is now commonly used when the number of covariates $p$ is of the same order or larger than the number of observations $n$. Classical asymptotic normality theory does not apply to…

Statistics Theory · Mathematics 2023-09-20 Michael Celentano , Andrea Montanari , Yuting Wei

For the problem of high-dimensional sparse linear regression, it is known that an $\ell_0$-based estimator can achieve a $1/n$ "fast" rate on the prediction error without any conditions on the design matrix, whereas in absence of…

Statistics Theory · Mathematics 2015-12-01 Yuchen Zhang , Martin J. Wainwright , Michael I. Jordan

Instrumental variable methods are widely used for inferring the causal effect in the presence of unmeasured confounders. Existing instrumental variable methods for nonlinear outcome models require stringent identifiability conditions. This…

Methodology · Statistics 2022-07-01 Sai Li , Zijian Guo

This paper proposes a Lasso-type estimator for a high-dimensional sparse parameter identified by a single index conditional moment restriction (CMR). In addition to this parameter, the moment function can also depend on a nuisance function,…

Statistics Theory · Mathematics 2021-09-14 Denis Nekipelov , Vira Semenova , Vasilis Syrgkanis

Traditional instrumental variable (IV) estimators face a fundamental constraint: they can only accommodate as many endogenous treatment variables as available instruments. This limitation becomes particularly challenging in settings where…

Machine Learning · Computer Science 2025-06-25 Shiangyi Lin , Hui Lan , Vasilis Syrgkanis

A great deal of interest has recently focused on conducting inference on the parameters in a high-dimensional linear model. In this paper, we consider a simple and very na\"{i}ve two-step procedure for this task, in which we (i) fit a lasso…

Methodology · Statistics 2020-07-02 Sen Zhao , Daniela Witten , Ali Shojaie