中文
相关论文

相关论文: Debiased and threshold ridge regression for linear…

200 篇论文

This paper characterizes the conditional distribution properties of the finite sample ridge regression estimator and uses that result to evaluate total regression and generalization errors that incorporate the inaccuracies committed at the…

机器学习 · 统计学 2016-05-31 Lyudmila Grigoryeva , Juan-Pablo Ortega

We study confidence intervals based on hard-thresholding, soft-thresholding, and adaptive soft-thresholding in a linear regression model where the number of regressors $k$ may depend on and diverge with sample size $n$. In addition to the…

统计理论 · 数学 2018-10-08 Ulrike Schneider

Current statistics literature on statistical inference of random fields typically assumes that the fields are stationary or focuses on models of non-stationary Gaussian fields with parametric/semiparametric covariance families, which may…

统计理论 · 数学 2024-09-04 Yunyi Zhang , Zhou Zhou

Spike-and-slab and horseshoe regression are arguably the most popular Bayesian variable selection approaches for linear regression models. However, their performance can deteriorate if outliers and heteroskedasticity are present in the…

统计方法学 · 统计学 2022-10-20 Alberto Cabezas , Marco Battiston , Christopher Nemeth

Estimating linear regression using least squares and reporting robust standard errors is very common in financial economics, and indeed, much of the social sciences and elsewhere. For thick tailed predictors under heteroskedasticity this…

统计方法学 · 统计学 2020-08-17 Neil Shephard

Although a majority of the theoretical literature in high-dimensional statistics has focused on settings which involve fully-observed data, settings with missing values and corruptions are common in practice. We consider the problems of…

机器学习 · 统计学 2017-11-06 Yining Wang , Jialei Wang , Sivaraman Balakrishnan , Aarti Singh

The debiased estimator is a crucial tool in statistical inference for high-dimensional model parameters. However, constructing such an estimator involves estimating the high-dimensional inverse Hessian matrix, incurring significant…

机器学习 · 统计学 2023-12-18 Jiyuan Tu , Weidong Liu , Xiaojun Mao , Mingyue Xu

We propose two semiparametric versions of the debiased Lasso procedure for the model $Y_i = X_i\beta_0 + g_0(Z_i) + \epsilon_i$, where $\beta_0$ is high dimensional but sparse (exactly or approximately). Both versions are shown to have the…

统计理论 · 数学 2017-08-09 Ying Zhu , Zhuqing Yu , Guang Cheng

High-dimensional penalized rank regression is a powerful tool for modeling high-dimensional data due to its robustness and estimation efficiency. However, the non-smoothness of the rank loss brings great challenges to the computation. To…

统计方法学 · 统计学 2025-02-20 Leheng Cai , Xu Guo , Heng Lian , Liping Zhu

Debiasing is a fundamental concept in high-dimensional statistics. While degrees-of-freedom adjustment is the state-of-the-art technique in high-dimensional linear regression, it is limited to i.i.d. samples and sub-Gaussian covariates.…

统计理论 · 数学 2026-01-01 Yufan Li , Pragya Sur

We consider penalized extremum estimation of a high-dimensional, possibly nonlinear model that is sparse in the sense that most of its parameters are zero but some are not. We use the SCAD penalty function, which provides model selection…

计量经济学 · 经济学 2024-02-23 Joel L. Horowitz , Ahnaf Rafi

This paper deals with the Gaussian and bootstrap approximations to the distribution of the max statistic in high dimensions. This statistic takes the form of the maximum over components of the sum of independent random vectors and its…

统计理论 · 数学 2022-05-31 Victor Chernozhukov , Denis Chetverikov , Kengo Kato , Yuta Koike

Simulator-based models are models for which the likelihood is intractable but simulation of synthetic data is possible. They are often used to describe complex real-world phenomena, and as such can often be misspecified in practice.…

统计方法学 · 统计学 2022-12-20 Charita Dellaporta , Jeremias Knoblauch , Theodoros Damoulas , François-Xavier Briol

Logistic regression is a ubiquitous method for probabilistic classification. However, the effectiveness of logistic regression depends upon careful and relatively computationally expensive tuning, especially for the regularisation…

机器学习 · 计算机科学 2025-04-04 Angus Dempster , Geoffrey I. Webb , Daniel F. Schmidt

This paper is concerned with inference in threshold regression models when the practitioners do not know whether at the threshold point the true specification has a kink or a jump. We nest previous works that assume either continuity or…

统计理论 · 数学 2020-01-15 Javier Hidalgo , Jungyoon Lee , Myung Hwan Seo

This paper studies the Gaussian approximation of high-dimensional and non-degenerate U-statistics of order two under the supremum norm. We propose a two-step Gaussian approximation procedure that does not impose structural assumptions on…

统计理论 · 数学 2016-10-04 Xiaohui Chen

In various statistical settings, the goal is to estimate a function which is restricted by the statistical model only through a conditional moment restriction. Prominent examples include the nonparametric instrumental variable framework for…

统计方法学 · 统计学 2025-05-28 AmirEmad Ghassami , James M. Robins , Andrea Rotnitzky

This paper develops distribution theory and bootstrap-based inference methods for a broad class of convex pairwise difference estimators. These estimators minimize a kernel-weighted convex-in-parameter function over observation pairs with…

计量经济学 · 经济学 2026-05-29 Matias D. Cattaneo , Michael Jansson , Kenichi Nagasawa

This paper concerns the development of an inferential framework for high-dimensional linear mixed effect models. These are suitable models, for instance, when we have $n$ repeated measurements for $M$ subjects. We consider a scenario where…

统计方法学 · 统计学 2019-12-17 Lina Lin , Mathias Drton , Ali Shojaie

Although linear regression models are fundamental tools in statistical science, the estimation results can be sensitive to outliers. While several robust methods have been proposed in frequentist frameworks, statistical inference is not…

统计方法学 · 统计学 2020-07-15 Shintaro Hashimoto , Shonosuke Sugasawa