中文
相关论文

相关论文: High-Dimensional Data with Measurement Error

200 篇论文

An inference procedure is proposed to provide consistent estimators of parameters in a modal regression model with a covariate prone to measurement error. A score-based diagnostic tool exploiting parametric bootstrap is developed to assess…

统计方法学 · 统计学 2024-07-02 Qingyang Liu , Xianzheng Huang

This paper explores the following question: what kind of statistical guarantees can be given when doing variable selection in high-dimensional models? In particular, we look at the error rates and power of some multi-stage regression…

统计理论 · 数学 2009-08-20 Larry Wasserman , Kathryn Roeder

Data subject to heavy-tailed errors are commonly encountered in various scientific fields, especially in the modern era with explosion of massive data. To address this problem, procedures based on quantile regression and Least Absolute…

统计理论 · 数学 2014-10-09 Jianqing Fan , Quefeng Li , Yuyan Wang

Consider estimation of average treatment effects with multi-valued treatments using augmented inverse probability weighted (IPW) estimators, depending on outcome regression and propensity score models in high-dimensional settings. These…

统计方法学 · 统计学 2022-01-25 Wenfu Xu , Zhiqiang Tan

It is a standard assumption that datasets in high dimension have an internal structure which means that they in fact lie on, or near, subsets of a lower dimension. In many instances it is important to understand the real dimension of the…

机器学习 · 统计学 2025-07-21 James A. D. Binnie , Paweł Dłotko , John Harvey , Jakub Malinowski , Ka Man Yim

Random feature ridge regression is often analyzed in the high-dimensional regime under the homogeneous sampling model $x_i=\Sigma^{1/2}x_i'$, where the vectors $x_i'$ have iid entries and the same covariance matrix $\Sigma$ is shared by all…

机器学习 · 统计学 2026-05-19 Issa-Mbenard Dabo , Jérémie Bigot

While shrinkage is essential in high-dimensional settings, its use for low-dimensional regression-based prediction has been debated. It reduces variance, often leading to improved prediction accuracy. However, it also inevitably introduces…

High-dimensional big data appears in many research fields such as image recognition, biology and collaborative filtering. Often, the exploration of such data by classic algorithms is encountered with difficulties due to `curse of…

机器学习 · 计算机科学 2016-07-13 Amit Bermanis , Aviv Rotbart , Moshe Salhov , Amir Averbuch

This article provides, through theoretical analysis, an in-depth understanding of the classification performance of the empirical risk minimization framework, in both ridge-regularized and unregularized cases, when high dimensional data are…

机器学习 · 统计学 2020-11-26 Xiaoyi Mai , Zhenyu Liao

Despite its prevalence in statistical datasets, heteroscedasticity (non-constant sample variances) has been largely ignored in the high-dimensional statistics literature. Recently, studies have shown that the Lasso can accommodate…

统计理论 · 数学 2014-10-31 James Sharpnack , Mladen Kolar

In microbiome and genomic studies, the regression of compositional data has been a crucial tool for identifying microbial taxa or genes that are associated with clinical phenotypes. To account for the variation in sequencing depth, the…

统计方法学 · 统计学 2021-03-11 Pixu Shi , Yuchen Zhou , Anru R. Zhang

In high-dimensional regression, we attempt to estimate a parameter vector $\beta_0\in\mathbb{R}^p$ from $n\lesssim p$ observations $\{(y_i,x_i)\}_{i\leq n}$ where $x_i\in\mathbb{R}^p$ is a vector of predictors and $y_i$ is a response…

统计理论 · 数学 2022-02-08 Michael Celentano , Andrea Montanari

The dependency structure of multivariate data can be analyzed using the covariance matrix $\Sigma$. In many fields the precision matrix $\Sigma^{-1}$ is even more informative. As the sample covariance estimator is singular in…

统计方法学 · 统计学 2015-06-04 Viktoria Öllerer , Christophe Croux

We consider high dimensional $M$-estimation in settings where the response $Y$ is possibly missing at random and the covariates $\mathbf{X} \in \mathbb{R}^p$ can be high dimensional compared to the sample size $n$. The parameter of interest…

统计方法学 · 统计学 2019-11-27 Abhishek Chakrabortty , Jiarui Lu , T. Tony Cai , Hongzhe Li

Penalization schemes like Lasso or ridge regression are routinely used to regress a response of interest on a high-dimensional set of potential predictors. Despite being decisive, the question of the relative strength of penalization is…

统计方法学 · 统计学 2018-11-08 Britta Velten , Wolfgang Huber

High-dimensional predictive models, those with more measurements than observations, require regularization to be well defined, perform well empirically, and possess theoretical guarantees. The amount of regularization, often determined by…

统计方法学 · 统计学 2019-07-16 Darren Homrighausen , Daniel J. McDonald

For high-dimensional linear regression models, we review and compare several estimators of variances $\tau^2$ and $\sigma^2$ of the random slopes and errors, respectively. These variances relate directly to ridge regression penalty…

统计计算 · 统计学 2019-02-08 Jurre R. Veerman , Gwenael G. R. Leday , Mark A. van de Wiel

Penalized regression methods, most notably the lasso, are a popular approach to analyzing high-dimensional data. An attractive property of the lasso is that it naturally performs variable selection. An important area of concern, however, is…

统计方法学 · 统计学 2026-05-13 Ryan Miller , Patrick Breheny

In the high-dimensional landscape, addressing the challenges of covariance regression with high-dimensional covariates has posed difficulties for conventional methodologies. This paper addresses these hurdles by presenting a novel approach…

统计方法学 · 统计学 2024-04-11 Yuheng He , Changliang Zou , Yi Zhao

Expected shortfall is defined as the average over the tail below (or above) a certain quantile of a probability distribution. Expected shortfall regression provides powerful tools for learning the relationship between a response variable…

统计方法学 · 统计学 2025-01-03 Shushu Zhang , Xuming He , Kean Ming Tan , Wen-Xin Zhou