English
Related papers

Related papers: Chi-square and normal inference in high-dimensiona…

200 papers

Multi-task learning is frequently used to model a set of related response variables from the same set of features, improving predictive performance and modeling accuracy relative to methods that handle each response variable separately.…

Methodology · Statistics 2023-08-11 Snigdha Panigrahi , Natasha Stewart , Chandra Sekhar Sripada , Elizaveta Levina

This article considers algorithmic and statistical aspects of linear regression when the correspondence between the covariates and the responses is unknown. First, a fully polynomial-time approximation scheme is given for the natural least…

Machine Learning · Computer Science 2017-11-09 Daniel Hsu , Kevin Shi , Xiaorui Sun

In this paper, we propose an abstract procedure for debiasing constrained or regularized potentially high-dimensional linear models. It is elementary to show that the proposed procedure can produce $\frac{1}{\sqrt{n}}$-confidence intervals…

Methodology · Statistics 2023-01-12 Yufei Yi , Matey Neykov

Completely randomized experiment is the gold standard for causal inference. When the covariate information for each experimental candidate is available, one typical way is to include them in covariate adjustments for more accurate treatment…

Methodology · Statistics 2025-06-10 Xin Lu , Fan Yang , Yuhao Wang

This paper develops an approach to inference in a linear regression model when the number of potential explanatory variables is larger than the sample size. The approach treats each regression coefficient in turn as the interest parameter,…

Methodology · Statistics 2022-11-14 Heather S. Battey , Nancy Reid

We consider high-dimensional inference for potentially misspecified Cox proportional hazard models based on low dimensional results by Lin and Wei [1989]. A de-sparsified Lasso estimator is proposed based on the log partial likelihood…

Statistics Theory · Mathematics 2018-11-02 Shengchun Kong , Zhuqing Yu , Xianyang Zhang , Guang Cheng

A key quantity of interest in Bayesian inference are expectations of functions with respect to a posterior distribution. Markov Chain Monte Carlo is a fundamental tool to consistently compute these expectations via averaging samples drawn…

Machine Learning · Statistics 2015-02-10 Heiko Strathmann , Dino Sejdinovic , Mark Girolami

The Lasso is a method for high-dimensional regression, which is now commonly used when the number of covariates $p$ is of the same order or larger than the number of observations $n$. Classical asymptotic normality theory does not apply to…

Statistics Theory · Mathematics 2023-09-20 Michael Celentano , Andrea Montanari , Yuting Wei

We develop new econometric methods for estimation and inference in high-dimensional panel data models with interactive fixed effects. Our approach can be regarded as a non-trivial extension of the very popular common correlated effects…

Econometrics · Economics 2025-08-11 Maximilian Ruecker , Michael Vogt , Oliver Linton , Christopher Walsh

High-dimensional inference refers to problems of statistical estimation in which the ambient dimension of the data may be comparable to or possibly even larger than the sample size. We study an instance of high-dimensional inference in…

Statistics Theory · Mathematics 2009-12-31 Sahand Negahban , Martin J. Wainwright

Deep neural networks have achieved tremendous success due to their representation power and adaptation to low-dimensional structures. Their potential for estimating structured regression functions has been recently established in the…

Statistics Theory · Mathematics 2023-02-14 Sohom Bhattacharya , Jianqing Fan , Debarghya Mukherjee

Suppose that we observe entries or, more generally, linear combinations of entries of an unknown $m\times T$-matrix $A$ corrupted by noise. We are particularly interested in the high-dimensional setting where the number $mT$ of unknown…

Statistics Theory · Mathematics 2011-05-16 Angelika Rohde , Alexandre B. Tsybakov

In the framework of censored data modeling, the classical linear regression model that assumes normally distributed random errors has received increasing attention in recent years, mainly for mathematical and computational convenience.…

Methodology · Statistics 2020-11-17 Mehrdad Naderi , Elham Mirfarah , Matthew Bernhardt , Ding-Geng Chen

Gaussian graphical regression is a powerful means that regresses the precision matrix of a Gaussian graphical model on covariates, permitting the numbers of the response variables and covariates to far exceed the sample size. Model fitting…

Methodology · Statistics 2022-05-24 Jingfei Zhang , Yi Li

To perform regression analysis in high dimensions, lasso or ridge estimation are a common choice. However, it has been shown that these methods are not robust to outliers. Therefore, alternatives as penalized M-estimation or the sparse…

Statistics Theory · Mathematics 2025-02-03 Viktoria Öllerer , Christophe Croux , Andreas Alfons

Reliable predictive uncertainty estimation plays an important role in enabling the deployment of neural networks to safety-critical settings. A popular approach for estimating the predictive uncertainty of neural networks is to define a…

Machine Learning · Statistics 2023-12-29 Tim G. J. Rudner , Zonghao Chen , Yee Whye Teh , Yarin Gal

Consider the problem of nonparametric estimation of an unknown $\beta$-H\"older smooth density $p_{XY}$ at a given point, where $X$ and $Y$ are both $d$ dimensional. An infinite sequence of i.i.d.\ samples $(X_i,Y_i)$ are generated…

Information Theory · Computer Science 2023-08-29 Jingbo Liu

Large-scale regression problems where both the number of variables, $p$, and the number of observations, $n$, may be large and in the order of millions or more, are becoming increasingly more common. Typically the data are sparse: only a…

Statistics Theory · Mathematics 2018-02-27 Rajen D. Shah , Nicolai Meinshausen

A key problem in the theory of meta-learning is to understand how the task distributions influence transfer risk, the expected error of a meta-learner on a new task drawn from the unknown task distribution. In this paper, focusing on fixed…

Machine Learning · Statistics 2021-06-15 Mikhail Konobeev , Ilja Kuzborskij , Csaba Szepesvári

Data transformations are essential for broad applicability of parametric regression models. However, for Bayesian analysis, joint inference of the transformation and model parameters typically involves restrictive parametric transformations…

Methodology · Statistics 2024-08-29 Daniel R. Kowal , Bohan Wu