English
Related papers

Related papers: Asymptotic Confidence Regions for High-dimensional…

200 papers

This tutorial provides an exposition of a flexible geometric framework for high dimensional estimation problems with constraints. The tutorial develops geometric intuition about high dimensional sets, justifies it with some results of…

Statistics Theory · Mathematics 2016-12-23 Roman Vershynin

The use of standard statistical methods, such as maximum likelihood, is often justified based on their asymptotic properties. For suitably regular models, this theory is standard but, when the model is non-regular, e.g., the support depends…

Methodology · Statistics 2016-08-25 Ryan Martin , Yi Lin

We use tools from geometric statistics to analyze the usual estimation procedure of a template shape. This applies to shapes from landmarks, curves, surfaces, images etc. We demonstrate the asymptotic bias of the template shape estimation…

Computer Vision and Pattern Recognition · Computer Science 2017-02-03 Nina Miolane , Susan Holmes , Xavier Pennec

This paper considers the problem of estimating an unknown high dimensional signal from noisy linear measurements, {when} the signal is assumed to possess a \emph{group-sparse} structure in a {known,} fixed dictionary. We consider signals…

Information Theory · Computer Science 2018-05-22 Mojtaba Kadkhodaie Elyaderani , Swayambhoo Jain , Jeffrey Druce , Stefano Gonella , Jarvis Haupt

Covariate-specific treatment effects (CSTEs) represent heterogeneous treatment effects across subpopulations defined by certain selected covariates. In this article, we consider marginal structural models where CSTEs are linearly…

Methodology · Statistics 2021-05-25 Peng Wu , Zhiqiang Tan , Wenjie Hu , Xiao-Hua Zhou

In high-dimensional regression, we attempt to estimate a parameter vector $\beta_0\in\mathbb{R}^p$ from $n\lesssim p$ observations $\{(y_i,x_i)\}_{i\leq n}$ where $x_i\in\mathbb{R}^p$ is a vector of predictors and $y_i$ is a response…

Statistics Theory · Mathematics 2022-02-08 Michael Celentano , Andrea Montanari

In this paper, we study a simple algorithm to construct asymptotically valid confidence regions for model parameters using the batch means method. The main idea is to cancel out the covariance matrix which is hard/costly to estimate. In the…

Machine Learning · Statistics 2020-02-03 Yi Zhu , Jing Dong

In high-dimensional statistical inference in which the number of parameters to be estimated is larger than that of the holding data, regularized linear estimation techniques are widely used. These techniques have, however, some drawbacks.…

Methodology · Statistics 2025-08-06 Takashi Takahashi , Yoshiyuki Kabashima

Recent work in signal processing and statistics have focused on defining new regularization functions, which not only induce sparsity of the solution, but also take into account the structure of the problem. We present in this paper a class…

Machine Learning · Computer Science 2011-10-21 Julien Mairal , Rodolphe Jenatton , Guillaume Obozinski , Francis Bach

Regularization is often used in high-dimensional regression settings to generate a sparse model, which can save tremendous computing resources and identify predictors that are most strongly associated with the response. When the predictors…

Machine Learning · Statistics 2026-05-07 Jia Wei He , R. Ayesha Ali , Gerarda Darlington

Penalized $M-$estimators for logistic regression models have been previously study for fixed dimension in order to obtain sparse statistical models and automatic variable selection. In this paper, we derive asymptotic results for penalized…

Statistics Theory · Mathematics 2023-08-08 Ana M. Bianco , Graciela Boente , Gonzalo Chebi

This paper introduces a new fixed effects estimator for linear panel data models with clustered time patterns of unobserved heterogeneity. The method avoids non-convex and combinatorial optimization by combining a preliminary consistent…

Econometrics · Economics 2025-04-21 Martin Mugnier

We investigate high-dimensional nonconvex penalized regression, where the number of covariates may grow at an exponential rate. Although recent asymptotic theory established that there exists a local minimum possessing the oracle property…

Statistics Theory · Mathematics 2013-11-21 Lan Wang , Yongdai Kim , Runze Li

We propose a new system identification method, called Sign-Perturbed Sums (SPS), for constructing non-asymptotic confidence regions under mild statistical assumptions. SPS is introduced for linear regression models, including but not…

Signal Processing · Electrical Eng. & Systems 2018-07-24 Balázs Cs. Csáji , Marco C. Campi , Erik Weyer

We develop uniformly valid confidence regions for regression coefficients in a high-dimensional sparse median regression model with homoscedastic errors. Our methods are based on a moment equation that is immunized against non-regular…

Statistics Theory · Mathematics 2020-10-20 Alexandre Belloni , Victor Chernozhukov , Kengo Kato

This paper aims to front with dimensionality reduction in regression setting when the predictors are a mixture of functional variable and high-dimensional vector. A flexible model, combining both sparse linear ideas together with…

Statistics Theory · Mathematics 2024-01-29 Silvia Novo , Germán Aneiros , Philippe Vieu

In machine learning and data mining, linear models have been widely used to model the response as parametric linear functions of the predictors. To relax such stringent assumptions made by parametric linear models, additive models consider…

Machine Learning · Statistics 2017-10-18 Sheng Chen , Arindam Banerjee

Inference and prediction under the sparsity assumption have been a hot research topic in recent years. However, in practice, the sparsity assumption is difficult to test, and more importantly can usually be violated. In this paper, to study…

Statistics Theory · Mathematics 2022-10-18 Yanmei Shi , Zhiruo Li , Qi Zhang

We consider a novel Bayesian approach to estimation, uncertainty quantification, and variable selection for a high-dimensional linear regression model under sparsity. The number of predictors can be nearly exponentially large relative to…

Methodology · Statistics 2025-02-28 Samhita Pal , Subhashis Ghoshal

For data segmentation in high-dimensional linear regression settings, the regression parameters are often assumed to be sparse segment-wise, which enables many existing methods to estimate the parameters locally via $\ell_1$-regularised…

Methodology · Statistics 2026-05-08 Haeran Cho , Tobias Kley , Housen Li