English
Related papers

Related papers: Double-estimation-friendly inference for high-dime…

200 papers

Uncertainty estimation is an essential step in the evaluation of the robustness for deep learning models in computer vision, especially when applied in risk-sensitive areas. However, most state-of-the-art deep learning models either fail to…

Computer Vision and Pattern Recognition · Computer Science 2022-01-12 Lu Mi , Hao Wang , Yonglong Tian , Hao He , Nir Shavit

In this paper we develop inference for high dimensional linear models, with serially correlated errors. We examine Lasso under the assumption of strong mixing in the covariates and error process, allowing for fatter tails in their…

Econometrics · Economics 2023-10-05 Ilias Chronopoulos , Katerina Chrysikou , George Kapetanios

Randomly censored survival data are frequently encountered in applied sciences including biomedical or reliability applications and clinical trial analyses. Testing the significance of statistical hypotheses is crucial in such analyses to…

Methodology · Statistics 2019-01-08 Abhik Ghosh , Ayanendranath Basu , Leandro Pardo

Complex phenomena in engineering and the sciences are often modeled with computationally intensive feed-forward simulations for which a tractable analytic likelihood does not exist. In these cases, it is sometimes necessary to estimate an…

Methodology · Statistics 2020-06-18 Niccolò Dalmasso , Ann B. Lee , Rafael Izbicki , Taylor Pospisil , Ilmun Kim , Chieh-An Lin

We develop a general assumption-lean framework for constructing uniformly valid confidence sets for functionals defined by moment equalities, referred to as $Z$-functionals. Our approach combines self-normalized statistics with a test…

Statistics Theory · Mathematics 2025-07-11 Woonyoung Chang , Arun Kumar Kuchibhotla

Probabilistic models analyze data by relying on a set of assumptions. Data that exhibit deviations from these assumptions can undermine inference and prediction quality. Robust models offer protection against mismatch between a model's…

Machine Learning · Statistics 2018-06-20 Yixin Wang , Alp Kucukelbir , David M. Blei

We consider a general high-dimensional additive hazard model in a non-asymptotic setting, including regression for censored-data. In this context, we consider a Lasso estimator with a fully data-driven $\ell_1$ penalization, which is tuned…

Statistics Theory · Mathematics 2012-03-06 Séphane Gaïffas , Agathe Guilloux

A fundamental assumption underling any Hypothesis Testing (HT) problem is that the available data follow the parametric model assumed to derive the test statistic. Nevertheless, a perfect match between the true and the assumed data models…

Signal Processing · Electrical Eng. & Systems 2017-09-27 S. Fortunati , M. S. Greco , F. Gini

We propose a series-based nonparametric specification test for a regression function when data are spatially dependent, the `space' being of a general economic or social nature. Dependence can be parametric, parametric with increasing…

Econometrics · Economics 2022-08-30 Abhimanyu Gupta , Xi Qu

In the sparse linear regression setting, we consider testing the significance of the predictor variable that enters the current lasso model, in the sequence of models visited along the lasso solution path. We propose a simple test statistic…

Statistics Theory · Mathematics 2014-05-27 Richard Lockhart , Jonathan Taylor , Ryan J. Tibshirani , Robert Tibshirani

In causal inference confounding may be controlled either through regression adjustment in an outcome model, or through propensity score adjustment or inverse probability of treatment weighting, or both. The latter approaches, which are…

Methodology · Statistics 2017-01-17 Olli Saarela , Léo R. Belzile , David A. Stephens

This paper develops new tools to quantify uncertainty in optimal decision making and to gain insight into which variables one should collect information about given the potential cost of measuring a large number of variables. We investigate…

Methodology · Statistics 2021-05-11 Yunan Wu , Lan Wang , Haoda Fu

Adequacy for estimation between an inferential method and a model can be de{\ldots}ned through two main requirements: {\ldots}rstly the inferential tool should de{\ldots}ne a well posed problem when applied to the model; secondly the…

Statistics Theory · Mathematics 2025-07-30 Michel Broniatowski , Justin Moutsouka

In high-dimensional linear models, the sparsity assumption is typically made, stating that most of the parameters are equal to zero. Under the sparsity assumption, estimation and, recently, inference have been well studied. However, in…

Methodology · Statistics 2019-07-09 Yinchu Zhu , Jelena Bradic

Selective inference (post-selection inference) is a methodology that has attracted much attention in recent years in the fields of statistics and machine learning. Naive inference based on data that are also used for model selection tends…

Methodology · Statistics 2021-11-25 Yoshiyuki Ninomiya , Yuta Umezu , Ichiro Takeuchi

Statistical inference for high-dimensional regression heteroskedasticity is an important but under-explored problem. The current paper aims at filling this gap by proposing two tests, namely the variance difference test and the variance…

Methodology · Statistics 2022-12-06 Chi Chien-Ming

Generalized linear models are a popular tool in applied statistics, with their maximum likelihood estimators enjoying asymptotic Gaussianity and efficiency. As all models are wrong, it is desirable to understand these estimators' behaviours…

Methodology · Statistics 2024-12-10 Elliot H. Young , Rajen D. Shah

Motivated by the challenges in analyzing gut microbiome and metagenomic data, this work aims to tackle the issue of measurement errors in high-dimensional regression models that involve compositional covariates. This paper marks a…

Methodology · Statistics 2024-09-13 Huali Zhao , Tianying Wang

Many flexible families of positive random variables exhibit non-closed forms of the density and distribution functions and this feature is considered unappealing for modelling purposes. However, such families are often characterized by a…

Statistics Theory · Mathematics 2025-06-09 Lucio Barabesi , Antonio Di Noia , Marzia Marcheselli , Caterina Pisani , Luca Pratelli

In this paper, we investigate the degrees of freedom ($\dof$) of penalized $\ell_1$ minimization (also known as the Lasso) for linear regression models. We give a closed-form expression of the $\dof$ of the Lasso response. Namely, we show…

Statistics Theory · Mathematics 2012-05-30 Charles Dossal , Maher Kachour , Jalal M. Fadili , Gabriel Peyré , Christophe Chesneau