English
Related papers

Related papers: A projection pursuit framework for testing general…

200 papers

We derive a new class of statistical tests for generalized linear models based on thresholding point estimators. These tests can be employed whether the model includes more parameters than observations or not. For linear models, our tests…

Methodology · Statistics 2018-03-14 Sylvain Sardy , Caroline Giacobino , Jairo Diaz-Rodriguez

The paper concerns inference in the ill-conditioned functional response model, which is a part of functional data analysis. In this regression model, the functional response is modeled using several independent scalar variables. To verify…

Methodology · Statistics 2024-10-07 Łukasz Smaga , Natalia Stefańska

We consider a novel Bayesian approach to estimation, uncertainty quantification, and variable selection for a high-dimensional linear regression model under sparsity. The number of predictors can be nearly exponentially large relative to…

Methodology · Statistics 2025-02-28 Samhita Pal , Subhashis Ghoshal

Inference for the parameters indexing generalised linear models is routinely based on the assumption that the model is correct and a priori specified. This is unsatisfactory because the chosen model is usually the result of a data-adaptive…

Methodology · Statistics 2020-06-16 Stijn Vansteelandt , Oliver Dukes

Approximate inference via information projection has been recently introduced as a general-purpose approach for efficient probabilistic inference given sparse variables. This manuscript goes beyond classical sparsity by proposing efficient…

Machine Learning · Statistics 2016-07-13 Rajiv Khanna , Joydeep Ghosh , Russell Poldrack , Oluwasanmi Koyejo

Rapid advancements in data science require us to have fundamentally new frameworks to tackle prevalent but highly non-trivial "irregular" inference problems, to which the large sample central limit theorem does not apply. Typical examples…

Methodology · Statistics 2026-02-11 Minge Xie , Peng Wang

In this paper, we present a novel and effective inference approach to conduct both finite- and large-sample inference for high-dimensional linear regression models. This approach is developed under the so-called repro samples framework, in…

Methodology · Statistics 2025-12-01 Peng Wang , Min-Ge Xie , Linjun Zhang

In this paper, we study inference for high-dimensional data characterized by small sample sizes relative to the dimension of the data. In particular, we provide an infinite-dimensional framework to study statistical models that involve…

Statistics Theory · Mathematics 2010-02-25 Jim Kuelbs , Anand N. Vidyashankar

Fitting high-dimensional statistical models often requires the use of non-linear parameter estimation procedures. As a consequence, it is generally impossible to obtain an exact characterization of the probability distribution of the…

Methodology · Statistics 2014-04-03 Adel Javanmard , Andrea Montanari

We introduce a general framework for testing goodness-of-fit for Gaussian graphical models in both the low- and high-dimensional settings. This framework is based on a novel algorithm for generating exchangeable copies by conditioning on…

Methodology · Statistics 2025-01-07 Xiaotong Lin , Weihao Li , Fangqiao Tian , Dongming Huang

In recent years, there has been considerable theoretical development regarding variable selection consistency of penalized regression techniques, such as the lasso. However, there has been relatively little work on quantifying the…

Methodology · Statistics 2014-05-21 Arend Voorman , Ali Shojaie , Daniela Witten

Variable selection for high-dimensional, highly correlated data has long been a challenging problem, often yielding unstable and unreliable models. We propose a resample-aggregate framework that exploits diffusion models' ability to…

Methodology · Statistics 2025-08-20 Minjie Wang , Xiaotong Shen , Wei Pan

An important challenge in statistical analysis lies in controlling the bias of estimators due to the ever-increasing data size and model complexity. Approximate numerical methods and data features like censoring and misclassification often…

Statistics Theory · Mathematics 2020-11-17 Stéphane Guerrier , Mucyo Karemera , Samuel Orso , Maria-Pia Victoria-Feser , Yuming Zhang

Ensuring robust model performance in diverse real-world scenarios requires addressing generalizability across domains with covariate shifts. However, no formal procedure exists for statistically evaluating generalizability in machine…

Machine Learning · Computer Science 2025-06-13 Daniel de Vassimon Manela , Linying Yang , Robin J. Evans

Uncertainty estimation aims to evaluate the confidence of a trained deep neural network. However, existing uncertainty estimation approaches rely on low-dimensional distributional assumptions and thus suffer from the high dimensionality of…

Machine Learning · Computer Science 2023-10-26 Tsai Hor Chan , Kin Wai Lau , Jiajun Shen , Guosheng Yin , Lequan Yu

Sparse feature selection is necessary when we fit statistical models, we have access to a large group of features, don't know which are relevant, but assume that most are not. Alternatively, when the number of features is larger than the…

Applications · Statistics 2017-04-04 Emiliano Diaz

For a high-dimensional linear model with a finite number of covariates measured with error, we study statistical inference on the parameters associated with the error-prone covariates, and propose a new corrected decorrelated score test and…

Methodology · Statistics 2020-01-29 Mengyan Li , Runze Li , Yanyuan Ma

We introduce a new framework for dimension reduction in the context of high-dimensional regression. Our proposal is to aggregate an ensemble of random projections, which have been carefully chosen based on the empirical regression…

Methodology · Statistics 2024-10-08 Wenxing Zhou , Timothy I. Cannings

We study high-dimensional two-sample mean comparison and address the curse of dimensionality through data-adaptive projections. Leveraging the low-dimensional and localized signal structures commonly seen in single-cell genomics data, our…

Methodology · Statistics 2025-06-12 Tianyu Zhang , Jing Lei , Kathryn Roeder

Motivated by the prevalence of high dimensional low sample size datasets in modern statistical applications, we propose a general nonparametric framework, Direction-Projection-Permutation (DiProPerm), for testing high dimensional…

Methodology · Statistics 2013-04-04 Susan Wei , Chihoon Lee , Lindsay Wichers , Gen Li , J. S. Marron