English
Related papers

Related papers: Test of Significance for High-dimensional Threshol…

200 papers

We consider the change point testing problem for high-dimensional time series. Unlike conventional approaches, where one tests whether the difference $\delta$ of the mean vectors before and after the change point is equal to zero, we argue…

Statistics Theory · Mathematics 2025-09-01 Pascal Quanz , Holger Dette

Clustering methods have led to a number of important discoveries in bioinformatics and beyond. A major challenge in their use is determining which clusters represent important underlying structure, as opposed to spurious sampling artifacts.…

Methodology · Statistics 2021-10-20 Hanwen Huang , Yufeng Liu , Ming Yuan , J. S. Marron

This paper shows that the problem of testing hypotheses in moment condition models without any assumptions about identification may be considered as a problem of testing with an infinite-dimensional nuisance parameter. We introduce a…

Statistics Theory · Mathematics 2014-09-24 Isaiah Andrews , Anna Mikusheva

The standard paired-sample testing approach in the multidimensional setting applies multiple univariate tests on the individual features, followed by p-value adjustments. Such an approach suffers when the data carry numerous features. A…

Machine Learning · Statistics 2023-09-29 Ioannis Bargiotas , Argyris Kalogeratos , Nicolas Vayatis

In this paper, we consider testing the martingale difference hypothesis for high-dimensional time series. Our test is built on the sum of squares of the element-wise max-norm of the proposed matrix-valued nonlinear dependence measure at…

Econometrics · Economics 2023-11-15 Jinyuan Chang , Qing Jiang , Xiaofeng Shao

When developing a clinical prediction model, the sample size of the development dataset is a key consideration. Small sample sizes lead to greater concerns of overfitting, instability, poor performance and lack of fairness. Previous…

In this work, we consider causal inference in various high-dimensional treatment settings, including for single multi-valued treatments and vector treatments with binary or continuous components, when the number of treatments can be…

Statistics Theory · Mathematics 2026-02-26 Patrick Kramer , Edward H. Kennedy , Isaac M. Opper

There is a well-known problem in Null Hypothesis Significance Testing: many statistically significant results fail to replicate in subsequent experiments. We show that this problem arises because standard `point-form null' significance…

Methodology · Statistics 2025-02-06 Fintan Costello , Paul Watts

In this paper, we study the problem of testing the mean vectors of high dimensional data in both one-sample and two-sample cases. The proposed testing procedures employ maximum-type statistics and the parametric bootstrap techniques to…

Statistics Theory · Mathematics 2018-01-23 Jinyuan Chang , Chao Zheng , Wen-Xin Zhou , Wen Zhou

High-dimensional feature selection is a central problem in a variety of application domains such as machine learning, image analysis, and genomics. In this paper, we propose graph-based tests as a useful basis for feature selection. We…

Methodology · Statistics 2024-08-13 Swarnadip Ghosh , Somabha Mukherjee , Divyansh Agarwal , Yichen He , Mingzhi Song , Xuejiao Pei

We provide an inferential framework to assess variable importance for heterogeneous treatment effects. This assessment is especially useful in high-risk domains such as medicine, where decision makers hesitate to rely on black-box treatment…

Methodology · Statistics 2026-05-11 Pawel Morzywolek , Peter B. Gilbert , Alex Luedtke

Gene expression and phenotype association can be affected by potential unmeasured confounders from multiple sources, leading to biased estimates of the associations. Since genetic variants largely explain gene expression variations, they…

Methodology · Statistics 2019-10-23 Jiarui Lu , Hongzhe Li

Statisticians increasingly face the problem to reconsider the adaptability of classical inference techniques. In particular, divers types of high-dimensional data structures are observed in various research areas; disclosing the boundaries…

Statistics Theory · Mathematics 2017-06-09 Paavo Sattler , Markus Pauly

Statistical inference in high dimensional settings has recently attracted enormous attention within the literature. However, most published work focuses on the parametric linear regression problem. This paper considers an important…

Methodology · Statistics 2019-11-14 Qi Gao , Randy C. S. Lai , Thomas C. M. Lee , Yao Li

Labeling patients in electronic health records with respect to their statuses of having a disease or condition, i.e. case or control statuses, has increasingly relied on prediction models using high-dimensional variables derived from…

Methodology · Statistics 2021-10-14 Zijian Guo , Prabrisha Rakshit , Daniel S. Herman , Jinbo Chen

We introduce a methodology for performing parameter inference in high-dimensional, non-linear diffusion processes. We illustrate its applicability for obtaining insights into the evolution of and relationships between species, including…

Machine Learning · Statistics 2024-11-15 Nicklas Boserup , Gefan Yang , Michael Lind Severinsen , Christy Anna Hipsley , Stefan Sommer

After variable selection, standard inferential procedures for regression parameters may not be uniformly valid; there is no finite-sample size at which a standard test is guaranteed to approximately attain its nominal size. This problem is…

Methodology · Statistics 2020-07-07 Oliver Dukes , Vahe Avagyan , Stijn Vansteelandt

The logical and practical difficulties associated with research interpretation using P values and null hypothesis significance testing have been extensively documented. This paper describes an alternative, likelihood-based approach to…

Methodology · Statistics 2021-09-21 Nicholas Adams , Gerard O'Reilly

High-dimensional group inference is an essential part of statistical methods for analysing complex data sets, including hierarchical testing, tests of interaction, detection of heterogeneous treatment effects and inference for local…

Methodology · Statistics 2020-12-01 Zijian Guo , Claude Renaux , Peter Bühlmann , T. Tony Cai

Inference on the minimum clinically important difference, or MCID, is an important practical problem in medicine. The basic idea is that a treatment being statistically significant may not lead to an improvement in the patients' well-being.…

Methodology · Statistics 2022-08-29 Pei-Shien Wu , Ryan Martin