English
Related papers

Related papers: False Variable Selection Rates in Regression

200 papers

In high-dimensional regression modelling, the number of candidate covariates to be included in the predictor is quite large, and variable selection is crucial. In this work, we propose a new penalty able to guarantee both sparse variable…

Methodology · Statistics 2022-12-19 Daniele Cuntrera , Luigi Augugliaro , Vito M. R. Muggeo

Dynamic treatment regimes (DTRs) consist of a sequence of decision rules, one per stage of intervention, that finds effective treatments for individual patients according to patient information history. DTRs can be estimated from models…

Methodology · Statistics 2021-12-07 Zeyu Bian , Erica EM Moodie , Susan M Shortreed , Sahir Bhatnagar

Random forests (RFs) are well suited for prediction modeling and variable selection in high-dimensional omics studies. The effect of hyperparameters of the RF algorithm on prediction performance and variable importance estimation have…

Machine Learning · Statistics 2025-01-28 Cesaire J. K. Fouodo , Lea L. Kronziel , Inke R. König , Silke Szymczak

False discovery rate (FDR) control methods are essential for voxel-wise multiple testing in neuroimaging data analysis, where hundreds of thousands or even millions of tests are conducted to detect brain regions associated with…

Machine Learning · Statistics 2025-05-30 Taehyo Kim , Qiran Jia , Mony J. de Leon , Hai Shu

Deep neural networks (DNNs) are famous for their high prediction accuracy, but they are also known for their black-box nature and poor interpretability. We consider the problem of variable selection, that is, selecting the input variables…

Machine Learning · Statistics 2019-09-18 Zixuan Song , Jun Li

This paper studies the semi-supervised novelty detection problem where a set of "typical" measurements is available to the researcher. Motivated by recent advances in multiple testing and conformal inference, we propose AdaDetect, a…

Methodology · Statistics 2023-10-26 Ariane Marandon , Lihua Lei , David Mary , Etienne Roquain

For many scientific questions, understanding the underlying mechanism is the goal. To help investigators better understand the underlying mechanism, variable selection is a crucial step that permits the identification of the most associated…

Methodology · Statistics 2025-10-06 Shuangshuang Xu , Marco A. R. Ferreira , Allison N. Tegge

Consider the online testing of a stream of hypotheses where a real--time decision must be made before the next data point arrives. The error rate is required to be controlled at {all} decision points. Conventional \emph{simultaneous testing…

Methodology · Statistics 2020-03-03 Bowen Gang , Wenguang Sun , Weinan Wang

In 2015, Barber and Candes introduced a new variable selection procedure called the knockoff filter to control the false discovery rate (FDR) and prove that this method achieves exact FDR control. Inspired by the work of Barber and Candes…

Methodology · Statistics 2019-07-23 Jiajie Chen , Anthony Hou , Thomas Y. Hou

Distribution-free predictive inference beyond the construction of prediction sets has gained a lot of interest in recent applications. One such application is the selection task, where the objective is to design a reliable selection rule to…

Methodology · Statistics 2025-01-07 Yonghoon Lee , Zhimei Ren

We propose the group knockoff filter, a method for false discovery rate control in a linear regression setting where the features are grouped, and we would like to select a set of relevant groups which have a nonzero effect on the response.…

Methodology · Statistics 2016-02-12 Ran Dai , Rina Foygel Barber

The False Discovery Rate (FDR) is a commonly used type I error rate in multiple testing problems. It is defined as the expected False Discovery Proportion (FDP), that is, the expected fraction of false positives among rejected hypotheses.…

Statistics Theory · Mathematics 2013-10-04 Pierre Neuvial

This paper extends the theory of false discovery rates (FDR) pioneered by Benjamini and Hochberg [J. Roy. Statist. Soc. Ser. B 57 (1995) 289-300]. We develop a framework in which the False Discovery Proportion (FDP)--the number of false…

Statistics Theory · Mathematics 2007-06-13 Christopher Genovese , Larry Wasserman

Competition-based approach to controlling the false discovery rate (FDR) recently rose to prominence when, generalizing it to sequential hypothesis testing, Barber and Cand\`es used it as part of their knockoff-filter. Control of the FDR…

Methodology · Statistics 2023-02-24 Arya Ebadi , Dong Luo , Jack Freestone , William Stafford Noble , Uri Keich

Thanks to its fine balance between model flexibility and interpretability, the nonparametric additive model has been widely used, and variable selection for this type of model has been frequently studied. However, none of the existing…

Methodology · Statistics 2022-01-10 Xiaowu Dai , Xiang Lyu , Lexin Li

In the regression problem, L1 and L2 are the most commonly used loss functions, which produce mean predictions with different biases. However, the predictions are neither robust nor adequate enough since they only capture a few conditional…

Machine Learning · Computer Science 2019-11-14 Faen Zhang , Xinyu Fan , Hui Xu , Pengcheng Zhou , Yujian He , Junlong Liu

In many applications, the process of identifying a specific feature of interest often involves testing multiple hypotheses for their joint statistical significance. Examples include mediation analysis which simultaneously examines the…

Methodology · Statistics 2023-05-30 Linsui Deng , Kejun He , Xianyang Zhang

Genome-wide association studies (GWAS) have led to the discovery of numerous single nucleotide polymorphisms (SNPs) associated with various phenotypes and complex diseases. However, the identified genetic variants do not fully explain the…

Methodology · Statistics 2025-07-09 Dayeon Jung , Yewon Kim , Junyong Park

In large scale multiple testing, the use of an empirical null distribution rather than the theoretical null distribution can be critical for correct inference. This paper proposes a ``mode matching'' method for fitting an empirical null…

Applications · Statistics 2009-01-27 Armin Schwartzman

The knockoffs is a recently proposed powerful framework that effectively controls the false discovery rate (FDR) for variable selection. However, none of the existing knockoff solutions are directly suited to handle multivariate or…

Methodology · Statistics 2024-06-28 Xinghao Qiao , Mingya Long , Qizhai Li