English
Related papers

Related papers: Significance Testing and Group Variable Selection

200 papers

We consider testing whether a set of Gaussian variables, selected from the data, is independent of the remaining variables. We assume that this set is selected via a very simple approach that is commonly used across scientific disciplines:…

Methodology · Statistics 2022-11-04 Arkajyoti Saha , Daniela Witten , Jacob Bien

We develop tools for selective inference in the setting of group sparsity, including the construction of confidence intervals and p-values for testing selected groups of variables. Our main technical result gives the precise distribution of…

Methodology · Statistics 2016-07-28 Fan Yang , Rina Foygel Barber , Prateek Jain , John Lafferty

Variable selection comprises an important step in many modern statistical inference procedures. In the regression setting, when estimators cannot shrink irrelevant signals to zero, covariates without relationships to the response often…

Statistics Theory · Mathematics 2025-03-28 Ka Long Keith Ho , Hien Duy Nguyen

Applied statistical problems often come with pre-specified groupings to predictors. It is natural to test for the presence of simultaneous group-wide signal for groups in isolation, or for multiple groups together. Classical tests for the…

Applications · Statistics 2015-11-25 Stephen Reid , Jonathan Taylor , Robert Tibshirani

In this paper, we present a new classifier, which integrates significance testing results over different random subspaces to yield consensus p-values for quantifying the uncertainty of classification decision. The null hypothesis is that…

Machine Learning · Computer Science 2024-10-17 Zengyou He , Zerun Li , Junjie Dong , Xinying Liu , Mudi Jiang , Lianyu Hu

In this paper we give a completely new approach to the problem of covariate selection in linear regression. A covariate or a set of covariates is included only if it is better in the sense of least squares than the same number of Gaussian…

Methodology · Statistics 2022-02-25 Laurie Davies , Lutz Dümbgen

In this paper, we are concerned with regression problems where covariates can be grouped in nonoverlapping blocks, and where only a few of them are assumed to be active. In such a situation, the group Lasso is an at- tractive method for…

Information Theory · Computer Science 2013-01-01 Samuel Vaiter , Charles Deledalle , Gabriel Peyré , Jalal Fadili , Charles Dossal

We apply the methods developed by Lockhart et al. (2013) and Taylor et al. (2013) on significance tests for penalized regression to forward stepwise model selection. A general framework for selection procedures described by quadratic…

Methodology · Statistics 2014-05-16 Joshua R. Loftus , Jonathan E. Taylor

We consider testing the significance of a subset of covariates in a nonparametric regression. These covariates can be continuous and/or discrete. We propose a new kernel-based test that smoothes only over the covariates appearing under the…

Statistics Theory · Mathematics 2014-03-28 Pascal Lavergne , Samuel Maistre , Valentin Patilea

We provide a general mathematical framework for selective inference with supervised model selection procedures characterized by quadratic forms in the outcome variable. Forward stepwise with groups of variables is an important special case…

Methodology · Statistics 2015-11-05 Joshua R. Loftus , Jonathan E. Taylor

Categorical regressor variables are usually handled by introducing a set of indicator variables, and imposing a linear constraint to ensure identifiability in the presence of an intercept, or equivalently, using one of various coding…

Computation · Statistics 2018-05-21 Felicitas J. Detmer , Martin Slawski

In many fields of science, generalized likelihood ratio tests are established tools for statistical inference. At the same time, it has become increasingly common that a simulator (or generative model) is used to describe complex processes…

Applications · Statistics 2016-03-21 Kyle Cranmer , Juan Pavez , Gilles Louppe

Considered here is a hypothesis test for the coefficients in the change-plane regression models to detect the existence of a change plane. The test that is considered is from the class of test problems in which some parameters are not…

Statistics Theory · Mathematics 2024-08-02 Xu Liu , Jian Huang , Yong Zhou , Feipeng Zhang , Panpan Ren

This article reviews a class of adaptive group testing procedures that operate under a probabilistic model assumption as follows. Consider a set of $N$ items, where item $i$ has the probability $p$ ($p_i$ in the generalized group testing)…

Methodology · Statistics 2021-02-19 Yaakov Malinovsky , Paul S. Albert

We consider a new group testing model wherein each item is a binary random variable defined by an a priori probability of being defective. We assume that each probability is small and that items are independent, but not necessarily…

Information Theory · Computer Science 2018-07-24 Tongxin Li , Chun Lam Chan , Wenhao Huang , Tarik Kaced , Sidharth Jaggi

Standard ANOVA is among the most widely used tests in the life sciences and beyond. Several alternatives are proposed to provide simultaneous confidence intervals, ensure tight control of FWER, be robust to variance heterogeneity, avoid…

Methodology · Statistics 2022-06-01 Ludwig A. Hothorn

We study confidence regions and approximate chi-squared tests for variable groups in high-dimensional linear regression. When the size of the group is small, low-dimensional projection estimators for individual coefficients can be directly…

Statistics Theory · Mathematics 2016-02-23 Ritwik Mitra , Cun-Hui Zhang

In the sparse linear regression setting, we consider testing the significance of the predictor variable that enters the current lasso model, in the sequence of models visited along the lasso solution path. We propose a simple test statistic…

Statistics Theory · Mathematics 2014-05-27 Richard Lockhart , Jonathan Taylor , Ryan J. Tibshirani , Robert Tibshirani

This paper studies one-sided hypothesis testing under random sampling without replacement. That is, when $n+1$ binary random variables $X_1,\ldots, X_{n+1}$ are subject to a permutation invariant distribution and $n$ binary random variables…

Statistics Theory · Mathematics 2022-11-07 Zihao Li , Huangjun Zhu , Masahito Hayashi

Many data sets consist of variables with an inherent group structure. The problem of group selection has been well studied, but in this paper, we seek to do the opposite: our goal is to select at least one variable from each group in the…

Methodology · Statistics 2015-05-29 Frederick Campbell , Genevera I. Allen