English
Related papers

Related papers: Large Scale Partial Correlation Screening with Unc…

200 papers

In many statistical problems the hypotheses are naturally divided into groups, and the investigators are interested to perform group-level inference, possibly along with inference on individual hypotheses. We consider the goal of…

Statistics Theory · Mathematics 2021-05-20 Marina Bogomolov

Feature screening is an important method to reduce the dimension and capture informative variables in ultrahigh-dimensional data analysis. Many methods have been developed for feature screening. These methods, however, are challenged by…

Methodology · Statistics 2019-01-08 Li-Pang Chen

Forward regression is a crucial methodology for automatically identifying important predictors from a large pool of potential covariates. In contexts with moderate predictor correlation, forward selection techniques can achieve screening…

Methodology · Statistics 2024-08-23 Xuejun Jiang , Yue Ma , Haofeng Wang

Visual representation based on covariance matrix has demonstrates its efficacy for image classification by characterising the pairwise correlation of different channels in convolutional feature maps. However, pairwise correlation will…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Saimunur Rahman , Piotr Koniusz , Lei Wang , Luping Zhou , Peyman Moghadam , Changming Sun

Multiple hypothesis testing is a fundamental problem in high dimensional inference, with wide applications in many scientific fields. In genome-wide association studies, tens of thousands of tests are performed simultaneously to find if any…

Methodology · Statistics 2010-12-21 Xu Han , Weijie Gu , Jianqing Fan

We consider the problem of variable selection in high-dimensional statistical models where the goal is to report a set of variables, out of many predictors $X_1, \dotsc, X_p$, that are relevant to a response of interest. For linear…

Methodology · Statistics 2019-03-20 Adel Javanmard , Hamid Javadi

Inferring linear relationships lies at the heart of many empirical investigations. A measure of linear dependence should correctly evaluate the strength of the relationship as well as qualify whether it is meaningful for the population.…

Methodology · Statistics 2022-08-16 Kaustubh R. Patil , Simon B. Eickhoff , Robert Langner

Feature screening is a powerful tool in the analysis of high dimensional data. When the sample size $N$ and the number of features $p$ are both large, the implementation of classic screening methods can be numerically challenging. In this…

Methodology · Statistics 2019-03-12 Xingxiang Li , Runze Li , Zhiming Xia , Chen Xu

A variable screening procedure via correlation learning was proposed Fan and Lv (2008) to reduce dimensionality in sparse ultra-high dimensional models. Even when the true model is linear, the marginal regression can be highly nonlinear. To…

Methodology · Statistics 2011-01-19 Jianqing Fan , Yang Feng , Rui Song

Herein, we propose a Spearman rank correlation based screening procedure for ultrahigh-dimensional data with censored response case. The proposed method is model-free without specifying any regression forms of predictors or response…

Methodology · Statistics 2022-11-28 Hongni Wang , Jingxin Yan , Xiaodong Yan

When can reliable inference be drawn in the "Big Data" context? This paper presents a framework for answering this fundamental question in the context of correlation mining, with implications for general large scale inference. In large…

Statistics Theory · Mathematics 2015-05-19 Alfred O. Hero , Bala Rajaratnam

Fault detection is crucial for ensuring the safety and reliability of modern industrial systems. However, a significant scientific challenge is the lack of rigorous risk control and reliable uncertainty quantification in existing diagnostic…

Artificial Intelligence · Computer Science 2025-08-05 Mingchen Mei , Yi Li , YiYao Qian , Zijun Jia

The generalized varying coefficient partially linear model with growing number of predictors arises in many contemporary scientific endeavor. In this paper we set foot on both theoretical and practical sides of profile likelihood estimation…

Statistics Theory · Mathematics 2011-11-09 C. Lam , J. Fan

Standard penalized methods of variable selection and parameter estimation rely on the magnitude of coefficient estimates to decide which variables to include in the final model. However, coefficient estimates are unreliable when the design…

Methodology · Statistics 2018-02-13 Jonathan P Williams , Jan Hannig

Ultra-high dimensional longitudinal data are increasingly common and the analysis is challenging both theoretically and methodologically. We offer a new automatic procedure for finding a sparse semivarying coefficient model, which is widely…

Methodology · Statistics 2014-09-24 Ming-Yen Cheng , Toshio Honda , Jialiang Li , Heng Peng

Independence screening is a variable selection method that uses a ranking criterion to select significant variables, particularly for statistical models with nonpolynomial dimensionality or "large p, small n" paradigms when p can be as…

Methodology · Statistics 2012-10-18 Gaorong Li , Heng Peng , Jun Zhang , Lixing Zhu

We consider statistical hypothesis testing simultaneously over a fairly general, possibly uncountably infinite, set of null hypotheses, under the assumption that a suitable single test (and corresponding $p$-value) is known for each…

Methodology · Statistics 2014-02-10 Gilles Blanchard , Sylvain Delattre , Etienne Roquain

Biological research often involves testing a growing number of null hypotheses as new data is accumulated over time. We study the problem of online control of the familywise error rate (FWER), that is testing an apriori unbounded sequence…

Methodology · Statistics 2020-03-10 Jinjin Tian , Aaditya Ramdas

The growing prevalence of large language models (LLMs) and vision-language models (VLMs) has heightened the need for reliable techniques to determine whether a model has been fine-tuned from or is even identical to another. Existing…

Machine Learning · Computer Science 2025-09-30 Ruibo Chen , Sheng Zhang , Yihan Wu , Tong Zheng , Peihua Mai , Heng Huang

Selecting the top-$m$ variables with the $m$ largest population parameters from a larger set of candidates is a fundamental problem in statistics. In this paper, we propose a novel methodology called Sequential Correct Screening (SCS),…

Methodology · Statistics 2025-08-21 Masaki Toyoda , Yoshimasa Uematsu