English
Related papers

Related papers: Feature screening for multi-response linear models…

200 papers

Feature selection and reducing the dimensionality of data is an essential step in data analysis. In this work, we propose a new criterion for feature selection that is formulated as conditional information between features given the labeled…

Machine Learning · Statistics 2019-05-20 Salimeh Yasaei Sekeh , Alfred O. Hero

Microarray studies, in order to identify genes associated with an outcome of interest, usually produce noisy measurements for a large number of gene expression features from a small number of subjects. One common approach to analyzing such…

Methodology · Statistics 2021-04-21 Linh Nghiem , Francis K. C. Hui , Samuel Mueller , A. H. Welsh

A new method is proposed for variable screening, variable selection and prediction in linear regression problems where the number of predictors can be much larger than the number of observations. The method involves minimizing a penalized…

Statistics Theory · Mathematics 2017-09-14 D. Vasiliu , T. Dey , I. L. Dryden

We propose an empirical likelihood ratio test for nonparametric model selection, where the competing models may be nested, nonnested, overlapping, misspecified, or correctly specified. It compares the squared prediction errors of models…

Methodology · Statistics 2022-01-21 Jiancheng Jiang , Jiang Xuejun , Wang Haofeng

When the number of features exponentially outnumbers the number of samples, feature screening plays a pivotal role in reducing the dimension of the feature space and developing models based on such data. While most extant feature screening…

Methodology · Statistics 2019-11-19 Randall Reese

Conventional likelihood-based information criteria for model selection rely on the distribution assumption of data. However, for complex data that are increasingly available in many scientific fields, the specification of their underlying…

Methodology · Statistics 2020-06-25 Chixiang Chen , Ming Wang , Rongling Wu , Runze Li

Mixed linear models are commonly used in repeated measures studies. They account for the dependence amongst observations obtained from the same experimental unit. Oftentimes, the number of observations is small, and it is thus important to…

Methodology · Statistics 2011-08-05 Tatiane F. N. Melo , Silvia L. P. Ferrari , Francisco Cribari-Neto

Multi-parameter one-sided hypothesis test problems arise naturally in many applications. We are particularly interested in effective tests for monitoring multiple quality indices in forestry products. Our search reveals that there are many…

Statistics Theory · Mathematics 2017-03-16 Guangyu Zhu , Jiahua Chen

A data analysis pipeline is a structured sequence of steps that transforms raw data into meaningful insights by integrating various analysis algorithms. In this paper, we propose a novel statistical test to assess the significance of data…

Machine Learning · Statistics 2024-10-15 Tomohiro Shiraishi , Tatsuya Matsukawa , Shuichi Nishino , Ichiro Takeuchi

Understanding how features interact with each other is of paramount importance in many scientific discoveries and contemporary applications. Yet interaction identification becomes challenging even for a moderate number of covariates. In…

Methodology · Statistics 2016-05-31 Yingying Fan , Yinfei Kong , Daoji Li , Jinchi Lv

We consider an empirical likelihood inference for parameters defined by general estimating equations when some components of the random observations are subject to missingness. As the nature of the estimating equations is wide-ranging, we…

Statistics Theory · Mathematics 2009-03-05 Dong Wang , Song Xi Chen

In this paper we propose a linear variable screening method for computer experiments when the number of input variables is larger than the number of runs. This method uses a linear model to model the nonlinear data, and screens the…

Methodology · Statistics 2020-06-16 Chunya Li , Daijun Chen , Shifeng Xiong

We develop a framework for post model selection inference, via marginal screening, in linear regression. At the core of this framework is a result that characterizes the exact distribution of linear functions of the response $y$,…

Methodology · Statistics 2014-03-03 Jason D Lee , Jonathan E Taylor

Unbiased assessment of the predictivity of models learnt by supervised machine-learning methods requires knowledge of the learned function over a reserved test set (not used by the learning algorithm). The quality of the assessment depends,…

Statistics Theory · Mathematics 2022-07-11 Elias Fekhari , Bertrand Iooss , Joseph Muré , Luc Pronzato , Maria-João Rendas

Feature screening for ultrahigh-dimension, in general, proceeds with two essential steps. The first step is measuring and ranking the marginal dependence between response and covariates, and the second is determining the threshold. We…

Methodology · Statistics 2022-07-28 Linsui Deng , Yilin Zhang

The likelihood for the parameters of a generalized linear mixed model involves an integral which may be of very high dimension. Because of this intractability, many approximations to the likelihood have been proposed, but all can fail when…

Computation · Statistics 2014-09-01 Helen Ogden

Independence screening is a variable selection method that uses a ranking criterion to select significant variables, particularly for statistical models with nonpolynomial dimensionality or "large p, small n" paradigms when p can be as…

Methodology · Statistics 2012-10-18 Gaorong Li , Heng Peng , Jun Zhang , Lixing Zhu

We in this paper propose a directional regression based approach for ultrahigh dimensional sufficient variable screening with censored responses. The new method is designed in a model-free manner and thus can be adapted to various complex…

Methodology · Statistics 2018-02-28 Menghao Xu , Zhou Yu , Jun Shao

Motivated by applications to goodness of fit testing, the empirical likelihood approach is generalized to allow for the number of constraints to grow with the sample size and for the constraints to use estimated criteria functions. The…

Statistics Theory · Mathematics 2013-07-24 Hanxiang Peng , Anton Schick

When dealing with subjective, noisy, or otherwise nebulous features, the "wisdom of crowds" suggests that one may benefit from multiple judgments of the same feature on the same object. We give theoretically-motivated `feature…

Machine Learning · Computer Science 2013-05-16 Sivan Sabato , Adam Kalai