English
Related papers

Related papers: Selecting Penalty Parameters of High-Dimensional M…

200 papers

Cross-validation is frequently used for model selection in a variety of applications. However, it is difficult to apply cross-validation to mixed effects models (including nonlinear mixed effects models or NLME models) due to the fact that…

Methodology · Statistics 2013-05-24 Emily Colby , Eric Bair

Mixed-effect models are widely used for the analysis of correlated data such as longitudinal data and repeated measures. In this article, we study an approach to the nonparametric estimation of mixed-effect models. We consider models with…

Statistics Theory · Mathematics 2007-06-13 Chong Gu , Ping Ma

We consider controlling the false discovery rate for testing many time series with an unknown cross-sectional correlation structure. Given a large number of hypotheses, false and missing discoveries can plague an analysis. While many…

Methodology · Statistics 2021-06-10 Junpei Komiyama , Masaya Abe , Kei Nakagawa , Kenichiro McAlinn

Appropriate selection of the penalty parameter is crucial to obtaining good performance from the Alternating Direction Method of Multipliers (ADMM). While analytic results for optimal selection of this parameter are very limited, there is a…

Optimization and Control · Mathematics 2017-11-09 Brendt Wohlberg

A new type of redescending M-estimators is constructed, based on data augmentation with an unspecified outlier model. Necessary and sufficient conditions for the convergence of the resulting estimators to the Hubertype skipped mean are…

Methodology · Statistics 2010-06-21 Rudolf Frühwirth , Wolfgang Waltenberger

We propose a bootstrap-based test to detect a mean shift in a sequence of high-dimensional observations with unknown time-varying heteroscedasticity. The proposed test builds on the U-statistic based approach in Wang et al. (2022), targets…

Methodology · Statistics 2023-11-17 Teng Wu , Stanislav Volgushev , Xiaofeng Shao

In this paper, we propose new specification tests for regression models with measurement errors in the explanatory variables. Inspired by the integrated conditional moment (ICM) approach, we use a deconvoluted residual-marked empirical…

Econometrics · Economics 2025-11-07 Xiaojun Song , Jichao Yuan

Super learner algorithm can be applied to combine results of multiple base learners to improve quality of predictions. The default method for verification of super learner results is by nested cross validation. It has been proposed by…

Machine Learning · Computer Science 2020-03-19 Krzysztof Mnich , Agnieszka Kitlas Golińska , Aneta Polewko-Klim , Witold R. Rudnicki

Motivated by the problem of identifying correlations between genes or features of two related biological systems, we propose a model of \emph{feature selection} in which only a subset of the predictors $X_t$ are dependent on the…

Applications · Statistics 2011-11-29 Charles Zheng , Scott Schwartz , Robert Chapkin , Raymond Carroll , Ivan Ivanov

Previous methods evaluate reward models by testing them on a fixed pairwise ranking test set, but they typically do not provide performance information on each preference dimension. In this work, we address the evaluation challenge of…

Computation and Language · Computer Science 2025-11-18 Chenglong Wang , Yifu Huo , Yang Gan , Yongyu Mu , Qiaozhi He , Murun Yang , Bei Li , Chunliang Zhang , Tongran Liu , Anxiang Ma , Zhengtao Yu , Jingbo Zhu , Tong Xiao

In high-dimensional classification settings, we wish to seek a balance between high power and ensuring control over a desired loss function. In many settings, the points most likely to be misclassified are those who lie near the decision…

Machine Learning · Statistics 2017-06-06 Arun Srinivasan

The determination of the sample size required by a crossover trial typically depends on the specification of one or more variance components. Uncertainty about the value of these parameters at the design stage means that there is often a…

Methodology · Statistics 2018-03-28 Michael Grayling , Adrian Mander , James Wason

Presence of missing values in a dataset can adversely affect the performance of a classifier. Single and Multiple Imputation are normally performed to fill in the missing values. In this paper, we present several variants of combining…

Machine Learning · Computer Science 2019-10-16 Shehroz S. Khan , Amir Ahmad , Alex Mihailidis

Feature selection is a standard approach to understanding and modeling high-dimensional classification data, but the corresponding statistical methods hinge on tuning parameters that are difficult to calibrate. In particular, existing…

Methodology · Statistics 2019-03-01 Wei Li , Johannes Lederer

We prove that the combination of a target network and over-parameterized linear function approximation establishes a weaker convergence condition for bootstrapped value estimation in certain cases, even with off-policy data. Our condition…

Recently Hui et al. (2018) use F tests for testing a subset of random effect, demonstrating its computational simplicity and exactness when the first two moment of the random effects are specified. We extended the investigation of the F…

Methodology · Statistics 2018-12-11 P. Y. O'Shaughnessy , Francis Hui , Samuel Muller , A. H. Welsh

Most of the policy evaluation algorithms are based on the theories of Bellman Expectation and Optimality Equation, which derive two popular approaches - Policy Iteration (PI) and Value Iteration (VI). However, multi-step bootstrapping is…

Machine Learning · Computer Science 2021-12-16 Yuhui Wang , Qingyuan Wu , Pengcheng He , Xiaoyang Tan

We develop methodology for valid inference after variable selection in logistic regression when the responses are partially observed, that is, when one observes a set of error-prone testing outcomes instead of the true values of the…

Methodology · Statistics 2025-04-17 Qinyan Shen , Karl Gregory , Xianzheng Huang

In response to the challenges of data mining, discriminant analysis continues to evolve as a vital branch of statistics. Our recently introduced method of vertex discriminant analysis (VDA) is ideally suited to handle multiple categories…

Applications · Statistics 2011-01-06 Tong Tong Wu , Kenneth Lange

We consider the problem of estimating the parameters of the covariance function of a Gaussian process by cross-validation. We suggest using new cross-validation criteria derived from the literature of scoring rules. We also provide an…

Computation · Statistics 2020-08-07 Sébastien Petit , Julien Bect , Sébastien da Veiga , Paul Feliot , Emmanuel Vazquez