English
Related papers

Related papers: Reconciling Model Selection and Prediction

200 papers

In this article we study the asymptotic predictive optimality of a model selection criterion based on the cross-validatory predictive density, already available in the literature. For a dependent variable and associated explanatory…

Statistics Theory · Mathematics 2008-12-18 Arijit Chakrabarti , Tapas Samanta

Recent work has shown that models trained to the same objective, and which achieve similar measures of accuracy on consistent test data, may nonetheless behave very differently on individual predictions. This inconsistency is undesirable in…

Machine Learning · Computer Science 2021-11-17 Emily Black , Klas Leino , Matt Fredrikson

Penalized estimation principle is fundamental to high-dimensional problems. In the literature, it has been extensively and successfully applied to various models with only structural parameters. As a contrast, in this paper, we apply this…

Statistics Theory · Mathematics 2017-08-03 Jianqing Fan , Runlong Tang , Xiaofeng Shi

The oracle property of model selection procedures has attracted a large volume of favorable publications in the literature, but also faced criticisms of being ineffective and misleading in applications. In this paper, we introduce a class…

Statistics Theory · Mathematics 2018-07-12 Xianyi Wu , Xian Zhou

In some estimation problems, especially in applications dealing with information theory, signal processing and biology, theory provides us with additional information allowing us to restrict the parameter space to a finite number of points.…

Methodology · Statistics 2012-07-25 Christine Choirat , Raffaello Seri

Asymptotic optimality is a key theoretical property in model averaging. Due to technical difficulties, existing studies rely on restricted weight sets or the assumption that there is no true model with fixed dimensions in the candidate set.…

Statistics Theory · Mathematics 2024-11-15 Wenchao Xu , Xinyu Zhang

A class of variable selection procedures for parametric models via nonconcave penalized likelihood was proposed by Fan and Li to simultaneously estimate parameters and select important variables. They demonstrated that this class of…

Statistics Theory · Mathematics 2007-06-13 Jianqing Fan , Heng Peng

Model selection criteria are one of the most important tools in statistics. Proofs showing a model selection criterion is asymptotically optimal are tailored to the type of model (linear regression, quantile regression, penalized…

Statistics Theory · Mathematics 2025-10-17 Amaze Lusompa

We consider exact asymptotics of the minimax risk for global testing against sparse alternatives in the context of high dimensional linear regression. Our results characterize the leading order behavior of this minimax risk in several…

Statistics Theory · Mathematics 2020-03-03 Rajarshi Mukherjee , Subhabrata Sen

We discuss the asymptotics of the nonparametric maximum likelihood estimator (NPMLE) in the normal mixture model. We then prove the convergence rate of the NPMLE decision in the empirical Bayes problem with normal observations. We point to…

Statistics Theory · Mathematics 2024-06-17 Ya'acov Ritov

Biased stochastic estimators, such as finite-differences for noisy gradient estimation, often contain parameters that need to be properly chosen to balance impacts from the bias and the variance. While the optimal order of these parameters…

Methodology · Statistics 2019-02-14 Henry Lam , Xinyu Zhang , Xuhui Zhang

We derive asymptotic properties of penalized estimators for singular models for which identifiability may break and the true parameter values can lie on the boundary of the parameter space. Selection consistency of the estimators is also…

Statistics Theory · Mathematics 2023-01-24 Junichiro Yoshida , Nakahiro Yoshida

In nonparametric statistics an optimality criterion for estimation procedures is provided by the minimax rate of convergence. However this classical point of view is subject to controversy as it requires to look for the worst behaviour…

Statistics Theory · Mathematics 2009-02-20 A. Fraysse

This paper considers the problem of estimating a periodic function in a continuous time regression model with a general square integrable semimartingale noise. A model selection adaptive procedure is proposed. Sharp non-asymptotic oracle…

Statistics Theory · Mathematics 2009-09-18 Victor Konev , Serguei Pergamenchtchikov

This paper considers the problem of variable selection allowing for parameter instability. It distinguishes between signal and pseudo-signal variables that are correlated with the target variable, and noise variables that are not, and…

Econometrics · Economics 2024-07-17 Alexander Chudik , M. Hashem Pesaran , Mahrad Sharifvaghefi

Predictors are learned using past training data which may contain features that are unavailable at the time of prediction. We develop an approach that is robust against outlying missing features, based on the optimality properties of an…

Signal Processing · Electrical Eng. & Systems 2020-07-15 Xiuming Liu , Dave Zachariah , Petre Stoica

We study the asymptotic behavior of a class of methods for sufficient dimension reduction in high-dimension regressions, as the sample size and number of predictors grow in various alignments. It is demonstrated that these methods are…

Statistics Theory · Mathematics 2012-05-31 R. Dennis Cook , Liliana Forzani , Adam J. Rothman

In this article, we investigate large sample properties of model selection procedures in a general Bayesian framework when a closed form expression of the marginal likelihood function is not available or a local asymptotic quadratic…

Statistics Theory · Mathematics 2017-01-10 Yun Yang , Debdeep Pati

Missing values arise in most real-world data sets due to the aggregation of multiple sources and intrinsically missing information (sensor failure, unanswered questions in surveys...). In fact, the very nature of missing values usually…

Machine Learning · Statistics 2022-02-04 Alexis Ayme , Claire Boyer , Aymeric Dieuleveut , Erwan Scornet

We study the problem of nonparametric estimation under $\bL_p$-loss, $p\in [1,\infty)$, in the framework of the convolution structure density model on $\bR^d$. This observation scheme is a generalization of two classical statistical models,…

Statistics Theory · Mathematics 2017-04-17 Oleg Lepski , Thomas Willer
‹ Prev 1 2 3 10 Next ›