English
Related papers

Related papers: Efficient and Consistent Data-Driven Model Selecti…

200 papers

A challenging problem in estimating high-dimensional graphical models is to choose the regularization parameter in a data-dependent way. The standard techniques include $K$-fold cross-validation ($K$-CV), Akaike information criterion (AIC),…

Machine Learning · Statistics 2010-06-18 Han Liu , Kathryn Roeder , Larry Wasserman

A wide range of approaches for batch processes monitoring can be found in the literature. This kind of process generates a very peculiar data structure, in which successive measurements of many process variables in each batch run are…

Methodology · Statistics 2021-09-03 Batista Nunes de Oliveira , Marcio Valk , Danilo Marcondes Filho

We discuss model selection to determine whether the variance-covariance matrix of a multivariate Gaussian model with known mean should be considered to be a constant diagonal, a non-constant diagonal, or an arbitrary positive definite…

Methodology · Statistics 2021-05-05 Zachary M. Pisano , Daniel Q. Naiman , Carey E. Priebe

Selective classification is a powerful tool for automated decision-making in high-risk scenarios, allowing classifiers to act only when confident and abstain when uncertainty is high. Given a target accuracy, our goal is to minimize…

Statistics Theory · Mathematics 2025-10-28 Mohamed Ndaoud , Peter Radchenko , Bradley Rava

This paper introduces and develops a theoretical extension of the widely applicable information criterion (WAIC), called the Covariance-Corrected WAIC (CC-WAIC), that applied for Bayesian sequential data models. The CC-WAIC accounts for…

Methodology · Statistics 2025-09-23 Safaa K. Kadhem

Approximate Bayesian Computation (ABC) methods have gained in their popularity over the last decade because they expand the horizon of Bayesian parameter inference methods to the range of models for which only forward simulation is…

Computation · Statistics 2016-08-05 Majid K. Vakilzadeh , James L. Beck , Thomas Abrahamsson

In segmented regression, when the regression function is continuous at the change-points that are the boundaries of the segments, it is also called joinpoint regression, and the analysis package developed by \cite{KimFFM00} has become a…

Methodology · Statistics 2025-06-11 Kazuki Nakajima , Yoshiyuki Ninomiya

We study continuity and robustness properties of infinite-horizon average expected cost problems with respect to (controlled) transition kernels, and applications of these results to the problem of robustness of control policies designed…

Systems and Control · Electrical Eng. & Systems 2020-12-22 Ali Devran Kara , Maxim Raginsky , Serdar Yuksel

Model selection in supervised learning provides costless guarantees as if the model that best balances bias and variance was known a priori. We study the feasibility of similar guarantees for cumulative regret minimization in the stochastic…

Machine Learning · Computer Science 2023-10-25 Sanath Kumar Krishnamurthy , Adrienne Margaret Propp , Susan Athey

When learning interpretable latent structures using model-based approaches, even small deviations from modeling assumptions can lead to inferential results that are not mechanistically meaningful. In this work, we consider latent structures…

Methodology · Statistics 2026-02-26 Jiawei Li , Nguyen Nguyen , Meng Lai , Ioannis Ch. Paschalidis , Jonathan H. Huggins

This article investigates unsupervised classification techniques for categorical multivariate data. The study employs multivariate multinomial mixture modeling, which is a type of model particularly applicable to multilocus genotypic data.…

Statistics Theory · Mathematics 2014-03-11 Dominique Bontemps , Wilson Toussile

Recent advances in autoregressive (AR) models have demonstrated their potential to rival diffusion models in image synthesis. However, for complex spatially-conditioned generation, current AR approaches rely on fine-tuning the pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Jiaqi Liu , Tao Huang , Chang Xu

We propose a panel ARMA-GARCH model to capture the dynamics of large panel data with $N$ individuals over $T$ time periods. For this model, we provide a two-step estimation procedure to estimate the ARMA parameters and GARCH parameters…

Methodology · Statistics 2024-04-30 Bing Su , Ke Zhu

We propose a novel algorithm for efficiently computing a sparse directed adjacency matrix from a group of time series following a causal graph process. Our solution is scalable for both dense and sparse graphs and automatically selects the…

Machine Learning · Statistics 2019-11-19 Théophile Griveau-Billion , Ben Calderhead

Model selection is of fundamental importance to high dimensional modeling featured in many contemporary applications. Classical principles of model selection include the Kullback-Leibler divergence principle and the Bayesian principle,…

Statistics Theory · Mathematics 2016-05-12 Jinchi Lv , Jun S. Liu

Learning theory has traditionally followed a model-centric approach, focusing on designing optimal algorithms for a fixed natural learning task (e.g., linear classification or regression). In this paper, we adopt a complementary…

Machine Learning · Computer Science 2025-04-29 Steve Hanneke , Shay Moran , Alexander Shlimovich , Amir Yehudayoff

In statistical modeling area, the Akaike information criterion AIC, is a widely known and extensively used tool for model choice. The {\phi}-divergence test statistic is a recently developed tool for statistical model selection. The…

Methodology · Statistics 2011-10-28 Papa Ngom , Bertrand Ntep

Linear mixed effects models are highly flexible in handling a broad range of data types and are therefore widely used in applications. A key part in the analysis of data is model selection, which often aims to choose a parsimonious model…

Methodology · Statistics 2013-06-12 Samuel Müller , J. L. Scealy , A. H. Welsh

We consider a general multi-armed bandit problem with correlated (and simple contextual and restless) elements, as a relaxed control problem. By introducing an entropy regularisation, we obtain a smooth asymptotic approximation to the value…

Optimization and Control · Mathematics 2022-09-07 Samuel N. Cohen , Tanut Treetanthiploet

The autoregressive process of order $p$ (AR($p$)) is a central model in time series analysis. A Bayesian approach requires the user to define a prior distribution for the coefficients of the AR($p$) model. Although it is easy to write down…

Methodology · Statistics 2016-09-01 Sigrunn Holbek Sørbye , Håvard Rue