English
Related papers

Related papers: LOO and WAIC as Model Selection Methods for Polyto…

200 papers

Several instance-based explainability methods for finding influential training examples for test-time decisions have been proposed recently, including Influence Functions, TraceIn, Representer Point Selection, Grad-Dot, and Grad-Cos.…

Machine Learning · Computer Science 2021-11-09 Karthikeyan K , Anders Søgaard

The problem of representative selection amounts to sampling few informative exemplars from large datasets. This paper presents MOSAIC, a novel representative selection approach from high-dimensional data that may exhibit non-linear…

Machine Learning · Computer Science 2020-03-16 Mahlagha Sedghi , George Atia , Michael Georgiopoulos

The efficacy of family-based approaches to mixture model-based clustering and classification depends on the selection of parsimonious models. Current wisdom suggests the Bayesian information criterion (BIC) for mixture model selection.…

Methodology · Statistics 2013-11-12 Sakyajit Bhattacharya , Paul D. McNicholas

Importance Sampling (IS), an effective variance reduction strategy in Monte Carlo (MC) simulation, is frequently utilized for Bayesian inference and other statistical challenges. Quasi-Monte Carlo (QMC) replaces the random samples in MC…

Numerical Analysis · Mathematics 2024-03-19 Zhijian He , Hejin Wang , Xiaoqun Wang

The experiments covered by Machine Learning (ML) must consider two important aspects to assess the performance of a model: datasets and algorithms. Robust benchmarks are needed to evaluate the best classifiers. For this, one can adopt gold…

We go through the process of crafting a robust and numerically stable online algorithm for the computation of the Watanabe-Akaike information criteria (WAIC). We implement this algorithm in the NIMBLE software. The implementation is…

Computation · Statistics 2021-06-28 Joshua E. Hug , Christopher J. Paciorek

Most Item Response Theory (IRT) models for dichotomous responses are based on probit or logit link functions which assume a symmetric relationship between the probability of a correct response and the latent traits of individuals submitted…

Methodology · Statistics 2022-05-24 Flávio B. Gonçalves , Juliane Venturelli , Rosangela H. Loschi

The question of selecting the "best" amongst different choices is a common problem in statistics. In drug development, our motivating setting, the question becomes, for example: what is the dose that gives me a pre-specified risk of…

Statistics Theory · Mathematics 2018-03-15 Pavel Mozgunov , Thomas Jaki

Alignment has greatly improved large language models (LLMs)' output quality at the cost of diversity, yielding highly similar outputs across generations. We propose Base-Aligned Model Collaboration (BACo), an inference-time token-level…

Computation and Language · Computer Science 2025-11-11 Yichen Wang , Chenghao Yang , Tenghao Huang , Muhao Chen , Jonathan May , Mina Lee

Deep learning is renowned for its theory-practice gap, whereby principled theory typically fails to provide much beneficial guidance for implementation in practice. This has been highlighted recently by the benign overfitting phenomenon:…

Machine Learning · Statistics 2023-11-14 Liam Hodgkinson , Chris van der Heide , Robert Salomone , Fred Roosta , Michael W. Mahoney

The semiparametric estimation approach, which includes inverse-probability-weighted and doubly robust estimation using propensity scores, is a standard tool in causal inference, and it is rapidly being extended in various directions. On the…

Methodology · Statistics 2022-12-29 Takamichi Baba , Yoshiyuki Ninomiya

The goal of this paper is to compare several widely used Bayesian model selection methods in practical model selection problems, highlight their differences and give recommendations about the preferred approaches. We focus on the variable…

Methodology · Statistics 2017-12-18 Juho Piironen , Aki Vehtari

Item Response Theory (IRT) and Factor Analysis (FA) are two major frameworks used to model multi-item measurements of latent traits. While the relationship between two-parameter IRT models and dichotomized FA models is well established, IRT…

Methodology · Statistics 2025-07-03 Ján Pavlech , Patrícia Martinková

Using predictive adaptive arithmetic coding and the Minimum Description Length principle, we derive an efficient tool for model selection problems : the RIC information criterion. We then present an extension of these coding techniques to…

Methodology · Statistics 2007-05-23 Guilhem Coq , Olivier Alata , Marc Arnaudon , Christian Olivier

Item response theory (IRT) is a non-linear generative probabilistic paradigm for using exams to identify, quantify, and compare latent traits of individuals, relative to their peers, within a population of interest. In pre-existing…

Machine Learning · Computer Science 2019-12-06 Joshua C. Chang , Shashaank Vattikuti , Carson C. Chow

Assume that observations are generated from an infinite-order autoregressive [AR($\infty$)] process. Shibata [Ann. Statist. 8 (1980) 147--164] considered the problem of choosing a finite-order AR model, allowing the order to become infinite…

Statistics Theory · Mathematics 2007-06-13 Ching-Kang Ing , Ching-Zong Wei

Purpose: This study presents a Deep Learning (DL)-based quality assessment (QA) approach for evaluating auto-generated contours (auto-contours) in radiotherapy, with emphasis on Online Adaptive Radiotherapy (OART). Leveraging Bayesian…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Biling Wang , Austen Maniscalco , Ti Bai , Siqiu Wang , Michael Dohopolski , Mu-Han Lin , Chenyang Shen , Dan Nguyen , Junzhou Huang , Steve Jiang , Xinlei Wang

This work proposes a fully distributed improved weighted average consensus (IWAC and WAC-AE) technique applied to cooperative spectrum sensing problem in cognitive radio systems. This method allows the secondary users cooperate based on…

Signal Processing · Electrical Eng. & Systems 2018-10-08 Aislan Gabriel Hernandes , Mario Proenca Lemes Junior , Taufik Abrao

Given a random sample from a multivariate population, estimating the number of large eigenvalues of the population covariance matrix is an important problem in Statistics with wide applications in many areas. In the context of Principal…

Statistics Theory · Mathematics 2020-11-10 Abhinav Chakraborty , Soumendu Sundar Mukherjee , Arijit Chakrabarti

This paper develops new insights into quantitative methods for the validation of computational model prediction. Four types of methods are investigated, namely classical and Bayesian hypothesis testing, a reliability-based method, and an…

Data Analysis, Statistics and Probability · Physics 2012-06-25 You Ling , Sankaran Mahadevan