English
Related papers

Related papers: On the large-sample limits of some Bayesian model …

200 papers

Approximate Bayesian computation (ABC) is a class of algorithmic methods in Bayesian inference using statistical summaries and computer simulations. ABC has become popular in evolutionary genetics and in other branches of biology. However…

Computation · Statistics 2011-05-03 Olivier Francois , Guillaume Laval

This paper considers the problem of approximating a density when it can be evaluated up to a normalizing constant at a limited number of points. We call this problem the Boltzmann approximation (BA) problem. The BA problem is ubiquitous in…

Methodology · Statistics 2020-10-08 Youngjun Choe , Yen-Chi Chen , Nick Terry

Double-descent refers to the unexpected drop in test loss of a learning algorithm beyond an interpolating threshold with over-parameterization, which is not predicted by information criteria in their classical forms due to the limitations…

Machine Learning · Computer Science 2023-11-15 Haobo Chen , Yuheng Bu , Gregory W. Wornell

Bayesian inference and the use of posterior or posterior predictive probabilities for decision making have become increasingly popular in clinical trials. The current practice in Bayesian clinical trials relies on a hybrid…

Methodology · Statistics 2024-04-30 Shirin Golchi , James Willard

Longitudinal data are common in clinical trials and observational studies, where missing outcomes due to dropouts are always encountered. Under such context with the assumption of missing at random, the weighted generalized estimating…

Methodology · Statistics 2019-04-30 Chixiang Chen , Biyi Shen , Lijun Zhang , Yuan Xue , Ming Wang

The Schwarz or Bayesian information criterion (BIC) is one of the most widely used tools for model comparison in social science research. The BIC however is not suitable for evaluating models with order constraints on the parameters of…

Methodology · Statistics 2019-05-01 Joris Mulder , Adrian E. Raftery

Model selection is crucial to high-dimensional learning and inference for contemporary big data applications in pinpointing the best set of covariates among a sequence of candidate interpretable models. Most existing work assumes implicitly…

Methodology · Statistics 2018-03-21 Emre Demirkaya , Yang Feng , Pallavi Basu , Jinchi Lv

Unmeasured covariates constitute one of the important problems in causal inference. Even if there are some unmeasured covariates, some instrumental variable methods such as a two-stage residual inclusion (2SRI) estimator, or a…

Methodology · Statistics 2021-12-30 Shunichiro Orihara

Typical Bayesian methods for models with latent variables (or random effects) involve directly sampling the latent variables along with the model parameters. In high-level software code for model definitions (using, e.g., BUGS, JAGS, Stan),…

Computation · Statistics 2022-12-12 E. C. Merkle , D. Furr , S. Rabe-Hesketh

Selecting the number of topics in LDA models is considered to be a difficult task, for which alternative approaches have been proposed. The performance of the recently developed singular Bayesian information criterion (sBIC) is evaluated…

Computation and Language · Computer Science 2023-02-17 Victor Bystrov , Viktoriia Naboka , Anna Staszewska-Bystrova , Peter Winker

In model selection literature, two classes of criteria perform well asymptotically in different situations: Bayesian information criterion (BIC) (as a representative) is consistent in selection when the true model is finite dimensional…

Statistics Theory · Mathematics 2012-02-03 Wei Liu , Yuhong Yang

Good large sample performance is typically a minimum requirement of any model selection criterion. This article focuses on the consistency property of the Bayes factor, a commonly used model comparison tool, which has experienced a recent…

Statistics Theory · Mathematics 2016-07-04 Siddhartha Chib , Todd A. Kuffner

Conventional likelihood-based information criteria for model selection rely on the distribution assumption of data. However, for complex data that are increasingly available in many scientific fields, the specification of their underlying…

Methodology · Statistics 2020-06-25 Chixiang Chen , Ming Wang , Rongling Wu , Runze Li

Model selection in linear regression models is a major challenge when dealing with high-dimensional data where the number of available measurements (sample size) is much smaller than the dimension of the parameter space. Traditional methods…

Signal Processing · Electrical Eng. & Systems 2023-07-05 Prakash B. Gohain , Magnus Jansson

Linear models with a growing number of parameters have been widely used in modern statistics. One important problem about this kind of model is the variable selection issue. Bayesian approaches, which provide a stochastic search of…

Statistics Theory · Mathematics 2012-02-03 Zuofeng Shang , Murray K. Clayton

This paper explores an approach to Bayesian sample size determination in clinical trials. The approach falls into the category of what is often called "proper Bayesian", in that it does not mix frequentist concepts with Bayesian ones. A…

Methodology · Statistics 2012-04-23 Robb J. Muirhead , Adina I. Soaita

In applications of Bayesian procedures, once a class of priors has been chosen, it may be tempting to fix the prior's hyperparameters from the data, in an empirical Bayes (EB) fashion, usually by their maximum marginal likelihood estimates…

Statistics Theory · Mathematics 2026-04-14 Stefano Rizzelli , Judith Rousseau , Sonia Petrone

The problem of model selection is considered for the setting of interpolating estimators, where the number of model parameters exceeds the size of the dataset. Classical information criteria typically consider the large-data limit,…

Machine Learning · Statistics 2026-01-13 Liam Hodgkinson , Chris van der Heide , Robert Salomone , Fred Roosta , Michael W. Mahoney

For predictive evaluation based on quasi-posterior distributions, we develop a new information criterion, the posterior covariance information criterion (PCIC. PCIC generalises the widely applicable information criterion WAIC so as to…

Methodology · Statistics 2023-01-26 Yukito Iba , Keisuke Yano

We marshall the arguments for preferring Bayesian hypothesis testing and confidence sets to frequentist ones. We define admissible solutions to inference problems, noting that Bayesian solutions are admissible. We give seven weaker…

Statistics Theory · Mathematics 2024-05-22 Roger Sewell