English
Related papers

Related papers: Bayesian Meta-Reasoning: Determining Model Adequac…

200 papers

Nested error regression models are useful tools for analysis of grouped data, especially in the case of small area estimation. This paper suggests a nested error regression model using uncertain random effects in which the random effect in…

Methodology · Statistics 2017-02-28 Shonosuke Sugasawa , Tatsuya Kubokawa

Bayesian learning is built on an assumption that the model space contains a true reflection of the data generating mechanism. This assumption is problematic, particularly in complex data environments. Here we present a Bayesian…

Machine Learning · Statistics 2018-11-05 S. P. Lyddon , S. G. Walker , C. C. Holmes

Replication studies are essential for assessing the credibility of claims from original studies. A critical aspect of designing replication studies is determining their sample size; a too small sample size may lead to inconclusive studies…

Methodology · Statistics 2023-08-14 Samuel Pawel , Guido Consonni , Leonhard Held

For many important problems the quantity of interest is an unknown function of the parameters, which is a random vector with known statistics. Since the dependence of the output on this random vector is unknown, the challenge is to identify…

Machine Learning · Statistics 2021-04-28 Themistoklis P. Sapsis

Empirical analysis serves as an important complement to theoretical analysis for studying practical Bayesian optimization. Often empirical insights expose strengths and weaknesses inaccessible to theoretical analysis. We define two metrics…

Machine Learning · Computer Science 2016-04-01 Ian Dewancker , Michael McCourt , Scott Clark , Patrick Hayes , Alexandra Johnson , George Ke

Design of experiments has traditionally relied on the frequentist hypothesis testing framework where the optimal size of the experiment is specified as the minimum sample size that guarantees a required level of power. Sample size…

Methodology · Statistics 2025-08-07 Shirin Golchi , Luke Hagar

Traditionally Bayesian decision-theoretic design of experiments proceeds by choosing a design to minimise expectation of a given loss function over the space of all designs. The loss function encapsulates the aim of the experiment, and the…

Methodology · Statistics 2021-08-10 Antony M. Overstall , James M. McGree

The vast majority of stochastic simulation models are imperfect in that they fail to exactly emulate real system dynamics. The inexactness of the simulation model, or model discrepancy, can impact the predictive accuracy and usefulness of…

Methodology · Statistics 2017-07-21 Matthew Plumlee , Henry Lam

We provide a brief overview of both Bayes and classical model selection. We argue tentatively that model selection has at least two major goals, that of finding the correct model or predicting well, and that in general both these goals may…

Statistics Theory · Mathematics 2015-10-05 Ritabrata Dutta , Malgortaza Bogdan , Jayanta K. Ghosh

We present a procedure to diagnose model misspecification in situations where inference is performed using approximate Bayesian computation. We demonstrate theoretically, and empirically that this procedure can consistently detect the…

Methodology · Statistics 2022-10-25 Andrés Ramírez-Hassan , David T. Frazier

In this paper we propose a Bayesian answer to testing problems when the hypotheses are not well separated. The idea of the method is to study the posterior distribution of a discrepancy measure between the parameter and the model we want to…

Statistics Theory · Mathematics 2017-06-28 Jean-Bernard Salomond

When we use the normal mixture model, the optimal number of the components describing the data should be determined. Testing homogeneity is good for this purpose; however, to construct its theory is challenging, since the test statistic…

Statistics Theory · Mathematics 2019-12-24 Natsuki Kariya , Sumio Watanabe

Tests of goodness of fit are used in nearly every domain where statistics is applied. One powerful and flexible approach is to sample artificial data sets that are exchangeable with the real data under the null hypothesis (but not under the…

Methodology · Statistics 2026-04-07 Ritwik Bhaduri , Aabesh Bhattacharyya , Rina Foygel Barber , Lucas Janson

Despite their importance in supporting experimental conclusions, standard statistical tests are often inadequate for research areas, like the life sciences, where the typical sample size is small and the test assumptions difficult to…

Methodology · Statistics 2011-04-15 Pietro Berkes , Jozsef Fiser

Estimation frameworks for statistical inference are preferred to hypothesis testing when quantifying uncertainty and precise estimation are more valuable than binary decisions about statistical significance. Study design for…

Methodology · Statistics 2025-10-29 Luke Hagar , Nathaniel T. Stevens

The Bayesian approach to data analysis provides a powerful way to handle uncertainty in all observations, model parameters, and model structure using probability theory. Probabilistic programming languages make it easier to specify and fit…

Modern imaging techniques heavily rely on Bayesian statistical models to address difficult image reconstruction and restoration tasks. This paper addresses the objective evaluation of such models in settings where ground truth is…

Image and Video Processing · Electrical Eng. & Systems 2026-05-29 Tom Sprunck , Marcelo Pereyra , Tobias Liaudat

Quantitative properties of stochastic systems are usually specified in logics that allow one to compare the measure of executions satisfying certain temporal properties with thresholds. The model checking problem for stochastic systems with…

Logic in Computer Science · Computer Science 2010-05-11 Axel Legay , Benoit Delahaye

Bayesian hypothesis testing is re-examined from the perspective of an a priori assessment of the test statistic distribution under the alternative. By assessing the distribution of an observable test statistic, rather than prior parameter…

Statistics Theory · Mathematics 2018-08-28 Hedibert F. Lopes , Nicholas G. Polson

The two key issues of modern Bayesian statistics are: (i) establishing principled approach for distilling statistical prior that is consistent with the given data from an initial believable scientific prior; and (ii) development of a…

Methodology · Statistics 2018-04-18 Subhadeep , Mukhopadhyay , Douglas Fletcher