English
Related papers

Related papers: Checking for prior-data conflict using prior to po…

200 papers

We distinguish two questions (i) how much information does the prior contain? and (ii) what is the effect of the prior? Several measures have been proposed for quantifying effective prior sample size, for example Clarke [1996] and Morita et…

Methodology · Statistics 2020-01-30 David E Jones , Robert N Trangucci , Yang Chen

There are things we know, things we know we don't know, and then there are things we don't know we don't know. In this paper we address the latter two issues in a Bayesian framework, introducing the notion of doubt to quantify the degree of…

Data Analysis, Statistics and Probability · Physics 2008-11-18 Glenn D Starkman , Roberto Trotta , Pascal M Vaudrevange

In computational inverse problems, it is common that a detailed and accurate forward model is approximated by a computationally less challenging substitute. The model reduction may be necessary to meet constraints in computing time when…

Methodology · Statistics 2018-02-14 Daniela Calvetti , Matthew M. Dunlop , Erkki Somersalo , Andrew M. Stuart

Pre-validation is a way to build prediction model with two datasets of significantly different feature dimensions. Previous work showed that the asymptotic distribution of the resulting test statistic for the pre-validated predictor…

Methodology · Statistics 2025-05-23 Jing Shang , Sourav Chatterjee , Trevor Hastie , Robert Tibshirani

We study the posterior distribution of the Bayesian multiple change-point regression problem when the number and the locations of the change-points are unknown. While it is relatively easy to apply the general theory to obtain the…

Statistics Theory · Mathematics 2008-08-21 Heng Lian

Bayesian model comparison relies upon the model evidence, yet for many models of interest the model evidence is unavailable in closed form and must be approximated. Many of the estimators for evidence that have been proposed in the Monte…

Methodology · Statistics 2014-05-02 Chris J. Oates , Theodore Papamarkou , Mark Girolami

This paper deals with Bayesian inference of a mixture of Gaussian distributions. A novel formulation of the mixture model is introduced, which includes the prior constraint that each Gaussian component is always assigned a minimal number of…

Methodology · Statistics 2014-05-21 Colin J. Stoneking

When constructing a model to estimate the causal effect of a treatment, it is necessary to control for other factors which may have confounding effects. Because the ignorability assumption is not testable, however, it is usually unclear…

Methodology · Statistics 2022-09-07 Spencer Woody , Carlos M. Carvalho , Jared S. Murray

New proposed models are often compared to state-of-the-art using statistical significance testing. Literature is scarce for classifier comparison using metrics other than accuracy. We present a survey of statistical methods that can be used…

Machine Learning · Computer Science 2016-11-17 Lovedeep Gondara

The prior distribution on parameters of a sampling distribution is the usual starting point for Bayesian uncertainty quantification. In this paper, we present a different perspective which focuses on missing observations as the source of…

Methodology · Statistics 2021-11-23 Edwin Fong , Chris Holmes , Stephen G. Walker

We consider a prior for nonparametric Bayesian estimation which uses finite random series with a random number of terms. The prior is constructed through distributions on the number of basis functions and the associated coefficients. We…

Statistics Theory · Mathematics 2015-02-10 Weining Shen , Subhashis Ghosal

In certain applications involving the solution of a Bayesian inverse problem, it may not be possible or desirable to evaluate the full posterior, e.g. due to the high computational cost of doing so. This problem motivates the use of…

Statistics Theory · Mathematics 2024-02-27 Han Cheng Lie , T. J. Sullivan , Aretha Teckentrup

Bayesian inference affords scientists with powerful tools for testing hypotheses. One of these tools is the Bayes factor, which indexes the extent to which support for one hypothesis over another is updated after seeing the data. Part of…

Computation · Statistics 2018-12-11 Thomas J. Faulkenberry

Model uncertainty is pervasive in real world analysis situations and is an often-neglected issue in applied statistics. However, standard approaches to the research process do not address the inherent uncertainty in model building and,…

Methodology · Statistics 2024-03-01 Mariana Nold , Florian Meinfelder , David Kaplan

While previous distribution shift detection approaches can identify if a shift has occurred, these approaches cannot localize which specific features have caused a distribution shift -- a critical step in diagnosing or fixing any underlying…

Machine Learning · Computer Science 2021-07-16 Sean Kulinski , Saurabh Bagchi , David I. Inouye

When computer codes are used for modeling complex physical systems, their unknown parameters are tuned by calibration techniques. A discrepancy function may be added to the computer code in order to capture its discrepancy with the real…

Methodology · Statistics 2019-03-11 Kaniav Kamary , Merlin Keller , Pierre Barbillon , Cédric Gœury , Éric Parent

Optimization constrained by high-fidelity computational models has potential for transformative impact. However, such optimization is frequently unattainable in practice due to the complexity and computational intensity of the model. An…

Numerical Analysis · Mathematics 2024-06-04 Joseph Hart , Bart van Bloemen Waanders

Hypothesis testing in high dimensional data is a notoriously difficult problem without direct access to competing models' likelihood functions. This paper argues that statistical divergences can be used to quantify the difference between…

Data Analysis, Statistics and Probability · Physics 2024-08-02 Jeremy J. H. Wilkinson , Christopher G. Lester

Conformal prediction has emerged as a cutting-edge methodology in statistics and machine learning, providing prediction intervals with finite-sample frequentist coverage guarantees. Yet, its interplay with Bayesian statistics, often…

Methodology · Statistics 2026-03-27 Nina Deliu , Brunero Liseo

Usually one compares the accuracy of two competing classifiers via null hypothesis significance tests (nhst). Yet the nhst tests suffer from important shortcomings, which can be overcome by switching to Bayesian hypothesis testing. We…

Machine Learning · Computer Science 2016-11-23 Giorgio Corani , Alessio Benavoli , Janez Demšar , Francesca Mangili , Marco Zaffalon