English
Related papers

Related papers: Robust Inference and Model Criticism Using Bagged …

200 papers

Dynamic decision-making under model uncertainty is central to many economic environments, yet existing bandit and reinforcement learning algorithms rely on the assumption of correct model specification. This paper studies the behavior and…

Theoretical Economics · Economics 2026-02-20 Xinyu Dai , Daniel Chen , Yian Qian

Frequentist-style large-sample properties of Bayesian posterior distributions, such as consistency and convergence rates, are important considerations in nonparametric problems. In this paper we give an analysis of Bayesian asymptotics…

Statistics Theory · Mathematics 2012-10-02 Ryan Martin , Liang Hong

Clustering is widely studied in statistics and machine learning, with applications in a variety of fields. As opposed to classical algorithms which return a single clustering solution, Bayesian nonparametric models provide a posterior over…

Methodology · Statistics 2019-02-11 Sara Wade , Zoubin Ghahramani

Missing data is a common issue in various fields such as medicine, social sciences, and natural sciences, and it poses significant challenges for accurate statistical analysis. Although numerous imputation methods have been proposed to…

Methodology · Statistics 2025-07-23 Seongmin Kim , Jeunghun Oh , Hungkuk Ko , Jeongmin Park , Jaeyong Lee

Much is now known about the consistency of Bayesian updating on infinite-dimensional parameter spaces with independent or Markovian data. Necessary conditions for consistency include the prior putting enough weight on the correct…

Statistics Theory · Mathematics 2022-03-18 Cosma Rohilla Shalizi

Neural networks are popular state-of-the-art models for many different tasks.They are often trained via back-propagation to find a value of the weights that correctly predicts the observed data. Although back-propagation has shown good…

Machine Learning · Statistics 2020-12-29 Simón Rodríguez Santana , Daniel Hernández-Lobato

Models with dimension more than the available sample size are now commonly used in various applications. A sensible inference is possible using a lower-dimensional structure. In regression problems with a large number of predictors, the…

Statistics Theory · Mathematics 2025-11-25 Sayantan Banerjee , Ismaël Castillo , Subhashis Ghosal

Estimating causal effects from large experimental and observational data has become increasingly prevalent in both industry and research. The bootstrap is an intuitive and powerful technique used to construct standard errors and confidence…

Methodology · Statistics 2023-02-07 Matthew Kosko , Lin Wang , Michele Santacatterina

A natural way to quantify uncertainties in Gaussian mixture models (GMMs) is through Bayesian methods. That said, sampling from the joint posterior distribution of GMMs via standard Markov chain Monte Carlo (MCMC) imposes several…

Methodology · Statistics 2024-05-20 Santiago Marin , Bronwyn Loong , Anton H. Westveld

A stream of algorithmic advances has steadily increased the popularity of the Bayesian approach as an inference paradigm, both from the theoretical and applied perspective. Even with apparent successes in numerous application fields, a…

Methodology · Statistics 2020-07-10 Owen Thomas , Henri Pesonen , Jukka Corander

Clustering procedures typically estimate which data points are clustered together, a quantity of primary importance in many analyses. Often used as a preliminary step for dimensionality reduction or to facilitate interpretation, finding…

Methodology · Statistics 2017-12-06 Ryan Giordano , Runjing Liu , Nelle Varoquaux , Michael I. Jordan , Tamara Broderick

The Bayesian posterior minimizes the "inferential risk" which itself bounds the "predictive risk". This bound is tight when the likelihood and prior are well-specified. However since misspecification induces a gap, the Bayesian posterior…

Machine Learning · Computer Science 2022-05-24 Warren R. Morningstar , Alexander A. Alemi , Joshua V. Dillon

With the advent of high-performance computing, Bayesian methods are increasingly popular tools for the quantification of uncertainty throughout science and industry. Since these methods impact the making of sometimes critical decisions in…

Statistics Theory · Mathematics 2016-05-20 Houman Owhadi , Clint Scovel , Tim Sullivan

In this paper we revisit the weighted likelihood bootstrap, a method that generates samples from an approximate Bayesian posterior of a parametric model. We show that the same method can be derived, without approximation, under a Bayesian…

Methodology · Statistics 2018-05-23 Simon Lyddon , Chris Holmes , Stephen Walker

Estimating the parameters of mathematical models is a common problem in almost all branches of science. However, this problem can prove notably difficult when processes and model descriptions become increasingly complex and an explicit…

Machine Learning · Statistics 2024-02-09 Stefan T. Radev , Ulf K. Mertens , Andreas Voss , Lynton Ardizzone , Ullrich Köthe

Meta-analysis is a statistical method used in evidence synthesis for combining, analyzing and summarizing studies that have the same target endpoint and aims to derive a pooled quantitative estimate using fixed and random effects models or…

Methodology · Statistics 2022-04-25 Ivette Raices Cruz , Matthias C. M. Troffaes , Johan Lindström , Ullrika Sahlin

Uncertainty quantification is central to many applications of causal machine learning, yet principled Bayesian inference for causal effects remains challenging. Standard Bayesian approaches typically require specifying a probabilistic model…

Machine Learning · Statistics 2026-03-04 Emil Javurek , Dennis Frauen , Yuxin Wang , Stefan Feuerriegel

Analysing non-Gaussian spatial-temporal data requires introducing spatial as well as temporal dependence in generalised linear models through the link function of an exponential family distribution. Unlike in Gaussian likelihoods, inference…

Methodology · Statistics 2025-12-29 Soumyakanti Pan , Lu Zhang , Jonathan R. Bradley , Sudipto Banerjee

We propose a general framework for obtaining probabilistic solutions to PDE-based inverse problems. Bayesian methods are attractive for uncertainty quantification but assume knowledge of the likelihood model or data generation process. This…

Methodology · Statistics 2023-09-28 Youngsoo Baek , Wilkins Aquino , Sayan Mukherjee

This book chapter introduces regression approaches and regression adjustment for Approximate Bayesian Computation (ABC). Regression adjustment adjusts parameter values after rejection sampling in order to account for the imperfect match…

Methodology · Statistics 2017-07-06 Michael GB Blum