English
Related papers

Related papers: Advances in projection predictive inference

200 papers

Examples with bound information on the regression function and density abound in many real applications. We propose a novel approach for estimating such functions by incorporating the prior knowledge on the bounds. Specially, a Gaussian…

Methodology · Statistics 2018-10-30 Jize Zhang , Lizhen Lin

The application of Bayesian methods in cosmology and astrophysics has flourished over the past decade, spurred by data sets of increasing size and complexity. In many respects, Bayesian methods have proven to be vastly superior to more…

Astrophysics · Physics 2009-06-23 Roberto Trotta

We advocate for a new statistical principle that combines the most desirable aspects of both parameter inference and density estimation. This leads us to the predictively oriented (PrO) posterior, which expresses uncertainty as a…

The Bayesian statistical paradigm provides a principled and coherent approach to probabilistic forecasting. Uncertainty about all unknowns that characterize any forecasting problem -- model, parameters, latent states -- is able to be…

Bayesian inference methods are useful in infectious diseases modeling due to their capability to propagate uncertainty, manage sparse data, incorporate latent structures, and address high-dimensional parameter spaces. However, parameter…

Methodology · Statistics 2025-04-29 Xiahui Li , Fergus Chadwick , Ben Swallow

Constraints are a natural choice for prior information in Bayesian inference. In various applications, the parameters of interest lie on the boundary of the constraint set. In this paper, we use a method that implicitly defines a…

Statistics Theory · Mathematics 2022-09-27 Jasper Marijn Everink , Yiqiu Dong , Martin Skovgaard Andersen

The effect of bias on hypothesis formation is characterized for an automated data-driven projection pursuit neural network to extract and select features for binary classification of data streams. This intelligent exploratory process…

Machine Learning · Computer Science 2022-01-05 John Patterson , Chris Avery , Tyler Grear , Donald J. Jacobs

We introduce the concept of conjugate prior models for a given likelihood function in Bayesian spatial inversion. The conjugate class of prior models can be selection extended and still remain conjugate. We demonstrate the generality of…

Methodology · Statistics 2018-12-06 Henning Omre , Kjartan Rimstad

Artificial Intelligence systems cannot yet match human abilities to apply knowledge to situations that vary from what they have been programmed for, or trained for. In visual object recognition methods of inference exploiting top-down…

Artificial Intelligence · Computer Science 2022-05-18 Frank Guerin

The remarkable generalization performance of large-scale models has been challenging the conventional wisdom of the statistical learning theory. Although recent theoretical studies have shed light on this behavior in linear models and…

Machine Learning · Statistics 2024-06-18 Tomoya Wakayama

Deep neural networks have achieved impressive results on a wide variety of tasks. However, quantifying uncertainty in the network's output is a challenging task. Bayesian models offer a mathematical framework to reason about model…

Machine Learning · Computer Science 2019-05-28 Manikanta Srikar Yellapragada , Chandra Prakash Konkimalla

Experiments in research on memory, language, and in other areas of cognitive science are increasingly being analyzed using Bayesian methods. This has been facilitated by the development of probabilistic programming languages such as Stan,…

Methodology · Statistics 2020-03-02 Daniel J. Schad , Michael Betancourt , Shravan Vasishth

The large majority of inferences drawn in empirical political research follow from model-based associations (e.g. regression). Here, we articulate the benefits of predictive modeling as a complement to this approach. Predictive models aim…

Methodology · Statistics 2016-12-20 Skyler J. Cranmer , Bruce A. Desmarais

This paper provides a critical review of the Bayesian perspective of causal inference based on the potential outcomes framework. We review the causal estimands, identification assumptions, the general structure of Bayesian inference of…

Methodology · Statistics 2022-10-25 Fan Li , Peng Ding , Fabrizia Mealli

A key sticking point of Bayesian analysis is the choice of prior distribution, and there is a vast literature on potential defaults including uniform priors, Jeffreys' priors, reference priors, maximum entropy priors, and weakly informative…

Methodology · Statistics 2017-11-22 Andrew Gelman , Daniel Simpson , Michael Betancourt

A key step in the Bayesian workflow for model building is the graphical assessment of model predictions, whether these are drawn from the prior or posterior predictive distribution. The goal of these assessments is to identify whether the…

Methodology · Statistics 2025-03-04 Teemu Säilynoja , Andrew R. Johnson , Osvaldo A. Martin , Aki Vehtari

Bayesian optimization is an effective method for finding extrema of a black-box function. We propose a new type of Bayesian optimization for learning user preferences in high-dimensional spaces. The central assumption is that the underlying…

Machine Learning · Statistics 2020-08-17 Petrus Mikkola , Milica Todorović , Jari Järvi , Patrick Rinke , Samuel Kaski

Bayesian inference provides a rigorous framework to encapsulate our knowledge and uncertainty regarding various physical quantities in a well-defined and self-contained manner. Utilising modern tools, such Bayesian models can be constructed…

High Energy Physics - Lattice · Physics 2024-01-02 Julien Frison

Motivated by big data and the vast parameter spaces in modern machine learning models, optimisation approaches to Bayesian inference have seen a surge in popularity in recent years. In this paper, we address the connection between the…

Methodology · Statistics 2024-10-18 Lachlan Astfalck , Cassandra Bird , Daniel Williamson

Bayesian inference promises a framework for principled uncertainty quantification of neural network predictions. Barriers to adoption include the difficulty of fully characterizing posterior distributions on network parameters and the…

Machine Learning · Statistics 2025-01-22 Katharine Fisher , Youssef Marzouk