English
Related papers

Related papers: Here Be Dragons: Bimodal posteriors arise from num…

200 papers

The prior distribution on parameters of a sampling distribution is the usual starting point for Bayesian uncertainty quantification. In this paper, we present a different perspective which focuses on missing observations as the source of…

Methodology · Statistics 2021-11-23 Edwin Fong , Chris Holmes , Stephen G. Walker

Most of the consistency analyses of Bayesian procedures for variable selection in regression refer to pairwise consistency, that is, consistency of Bayes factors. However, variable selection in regression is carried out in a given class of…

Methodology · Statistics 2015-07-30 Elías Moreno , Javier Girón , George Casella

A research frontier has emerged in scientific computation, wherein numerical error is regarded as a source of epistemic uncertainty that can be modelled. This raises several statistical challenges, including the design of statistical…

Machine Learning · Statistics 2017-10-19 François-Xavier Briol , Chris. J. Oates , Mark Girolami , Michael A. Osborne , Dino Sejdinovic

We present a physically inspired model for the problem of redshift estimation. Typically, redshift estimation has been treated as a regression problem that takes as input magnitudes and maps them to a single target redshift. In this work we…

Instrumentation and Methods for Astrophysics · Physics 2016-06-21 Sven D. Kugler , Nikolaos Gianniotis , Kai L. Polsterer

Modern large-scale statistical models require to estimate thousands to millions of parameters. This is often accomplished by iterative algorithms such as gradient descent, projected gradient descent or their accelerated versions. What are…

Machine Learning · Statistics 2020-03-04 Michael Celentano , Andrea Montanari , Yuchen Wu

The inverse problem methodology is a commonly-used framework in the sciences for parameter estimation and inference. It is typically performed by fitting a mathematical model to noisy experimental data. There are two significant sources of…

Numerical Analysis · Mathematics 2018-07-26 John T. Nardini , D. M. Bortz

A common task in experimental sciences is to fit mathematical models to real-world measurements to improve understanding of natural phenomenon (reverse-engineering or inverse modeling). When complex dynamical systems are considered, such as…

Numerical Analysis · Mathematics 2018-06-18 Jean-Charles Croix , Nicolas Durrande , Mauricio Alvarez

In this chapter, we address the challenge of exploring the posterior distributions of Bayesian inverse problems with computationally intensive forward models. We consider various multivariate proposal distributions, and compare them with…

Computation · Statistics 2024-05-02 Mikkel B. Lykkegaard , Colin Fox , Dave Higdon , C. Shane Reese , J. David Moulton

Bayesian inference for inverse problems hinges critically on the choice of priors. In the absence of specific prior information, population-level distributions can serve as effective priors for parameters of interest. With the advent of…

Instrumentation and Methods for Astrophysics · Physics 2025-02-11 Gabriel Missael Barco , Alexandre Adam , Connor Stone , Yashar Hezaveh , Laurence Perreault-Levasseur

Multimodal learning often outperforms its unimodal counterparts by exploiting unimodal contributions and cross-modal interactions. However, focusing only on integrating multimodal features into a unified comprehensive representation…

Machine Learning · Computer Science 2025-05-15 Sehwan Moon , Hyunju Lee

Current deep learning-based solutions for image analysis tasks are commonly incapable of handling problems to which multiple different plausible solutions exist. In response, posterior-based methods such as conditional Diffusion Models and…

The Hamiltonian Monte Carlo (HMC) method allows sampling from continuous densities. Favorable scaling with dimension has led to wide adoption of HMC by the statistics community. Modern auto-differentiating software should allow more…

Computation · Statistics 2022-08-17 Ian Langmore , Michael Dikovsky , Scott Geraedts , Peter Norgaard , Rob von Behren

In inverse problems, the parameters of a model are estimated based on observations of the model response. The Bayesian approach is powerful for solving such problems; one formulates a prior distribution for the parameter state that is…

Computation · Statistics 2022-06-08 Max Ehre , Rafael Flock , Martin Fußeder , Iason Papaioannou , Daniel Straub

In the application of Bayesian methods to metrology, pre-data probabilities play a critical role in the estimation of the model uncertainty. Following the observation that distributions form Riemann's manifolds, methods of differential…

Methodology · Statistics 2015-12-17 Giovanni Mana , Carlo Palmisano

Many inference problems involve inferring the number $N$ of components in some region, along with their properties $\{\mathbf{x}_i\}_{i=1}^N$, from a dataset $\mathcal{D}$. A common statistical example is finite mixture modelling. In the…

Computation · Statistics 2015-01-15 Brendon J. Brewer

In order to solve tasks like uncertainty quantification or hypothesis tests in Bayesian imaging inverse problems, we often have to draw samples from the arising posterior distribution. For the usually log-concave but high-dimensional…

Computation · Statistics 2025-01-23 Matthias J. Ehrhardt , Lorenz Kuger , Carola-Bibiane Schönlieb

We derive functional a posteriori error equalities and constant free two sided estimates for certain types of partial differential equations. The error is measured in a combined norm which takes into account both the primal and dual…

Analysis of PDEs · Mathematics 2015-12-29 Immanuel Anjam , Dirk Pauly

With the advent of structured data in the form of social networks, genetic circuits and protein interaction networks, statistical analysis of networks has gained popularity over recent years. Stochastic block model constitutes a classical…

Statistics Theory · Mathematics 2015-05-27 Debdeep Pati , Anirban Bhattacharya

The true posterior distribution of a Bayesian neural network is massively multimodal. Whilst most of these modes are functionally equivalent, we demonstrate that there remains a level of real multimodality that manifests in even the…

Machine Learning · Statistics 2022-05-24 David Yallup , Will Handley , Mike Hobson , Anthony Lasenby , Pablo Lemos

The derivative of a polynomial with all zeros on the unit circle has the zeros of its derivative on or inside the unit circle. It has been observed that in many cases the zeros of the derivative have a bimodal distribution: there are two…

Complex Variables · Mathematics 2025-02-20 David W. Farmer