English
Related papers

Related papers: Addressing prior dependence in hierarchical Bayesi…

200 papers

The remarkable generalization performance of large-scale models has been challenging the conventional wisdom of the statistical learning theory. Although recent theoretical studies have shed light on this behavior in linear models and…

Machine Learning · Statistics 2024-06-18 Tomoya Wakayama

Deterministic neural operators perform well on many PDEs but can struggle with the approximation of high-frequency wave phenomena, where strong input-to-output sensitivity makes operator learning challenging, and spectral bias blurs…

Machine Learning · Computer Science 2026-02-05 Yicheng Zou , Samuel Lanthaler , Hossein Salahshoor

High-dimensional data analysis using traditional models suffers from overparameterization. Two types of techniques are commonly used to reduce the number of parameters - regularization and dimension reduction. In this project, we combine…

Methodology · Statistics 2026-03-26 Xialu Liu , Xin Wang

Modeling real-world distributions can often be challenging due to sample data that are subjected to perturbations, e.g., instrumentation errors, or added random noise. Since flow models are typically nonlinear algorithms, they amplify these…

Machine Learning · Computer Science 2022-10-11 Sameera Ramasinghe , Kasun Fernando , Salman Khan , Nick Barnes

The increased availability of observation data from engineering systems in operation poses the question of how to incorporate this data into finite element models. To this end, we propose a novel statistical construction of the finite…

Methodology · Statistics 2021-01-25 Mark Girolami , Eky Febrianto , Ge Yin , Fehmi Cirak

High-precision pulsar timing is central to a wide range of astrophysics and fundamental physics applications. When timing an ensemble of millisecond pulsars in different sky positions, known as a pulsar timing array (PTA), one can search…

Instrumentation and Methods for Astrophysics · Physics 2018-10-09 R. N. Caballero

Neural posterior estimation (NPE), a simulation-based computational approach for Bayesian inference, has shown great success in approximating complex posterior distributions. Existing NPE methods typically rely on normalizing flows, which…

Machine Learning · Statistics 2025-03-14 Tianyu Chen , Vansh Bansal , James G. Scott

Variational mean field approximations tend to struggle with contemporary overparametrized deep neural networks. Where a Bayesian treatment is usually associated with high-quality predictions and uncertainties, the practical reality has been…

We propose a new Neural Galerkin Normalizing Flow framework to approximate the transition probability density function of a diffusion process by solving the corresponding Fokker-Planck equation with an atomic initial distribution,…

Machine Learning · Computer Science 2026-03-20 Riccardo Saporiti , Fabio Nobile

Simulation-based inference (SBI) offers a flexible and general approach to performing Bayesian inference: In SBI, a neural network is trained on synthetic data simulated from a model and used to rapidly infer posterior distributions for…

Machine Learning · Computer Science 2025-10-28 Julius Vetter , Manuel Gloeckler , Daniel Gedon , Jakob H. Macke

We present a hierarchical Bayesian learning approach to infer jointly sparse parameter vectors from multiple measurement vectors. Our model uses separate conditionally Gaussian priors for each parameter vector and common gamma-distributed…

Machine Learning · Statistics 2024-05-27 Jan Glaubitz , Anne Gelb

Identifying the parameters of a model and rating competitive models based on measured data has been among the most important but challenging topics in modern science and engineering, with great potential of application in structural system…

Computation · Statistics 2017-08-02 F. A. DiazDelaO , A. Garbuno-Inigo , S. K. Au , I. Yoshida

A novel method is proposed to infer Bayesian predictions of computationally expensive models. The method is based on the construction of quadrature rules, which are well-suited for approximating the weighted integrals occurring in Bayesian…

Numerical Analysis · Mathematics 2020-06-09 L. M. M. van den Bos , B. Sanderse , W. A. A. M. Bierbooms

We present a Bayesian hierarchical framework for a principled data analysis pipeline of peculiar velocity surveys, which makes explicit the inference problem of constraining cosmological parameters from redshift-independent distance…

Cosmology and Nongalactic Astrophysics · Physics 2020-07-24 Lawrence Dam

Many Bayesian network modelling applications suffer from the issue of data scarcity. Hence the use of expert judgement often becomes necessary to determine the parameters of the conditional probability tables (CPTs) throughout the network.…

Methodology · Statistics 2025-10-02 Kieran Drury , Martine J. Barons , Jim Q. Smith

A central theme in classical algorithms for the reconstruction of discontinuous functions from observational data is perimeter regularization via the use of the total variation. On the other hand, sparse or noisy data often demands a…

Optimization and Control · Mathematics 2020-04-13 Oliver R. A. Dunbar , Matthew M. Dunlop , Charles M. Elliott , Viet Ha Hoang , Andrew M. Stuart

We introduce repriorisation, a data-dependent reparameterisation which transforms a Bayesian neural network (BNN) posterior to a distribution whose KL divergence to the BNN prior vanishes as layer widths grow. The repriorisation map acts…

Machine Learning · Statistics 2022-06-16 Jiri Hron , Roman Novak , Jeffrey Pennington , Jascha Sohl-Dickstein

This article addresses the issue of estimating observation parameters (response and error parameters) in inverse problems. The focus is on cases where regularization is introduced in a Bayesian framework and the prior is modeled by a…

Machine Learning · Statistics 2026-02-13 Jean-François Giovannelli

Maximum a posteriori (MAP) estimation, like all Bayesian methods, depends on prior assumptions. These assumptions are often chosen to promote specific features in the recovered estimate. The form of the chosen prior determines the shape of…

Methodology · Statistics 2022-11-15 Zilai Si , Yucong Liu , Alexander Strang

Variable selection and classification are common objectives in the analysis of high-dimensional data. Most such methods make distributional assumptions that may not be compatible with the diverse families of distributions data can take. A…

Methodology · Statistics 2019-08-28 Weichang Yu , Lamiae Azizi , John T. Ormerod