English
Related papers

Related papers: Neural Simulation-based Inference with Hierarchica…

200 papers

Stochastic differential equations (SDEs) provide a flexible framework for modeling temporal dynamics in partially observed systems. A central task is to calibrate such models from data, which requires inferring latent trajectories and…

Machine Learning · Statistics 2026-05-08 Yu Wang , Arnab Ganguly

In the past few years, approximate Bayesian Neural Networks (BNNs) have demonstrated the ability to produce statistically consistent posteriors on a wide range of inference problems at unprecedented speed and scale. However, any disconnect…

Cosmology and Nongalactic Astrophysics · Physics 2021-03-24 Sebastian Wagner-Carena , Ji Won Park , Simon Birrer , Philip J. Marshall , Aaron Roodman , Risa H. Wechsler

Inspired by the combination of feedforward and iterative computations in the virtual cortex, and taking advantage of the ability of denoising autoencoders to estimate the score of a joint distribution, we propose a novel approach to…

Computer Vision and Pattern Recognition · Computer Science 2017-08-22 Adriana Romero , Michal Drozdzal , Akram Erraqabi , Simon Jégou , Yoshua Bengio

Multi-level normal hierarchical models, also interpreted as mixed effects models, play an important role in developing statistical theory in multi-parameter estimation for a wide range of applications. In this article, we propose a novel…

Statistics Theory · Mathematics 2025-11-18 Aditi Sen , Masayo Y. Hirose , Partha Lahiri

Bayesian inference for high-dimensional inverse problems is computationally costly and requires selecting a suitable prior distribution. Amortized variational inference addresses these challenges via a neural network that approximates the…

Machine Learning · Statistics 2023-01-19 Ali Siahkoohi , Gabrio Rizzuti , Rafael Orozco , Felix J. Herrmann

Parametric stochastic simulators are ubiquitous in science, often featuring high-dimensional input parameters and/or an intractable likelihood. Performing Bayesian parameter inference in this context can be challenging. We present a neural…

Machine Learning · Statistics 2021-10-27 Benjamin Kurt Miller , Alex Cole , Patrick Forré , Gilles Louppe , Christoph Weniger

Inference for mechanistic models is challenging because of nonlinear interactions between model parameters and a lack of identifiability. Here we focus on a specific class of mechanistic models, which we term stable differential equations.…

Computation · Statistics 2017-12-13 Philip Maybank , Ingo Bojak , Richard G. Everitt

Detection of an image boundary when the pixel intensities are measured with noise is an important problem in image segmentation, with numerous applications in medical imaging and engineering. From a statistical point of view, the challenge…

Methodology · Statistics 2020-12-11 Nicholas Syring , Ryan Martin

Machine learning models are increasingly used to produce predictions that serve as input data in subsequent statistical analyses. For example, computer vision predictions of economic and environmental indicators based on satellite imagery…

Methodology · Statistics 2025-11-18 Dan M. Kluger , Kerri Lu , Tijana Zrnic , Sherrie Wang , Stephen Bates

For more than three years now we have been conducting a spectroscopic survey of detached eclipsing binaries (DEBs) from the All-Sky Automated Survey (ASAS) database. Thousands of high-resolution spectra of over 300 systems were secured, and…

Solar and Stellar Astrophysics · Physics 2015-03-02 K. G. Hełminiak , M. Konacki , M. Ratajczak , A. Jordán , N. Espinoza , R. Brahm , E. Kambe , N. Ukita

Simulation-based inference (SBI) enables amortized Bayesian inference by first training a neural posterior estimator (NPE) on prior-simulator pairs, typically through low-dimensional summary statistics, which can then be cheaply reused for…

Machine Learning · Statistics 2026-02-11 Sherman Khoo , Dennis Prangle , Song Liu , Mark Beaumont

Neural networks trained with standard objectives exhibit behaviors characteristic of probabilistic inference: soft clustering, prototype specialization, and Bayesian uncertainty tracking. These phenomena appear across architectures -- in…

Machine Learning · Computer Science 2026-01-01 Alan Oursland

The Probabilistic Value-Added Bright Galaxy Survey (PROVABGS) catalog will provide the posterior distributions of physical properties of $>10$ million DESI Bright Galaxy Survey (BGS) galaxies. Each posterior distribution will be inferred…

Astrophysics of Galaxies · Physics 2023-03-27 K. J. Kwon , ChangHoon Hahn , Justin Alsing

Retrieving the physical parameters from spectroscopic observations of exoplanets is key to understanding their atmospheric properties. Exoplanetary atmospheric retrievals are usually based on approximate Bayesian inference and rely on…

Earth and Planetary Astrophysics · Physics 2023-04-19 Malavika Vasist , François Rozet , Olivier Absil , Paul Mollière , Evert Nasedkin , Gilles Louppe

Simulation-based Bayesian inference (SBI) can be used to estimate the parameters of complex mechanistic models given observed model outputs without requiring access to explicit likelihood evaluations. A prime example for the application of…

Machine Learning · Computer Science 2022-11-28 Jonas Beck , Michael Deistler , Yves Bernaerts , Jakob Macke , Philipp Berens

We present an iterative framework to improve the amortized approximations of posterior distributions in the context of Bayesian inverse problems, which is inspired by loop-unrolled gradient descent methods and is theoretically grounded in…

Machine Learning · Computer Science 2023-05-16 Rafael Orozco , Ali Siahkoohi , Mathias Louboutin , Felix J. Herrmann

There has been significant progress in Bayesian inference based on sparsity-inducing (e.g., spike-and-slab and horseshoe-type) priors for high-dimensional regression models. The resulting posteriors, however, in general do not possess…

Econometrics · Economics 2025-12-11 Qihui Chen , Zheng Fang , Ruixuan Liu

Non-linear hierarchical models are commonly used in many disciplines. However, inference in the presence of non-nested effects and on large datasets is challenging and computationally burdensome. This paper provides two contributions to…

Methodology · Statistics 2021-10-22 Max Goplerud

We present the latest results of our spectroscopic observations and refined modelling of a sample of detached eclipsing binaries (DEBs), selected from the $Kepler$} Eclipsing Binary Catalog, that are also double-lined spectroscopic binaries…

Solar and Stellar Astrophysics · Physics 2019-01-03 K. G. Hełminiak , M. Konacki , H. Maehara , E. Kambe , N. Ukita , M. Ratajczak , A. Pigulski , S. K. Kozłowski

Context: New spectroscopic surveys will increase the number of astronomical objects requiring characterization by over tenfold.. Machine learning tools are required to address this data deluge in a fast and accurate fashion. Most machine…