English
Related papers

Related papers: Neural Posterior Estimation with Differentiable Si…

200 papers

Simulation-based inference has been popular for amortized Bayesian computation. It is typical to have more than one posterior approximation, from different inference algorithms, different architectures, or simply the randomness of…

Methodology · Statistics 2024-03-04 Yuling Yao , Bruno Régaldo-Saint Blancard , Justin Domke

Inferring the parameters of a stochastic model based on experimental observations is central to the scientific method. A particularly challenging setting is when the model is strongly indeterminate, i.e. when distinct sets of parameters…

Machine Learning · Statistics 2021-11-10 Pedro L. C. Rodrigues , Thomas Moreau , Gilles Louppe , Alexandre Gramfort

Scientists and engineers use simulators to model empirically observed phenomena. However, tuning the parameters of a simulator to ensure its outputs match observed data presents a significant challenge. Simulation-based inference (SBI)…

Simulation-based inference (SBI) methods tackle complex scientific models with challenging inverse problems. However, SBI models often face a significant hurdle due to their non-differentiable nature, which hampers the use of gradient-based…

Machine Learning · Computer Science 2023-06-29 Vincent D. Zaballa , Elliot E. Hui

We introduce a new method for learning Bayesian neural networks, treating them as a stack of multivariate Bayesian linear regression models. The main idea is to infer the layerwise posterior exactly if we know the target outputs of each…

Machine Learning · Computer Science 2024-11-20 Richard Kurle , Alexej Klushyn , Ralf Herbrich

Bayesian inference without the likelihood evaluation, or likelihood-free inference, has been a key research topic in simulation studies for gaining quantitatively validated simulation models on real-world datasets. As the likelihood…

Methodology · Statistics 2022-11-07 Dongjun Kim , Kyungwoo Song , YoonYeong Kim , Yongjin Shin , Wanmo Kang , Il-Chul Moon , Weonyoung Joo

In this work, we study TabPFN as a training-free, modular summary network for simulation-based Bayesian inference (SBI). Tabular foundation models such as TabPFN are pretrained on broad families of synthetic tabular data-generating…

Machine Learning · Computer Science 2026-05-11 Elliot Pickens , Chiraag Gohel , Sidharth Satya

We introduce a new amortized likelihood ratio estimator for likelihood-free simulation-based inference (SBI). Our estimator is simple to train and estimates the likelihood ratio using a single forward pass of the neural estimator. Our…

Machine Learning · Statistics 2023-11-20 Adam D. Cobb , Brian Matejek , Daniel Elenius , Anirban Roy , Susmit Jha

Many recent works in simulation-based inference (SBI) rely on deep generative models to approximate complex, high-dimensional posterior distributions. However, evaluating whether or not these approximations can be trusted remains a…

Machine Learning · Statistics 2023-10-11 Julia Linhart , Alexandre Gramfort , Pedro L. C. Rodrigues

When a statistical model $\{P_{\theta} : \theta \in \Theta\}$ lacks analytically tractable likelihoods, parametric statistical inference based on data generated from an unknown underlying distribution $P$ can still be performed as long as…

Methodology · Statistics 2026-05-19 Peter Matthew Jacobs , Lekha Patel , Anirban Bhattacharya , Debdeep Pati

Computer simulations have proven a valuable tool for understanding complex phenomena across the sciences. However, the utility of simulators for modelling and forecasting purposes is often restricted by low data quality, as well as…

Machine Learning · Statistics 2022-10-14 Daniel Ward , Patrick Cannon , Mark Beaumont , Matteo Fasiolo , Sebastian M Schmon

Bayesian inference allows machine learning models to express uncertainty. Current machine learning models use only a single learnable parameter combination when making predictions, and as a result are highly overconfident when their…

Machine Learning · Computer Science 2022-02-23 Andrew Wood , Moshik Hershcovitch , Daniel Waddington , Sarel Cohen , Peter Chin

We present multimodal neural posterior estimation (MultiNPE), a method to integrate heterogeneous data from different sources in simulation-based inference with neural networks. Inspired by advances in deep fusion, it allows researchers to…

Machine Learning · Computer Science 2024-11-05 Marvin Schmitt , Leona Odole , Stefan T. Radev , Paul-Christian Bürkner

Bayesian neural networks offer better estimates of model uncertainty compared to frequentist networks. However, inference involving Bayesian models requires multiple instantiations or sampling of the network parameters, requiring…

Neural and Evolutionary Computing · Computer Science 2024-01-30 Prabodh Katti , Anagha Nimbekar , Chen Li , Amit Acharyya , Bashir M. Al-Hashimi , Bipin Rajendran

Because many of our X-ray telescopes are optimized towards observing faint sources, observations of bright sources like X-ray binaries in outburst are often affected by instrumental biases. These effects include dead time and photon…

Instrumentation and Methods for Astrophysics · Physics 2021-12-22 D. Huppenkothen , M. Bachetti

Accurate null depth retrieval is critical in nulling interferometry. However, achieving accurate null depth calibration is challenging due to various noise sources, instrumental imperfections, and the complexity of real observational…

Instrumentation and Methods for Astrophysics · Physics 2025-11-14 Baoyi Zeng , Marc-Antoine Martinod , Denis Defrère

Scientific modeling and engineering applications rely heavily on parameter estimation methods to fit physical models and calibrate numerical simulations using real-world measurements. In the absence of analytic statistical models with…

Machine Learning · Computer Science 2024-09-30 Ruoxi Jiang , Peter Y. Lu , Rebecca Willett

How can one perform Bayesian inference on stochastic simulators with intractable likelihoods? A recent approach is to learn the posterior from adaptively proposed simulations using neural network-based conditional density estimators.…

Machine Learning · Computer Science 2019-05-21 David S. Greenberg , Marcel Nonnenmacher , Jakob H. Macke

Simulation plays a central role in scientific discovery. In many applications, the bottleneck is no longer running a simulator; it is choosing among large families of plausible simulators, each corresponding to different forward…

Bayesian neural networks (BNNs) offer uncertainty quantification but come with the downside of substantially increased training and inference costs. Sparse BNNs have been investigated for efficient inference, typically by either slowly…

Machine Learning · Computer Science 2024-02-20 Junbo Li , Zichen Miao , Qiang Qiu , Ruqi Zhang
‹ Prev 1 3 4 5 6 7 10 Next ›