English
Related papers

Related papers: JANA: Jointly Amortized Neural Approximation of Co…

200 papers

Selection bias arises when the probability that an observation enters a dataset depends on variables related to the quantities of interest, leading to systematic distortions in estimation and uncertainty quantification. For example, in…

Amortized Bayesian inference (ABI) offers fast, scalable approximations to posterior densities by training neural surrogates on data simulated from the statistical model. However, ABI methods are highly sensitive to model misspecification:…

Machine Learning · Statistics 2026-01-27 Šimon Kucharský , Aayush Mishra , Daniel Habermann , Stefan T. Radev , Paul-Christian Bürkner

Due to their uncertainty quantification, Bayesian solutions to inverse problems are the framework of choice in applications that are risk averse. These benefits come at the cost of computations that are in general, intractable. New advances…

Machine Learning · Computer Science 2024-05-10 Rafael Orozco , Ali Siahkoohi , Mathias Louboutin , Felix J. Herrmann

Bayesian inference for complex models with an intractable likelihood can be tackled using algorithms performing many calls to computer simulators. These approaches are collectively known as "simulation-based inference" (SBI). Recent SBI…

We propose a model-based lifelong reinforcement-learning approach that estimates a hierarchical Bayesian posterior distilling the common structure shared across different tasks. The learned posterior combined with a sample-based Bayesian…

Machine Learning · Computer Science 2022-10-24 Haotian Fu , Shangqun Yu , Michael Littman , George Konidaris

We introduce a numerically tractable formulation of Bayesian joint models for longitudinal and survival data. The longitudinal process is modelled using generalised linear mixed models, while the survival process is modelled using a…

Methodology · Statistics 2021-04-23 Danilo Alvares , Francisco Javier Rubio

Laplace approximation (LA) and its linearized variant (LLA) enable effortless adaptation of pretrained deep neural networks to Bayesian neural networks. The generalized Gauss-Newton (GGN) approximation is typically introduced to improve…

Machine Learning · Computer Science 2022-10-25 Zhijie Deng , Feng Zhou , Jun Zhu

We propose the approximate Laplace approximation (ALA) to evaluate integrated likelihoods, a bottleneck in Bayesian model selection. The Laplace approximation (LA) is a popular tool that speeds up such computation and equips strong model…

Computation · Statistics 2021-10-07 David Rossell , Oriol Abril , Anirban Bhattacharya

In modern biomedical and econometric studies, longitudinal processes are often characterized by complex time-varying associations and abrupt regime shifts that are shared across correlated outcomes. Standard functional data analysis (FDA)…

Methodology · Statistics 2026-01-28 Baolin Chen , Mengfei Ran

Variational methods that rely on a recognition network to approximate the posterior of directed graphical models offer better inference and learning than previous methods. Recent advances that exploit the capacity and flexibility in this…

Machine Learning · Computer Science 2018-02-21 R Devon Hjelm , Kyunghyun Cho , Junyoung Chung , Russ Salakhutdinov , Vince Calhoun , Nebojsa Jojic

Bayesian decision theory provides an elegant framework for acting optimally under uncertainty when tractable posterior distributions are available. Modern Bayesian models, however, typically involve intractable posteriors that are…

Machine Learning · Computer Science 2021-06-15 Meet P. Vadera , Soumya Ghosh , Kenney Ng , Benjamin M. Marlin

A new generative adversarial network is developed for joint distribution matching. Distinct from most existing approaches, that only learn conditional distributions, the proposed model aims to learn a joint distribution of multiple random…

Machine Learning · Computer Science 2018-06-11 Yunchen Pu , Shuyang Dai , Zhe Gan , Weiyao Wang , Guoyin Wang , Yizhe Zhang , Ricardo Henao , Lawrence Carin

We revisit the problem of generating synthetic data under differential privacy. To address the core limitations of marginal-based methods, we propose the Private Adaptive Generative Adversarial Network with Bayes Network Structure…

Machine Learning · Statistics 2025-11-12 Ke Jia , Yuheng Ma , Yang Li , Feifei Wang

Many critical applications, from autonomous scientific discovery to personalized medicine, demand systems that can both strategically acquire the most informative data and instantaneously perform inference based upon it. While amortized…

Machine Learning · Statistics 2025-10-22 Daolang Huang , Xinyi Wen , Ayush Bharti , Samuel Kaski , Luigi Acerbi

Conformal prediction provides machine learning models with prediction sets that offer theoretical guarantees, but the underlying assumption of exchangeability limits its applicability to time series data. Furthermore, existing approaches…

Machine Learning · Statistics 2025-05-30 Eshant English , Eliot Wong-Toi , Matteo Fontana , Stephan Mandt , Padhraic Smyth , Christoph Lippert

Neural Posterior Estimation (NPE) enables rapid parameter inference for complex simulators with intractable likelihoods. NPE trains an inference network to estimate a probability density over parameters given data, typically assumed to be…

Machine Learning · Computer Science 2026-05-14 Jan Boelts , Cornelius Schröder , Jonas Beck , Jakob H. Macke , Michael Deistler , Daniel Gedon

Amortized Bayesian Inference (ABI) enables efficient posterior estimation using generative neural networks trained on simulated data, but often suffers from performance degradation under model misspecification. While self-consistency (SC)…

Machine Learning · Statistics 2026-02-27 Aayush Mishra , Šimon Kucharský , Paul-Christian Bürkner

Adversarial examples are crafted with imperceptible perturbations with the intent to fool neural networks. Against such attacks, adversarial training and its variants stand as the strongest defense to date. Previous studies have pointed out…

Computer Vision and Pattern Recognition · Computer Science 2020-01-30 Alvin Chan , Yi Tay , Yew Soon Ong , Jie Fu

Bayesian predictive inference propagates parameter uncertainty to quantities of interest through the posterior-predictive distribution. In practice, this is typically performed using a two-stage procedure: first approximating the posterior…

Machine Learning · Statistics 2026-05-06 Nan Feng , Xun Huan

Bayesian Neural Networks provide a principled framework for uncertainty quantification by modeling the posterior distribution of network parameters. However, exact posterior inference is computationally intractable, and widely used…

Machine Learning · Computer Science 2025-12-02 Alfredo Reichlin , Miguel Vasco , Danica Kragic