English
Related papers

Related papers: Conservative neural posterior estimation via distr…

200 papers

Simulation-based inference (SBI) offers a flexible and general approach to performing Bayesian inference: In SBI, a neural network is trained on synthetic data simulated from a model and used to rapidly infer posterior distributions for…

Machine Learning · Computer Science 2025-10-28 Julius Vetter , Manuel Gloeckler , Daniel Gedon , Jakob H. Macke

This paper presents a novel algorithmic study with extensive numerical experiments of distributionally robust multistage convex optimization (DR-MCO). Following the previous work on dual dynamic programming (DDP) algorithmic framework for…

Optimization and Control · Mathematics 2025-11-24 Shixuan Zhang , Xu Andy Sun

A key challenge in probabilistic regression is ensuring that predictive distributions accurately reflect true empirical uncertainty. Minimizing overall prediction error often encourages models to prioritize informativeness over calibration,…

Machine Learning · Statistics 2026-02-17 Ádám Jung , Domokos M. Kelen , András A. Benczúr

Deep neural networks (DNN) are prone to miscalibrated predictions, often exhibiting a mismatch between the predicted output and the associated confidence scores. Contemporary model calibration techniques mitigate the problem of…

Machine Learning · Computer Science 2022-12-21 Ramya Hebbalaguppe , Rishabh Patra , Tirtharaj Dash , Gautam Shroff , Lovekesh Vig

Likelihood-to-evidence ratio estimation is usually cast as either a binary (NRE-A) or a multiclass (NRE-B) classification task. In contrast to the binary classification framework, the current formulation of the multiclass version has an…

Machine Learning · Statistics 2024-07-08 Benjamin Kurt Miller , Christoph Weniger , Patrick Forré

FRAME (Filters, Random fields, And Maximum Entropy) is an energy-based descriptive model that synthesizes visual realism by capturing mutual patterns from structural input signals. The maximum likelihood estimation (MLE) is applied by…

Machine Learning · Computer Science 2019-01-17 Xu Cai , Yang Wu , Guanbin Li , Ziliang Chen , Liang Lin

In this work, we study how to ensure probabilistic safety for nonlinear systems under distributional ambiguity. Our approach builds on a backup-based safety filtering framework that switches between a high-performance nominal policy and a…

Robotics · Computer Science 2026-05-20 Daniel M. Cherenson , Haejoon Lee , Taekyung Kim , Dimitra Panagou

Neural PDE surrogates are often deployed in data-limited or partially observed regimes where downstream decisions depend on calibrated uncertainty in addition to low prediction error. Existing approaches obtain uncertainty through ensemble…

Machine Learning · Computer Science 2026-02-12 Carlos Stein Brito

Neural posterior estimation methods based on discrete normalizing flows have become established tools for simulation-based inference (SBI), but scaling them to high-dimensional problems can be challenging. Building on recent advances in…

Machine Learning · Computer Science 2023-10-30 Maximilian Dax , Jonas Wildberger , Simon Buchholz , Stephen R. Green , Jakob H. Macke , Bernhard Schölkopf

Safety is a critical concern in motion planning for autonomous vehicles. Modern autonomous vehicles rely on neural network-based perception, but making control decisions based on these inference results poses significant safety risks due to…

Robotics · Computer Science 2025-12-24 Hyeongchan Ham , Heejin Ahn

Machine learning algorithms minimizing average risk are susceptible to distributional shifts. Distributionally Robust Optimization (DRO) addresses this issue by optimizing the worst-case risk within an uncertainty set. However, DRO suffers…

Machine Learning · Computer Science 2023-11-10 Jiashuo Liu , Jiayun Wu , Tianyu Wang , Hao Zou , Bo Li , Peng Cui

Class imbalance induces systematic bias in deep neural networks by imposing a skewed effective class prior. This work introduces the Neural Prior Estimator (NPE), a framework that learns feature-conditioned log-prior estimates from latent…

Machine Learning · Computer Science 2026-02-23 Masoud Yavari , Payman Moallem

Task-free continual learning (CL) aims to learn a non-stationary data stream without explicit task definitions and not forget previous knowledge. The widely adopted memory replay approach could gradually become less effective for long data…

Machine Learning · Computer Science 2022-08-23 Zhenyi Wang , Li Shen , Le Fang , Qiuling Suo , Tiehang Duan , Mingchen Gao

Neural networks are being extensively used for modelling data, especially in the case where no likelihood can be formulated. Although in the case of X-ray spectral fitting, the likelihood is known, we aim to investigate the neural networks…

Instrumentation and Methods for Astrophysics · Physics 2024-02-22 Didier Barret , Simon Dupourqué

Deep neural networks (DNNs) are poorly calibrated when trained in conventional ways. To improve confidence calibration of DNNs, we propose a novel training method, distance-based learning from errors (DBLE). DBLE bases its confidence…

Machine Learning · Computer Science 2020-02-19 Chen Xing , Sercan Arik , Zizhao Zhang , Tomas Pfister

Current approaches in approximate inference for Bayesian neural networks minimise the Kullback-Leibler divergence to approximate the true posterior over the weights. However, this approximation is without knowledge of the final application,…

Machine Learning · Statistics 2018-05-11 Adam D. Cobb , Stephen J. Roberts , Yarin Gal

While traditional Deep Learning (DL) optimization methods treat all training samples equally, Distributionally Robust Optimization (DRO) adaptively assigns importance weights to different samples. However, a significant gap exists between…

A simulation is useful when the phenomenon of interest is either expensive to regenerate or irreproducible with the same context. Recently, Bayesian inference on the distribution of the simulation input parameter has been implemented…

Machine Learning · Computer Science 2022-11-07 Dongjun Kim , Kyungwoo Song , Seungjae Shin , Wanmo Kang , Il-Chul Moon , Weonyoung Joo

Density Ratio Estimation (DRE) is an important machine learning technique with many downstream applications. We consider the challenge of DRE with missing not at random (MNAR) data. In this setting, we show that using standard DRE methods…

Machine Learning · Statistics 2023-02-22 Josh Givens , Song Liu , Henry W J Reeve

Estimating uncertainty in deep learning models is critical for reliable decision-making in high-stakes applications such as medical imaging. Prior research has established that the difference between an input sample and its reconstructed…

Machine Learning · Computer Science 2026-01-28 Xinran Xu , Li Rong Wang , Xiuyi Fan