English
Related papers

Related papers: Robust posterior inference when statistically emul…

200 papers

Distribution shifts are ubiquitous in real-world machine learning applications, posing a challenge to the generalization of models trained on one data distribution to another. We focus on scenarios where data distributions vary across…

Machine Learning · Statistics 2024-06-05 Steven Wilkins-Reeves , Xu Chen , Qi Ma , Christine Agarwal , Aude Hofleitner

Foundation models are a current focus of attention in both industry and academia. While they have shown their capabilities in a variety of tasks, in-depth research is required to determine their robustness to distribution shift when used as…

Computation and Language · Computer Science 2023-12-12 Xiruo Ding , Zhecheng Sheng , Brian Hur , Feng Chen , Serguei V. S. Pakhomov , Trevor Cohen

This paper focuses on a challenging class of inverse problems that is often encountered in applications. The forward model is a complex non-linear black-box, potentially non-injective, whose outputs cover multiple decades in amplitude.…

Markov chain Monte Carlo (MCMC) algorithms provide a very general recipe for estimating properties of complicated distributions. While their use has become commonplace and there is a large literature on MCMC theory and practice, MCMC users…

Computation · Statistics 2012-05-03 Murali Haran , Luke Tierney

We analyze a lightweight simulation-based inference method that infers simulator parameters using only a regression-based projection of the observed data. After fitting a surrogate linear regression once, the procedure simulates small…

Methodology · Statistics 2026-02-04 Arya Farahi , Jonah Rose , Paul Torrey

Cosmological simulations play a crucial role in elucidating the effect of physical parameters on the statistics of fields and on constraining parameters given information on density fields. We leverage diffusion generative models to address…

Cosmology and Nongalactic Astrophysics · Physics 2023-12-13 Nayantara Mudur , Carolina Cuesta-Lazaro , Douglas P. Finkbeiner

This paper proposes a novel robust Model Predictive Control (MPC) scheme for linear discrete-time systems affected by model uncertainty described by interval matrices. The key feature of the proposed method is a bound on the uncertainty…

Systems and Control · Electrical Eng. & Systems 2026-02-20 Renato Quartullo , Andrea Garulli , Mirko Leomanni

In order to probe modifications of gravity at cosmological scales, one needs accurate theoretical predictions. N-body simulations are required to explore the non-linear regime of structure formation but are very time consuming. In this…

Cosmology and Nongalactic Astrophysics · Physics 2024-10-24 Iñigo Sáez-Casares , Yann Rasera , Baojiu Li

Recent advancements in Markov chain Monte Carlo (MCMC) sampling and surrogate modelling have significantly enhanced the feasibility of Bayesian analysis across engineering fields. However, the selection and integration of surrogate models…

Computational Physics · Physics 2024-11-22 Leon Riccius , Iuri B. C. M. Rocha , Joris Bierkens , Hanne Kekkonen , Frans P. van der Meer

An advantage of methods that base inference on a posterior distribution is that credible regions are readily obtained. Except in well-specified situations, however, there is no guarantee that such regions will achieve the nominal…

Methodology · Statistics 2019-06-28 Nicholas Syring , Ryan Martin

Inverse problems defined on the sphere arise in many fields, including seismology and cosmology where problems are defined on the globe and the cosmic sphere. These are generally high-dimensional and computationally very complex and, as a…

Data Analysis, Statistics and Probability · Physics 2023-01-05 Augustin Marignier , Jason D. McEwen , Ana M. G. Ferreira , Thomas D. Kitching

We present a Reinforcement Learning-based Robust Nonlinear Model Predictive Control (RL-RNMPC) framework for controlling nonlinear systems in the presence of disturbances and uncertainties. An approximate Robust Nonlinear Model Predictive…

Systems and Control · Electrical Eng. & Systems 2021-04-08 Hossein Nejatbakhsh Esfahani , Arash Bahari Kordabad , Sebastien Gros

Bayesian deep learning counts on the quality of posterior distribution estimation. However, the posterior of deep neural networks is highly multi-modal in nature, with local modes exhibiting varying generalization performance. Given a…

Machine Learning · Computer Science 2024-03-27 Bolian Li , Ruqi Zhang

Imitation Learning (IL) can generate computationally efficient policies from demonstrations provided by Model Predictive Control (MPC). However, IL methods often require extensive data-collection and training efforts, limiting changes to…

Robotics · Computer Science 2024-07-09 Andrea Tagliabue , Jonathan P. How

Transfer learning assumes classifiers of similar tasks share certain parameter structures. Unfortunately, modern classifiers uses sophisticated feature representations with huge parameter spaces which lead to costly transfer. Under the…

Machine Learning · Statistics 2015-10-20 Song Liu , Kenji Fukumizu

We report the application of implicit likelihood inference to the prediction of the macro-parameters of strong lensing systems with neural networks. This allows us to perform deep learning analysis of lensing systems within a well-defined…

Instrumentation and Methods for Astrophysics · Physics 2023-01-25 Ronan Legin , Yashar Hezaveh , Laurence Perreault-Levasseur , Benjamin Wandelt

We introduce Preconditioned Monte Carlo (PMC), a novel Monte Carlo method for Bayesian inference that facilitates efficient sampling of probability distributions with non-trivial geometry. PMC utilises a Normalising Flow (NF) in order to…

Instrumentation and Methods for Astrophysics · Physics 2022-08-24 Minas Karamanis , Florian Beutler , John A. Peacock , David Nabergoj , Uros Seljak

Computing the inverse covariance matrix (or precision matrix) of large data vectors is crucial in weak lensing (and multi-probe) analyses of the large scale structure of the universe. Analytically computed covariances are noise-free and…

Instrumentation and Methods for Astrophysics · Physics 2017-12-06 Oliver Friedrich , Tim Eifler

Approximate Bayesian Computation (ABC) enables statistical inference in simulator-based models whose likelihoods are difficult to calculate but easy to simulate from. ABC constructs a kernel-type approximation to the posterior distribution…

Methodology · Statistics 2022-12-02 Yuexi Wang , Tetsuya Kaji , Veronika Ročková

Data uncertainty in practical person reID is ubiquitous, hence it requires not only learning the discriminative features, but also modeling the uncertainty based on the input. This paper proposes to learn the sample posterior and the class…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Yan Zhang , Zhilin Zheng , Binyu He , Li Sun