English
Related papers

Related papers: The Controlled Thermodynamic Integral for Bayesian…

200 papers

Monte Carlo sampling for Bayesian posterior inference is a common approach used in machine learning. The Markov Chain Monte Carlo procedures that are used are often discrete-time analogues of associated stochastic differential equations…

Machine Learning · Statistics 2020-02-14 Xiaocheng Shang , Zhanxing Zhu , Benedict Leimkuhler , Amos J. Storkey

In the field of modeling, the word validation refers to simple comparisons between model outputs and experimental data. Usually, this comparison constitutes plotting the model results against data on the same axes to provide a visual…

Applications · Statistics 2021-06-11 Farid Mohammadi

This paper is concerned with Bayesian inferential methods for data from controlled branching processes that account for model robustness through the use of disparities. Under regularity conditions, we establish that estimators built on…

Methodology · Statistics 2018-02-19 M. González , C. Minuesa , I. del Puerto , A. N. Vidyashankar

A fully Bayesian treatment of complicated predictive models (such as deep neural networks) would enable rigorous uncertainty quantification and the automation of higher-level tasks including model selection. However, the intractability of…

The model evidence is a vital quantity in the comparison of statistical models under the Bayesian paradigm. This paper presents a review of commonly used methods. We outline some guidelines and offer some practical advice. The reviewed…

Methodology · Statistics 2011-11-09 Nial Friel , Jason Wyse

Sensors in high-precision mechatronic systems require accurate calibration, which is achieved using test beds that, in turn, require even more accurate calibration. The aim of this paper is to develop a cascaded calibration method for…

Systems and Control · Electrical Eng. & Systems 2023-04-07 Max van Meer , Emre Deniz , Gert Witvoet , Tom Oomen

It is not always clear how to adjust for control data in causal inference, balancing the goals of reducing bias and variance. We show how, in a setting with repeated experiments, Bayesian hierarchical modeling yields an adaptive procedure…

Methodology · Statistics 2025-01-23 Andrew Gelman , Matthijs Vákár

Experimental calibration of dynamic thermal models is required for model predictive control and characterization of building energy performance. In these applications, the uncertainty assessment of the parameter estimates is decisive; this…

Applications · Statistics 2019-04-25 L. Raillon , Christian Ghiaus

Comparison of appropriate models to describe observational data is a fundamental task of science. The Bayesian model evidence, or marginal likelihood, is a computationally challenging, yet crucial, quantity to estimate to perform Bayesian…

Cosmology and Nongalactic Astrophysics · Physics 2023-11-10 A. Spurio Mancini , M. M. Docherty , M. A. Price , J. D. McEwen

Mixture models are widely used in Bayesian statistics and machine learning, in particular in computational biology, natural language processing and many other fields. Variational inference, a technique for approximating intractable…

Statistics Theory · Mathematics 2020-08-03 Badr-Eddine Chérief-Abdellatif , Pierre Alquier

Noninformative priors constructed for estimation purposes are usually not appropriate for model selection and testing. The methodology of integral priors was developed to get prior distributions for Bayesian model selection when comparing…

Methodology · Statistics 2026-03-05 Diego Salmerón , Juan Antonio Cano , Christian P. Robert

Meta-analysis is widely used to integrate results from multiple experiments to obtain generalized insights. Since meta-analysis datasets are often heteroscedastic due to varying subgroups and temporal heterogeneity arising from experiments…

Methodology · Statistics 2026-01-19 Kohsuke Kubota , Shonosuke Sugasawa , Keiichi Ochiai , Takahiro Hoshino

We consider the problem of empirical Bayes estimation of multiple variances when provided with sample variances. Assuming an arbitrary prior on the variances, we derive different versions of the Bayes estimators using different loss…

Statistics Theory · Mathematics 2022-03-01 Yeil Kwon , Zhigen Zhao

Flexible variational distributions improve variational inference but are harder to optimize. In this work we present a control variate that is applicable for any reparameterizable distribution with known mean and covariance matrix, e.g.…

Machine Learning · Computer Science 2020-10-26 Tomas Geffner , Justin Domke

When the data do not conform to the hypothesis of a known sampling-variance, the fitting of a constant to a set of measured values is a long debated problem. Given the data, fitting would require to find what measurand value is the most…

Data Analysis, Statistics and Probability · Physics 2020-07-21 Giovanni Mana , Enrico Massa , Maria Predescu

Updating $\textit{a priori}$ information given some observed data is the core tenet of Bayesian inference. Bayesian transfer learning extends this idea by incorporating information from a related dataset to improve the inference on the…

Bayesian inference with stochastic models is often difficult because their likelihood functions involve high-dimensional integrals. Approximate Bayesian Computation (ABC) avoids evaluating the likelihood function and instead infers model…

The objective of Bayesian inference is often to infer, from data, a probability measure for a random variable that can be used as input for Monte Carlo simulation. When datasets for Bayesian inference are small, a principle challenge is…

Computation · Statistics 2018-03-29 Jiaxin Zhang , Michael D. Shields

In this paper we examine a control variate estimator for a quantity that can be expressed as the expectation of a functional of a random process, that is itself the solution of a differential equation driven by fast mean-reverting ergodic…

Probability · Mathematics 2020-08-10 Josselin Garnier , Laurent Mertz

Kinetic equations play a major rule in modeling large systems of interacting particles. Uncertainties may be due to various reasons, like lack of knowledge on the microscopic interaction details or incomplete informations at the boundaries.…

Numerical Analysis · Mathematics 2019-05-01 Giacomo Dimarco , Lorenzo Pareschi