English
Related papers

Related papers: Bayesian learning of noisy Markov decision process…

200 papers

We consider the problem of Bayesian parameter estimation for deep neural networks, which is important in problem settings where we may have little data, and/ or where we need accurate posterior predictive densities, e.g., for applications…

Machine Learning · Computer Science 2015-11-10 Anoop Korattikara , Vivek Rathod , Kevin Murphy , Max Welling

As control engineering methods are applied to increasingly complex systems, data-driven approaches for system identification appear as a promising alternative to physics-based modeling. While the Bayesian approaches prevalent for…

Systems and Control · Electrical Eng. & Systems 2024-08-07 Robert Lefringhausen , Supitsana Srithasan , Armin Lederer , Sandra Hirche

When working with multimodal Bayesian posterior distributions, Markov chain Monte Carlo (MCMC) algorithms have difficulty moving between modes, and default variational or mode-based approximate inferences will understate posterior…

Methodology · Statistics 2021-11-19 Yuling Yao , Aki Vehtari , Andrew Gelman

The right to be forgotten has been legislated in many countries, but its enforcement in the AI industry would cause unbearable costs. When single data deletion requests come, companies may need to delete the whole models learned with…

Machine Learning · Computer Science 2022-03-25 Shaopeng Fu , Fengxiang He , Dacheng Tao

Symbolic regression is a powerful tool for discovering governing equations directly from data, but its sensitivity to noise hinders its broader application. This paper introduces a Sequential Monte Carlo (SMC) framework for Bayesian…

Machine Learning · Computer Science 2025-12-12 Geoffrey F. Bomarito , Patrick E. Leser

This paper addresses the challenge of a particular class of noisy state observations in Markov Decision Processes (MDPs), a common issue in various real-world applications. We focus on modeling this uncertainty through a confusion matrix…

Machine Learning · Computer Science 2023-12-15 Amirhossein Afsharrad , Sanjay Lall

We study sequential Bayesian inference in stochastic kinetic models with latent factors. Assuming continuous observation of all the reactions, our focus is on joint inference of the unknown reaction rates and the dynamic latent states,…

Computation · Statistics 2014-09-10 Junjing Lin , Michael Ludkovski

Bayesian analyses combine information represented by different terms in a joint Bayesian model. When one or more of the terms is misspecified, it can be helpful to restrict the use of information from suspect model components to modify…

Methodology · Statistics 2022-06-27 Xuejun Yu , David J. Nott , Michael Stanley Smith

Safe learning of control policies remains challenging, both in optimal control and reinforcement learning. In this article, we consider safe learning of parametrized predictive controllers that operate with incomplete information about the…

Systems and Control · Electrical Eng. & Systems 2024-09-17 Sebastian Hirt , Maik Pfefferkorn , Rolf Findeisen

Bayesian observer and actor models have provided normative explanations for many behavioral phenomena in perception, sensorimotor control, and other areas of cognitive science and neuroscience. They attribute behavioral variability and…

Machine Learning · Computer Science 2025-02-03 Dominik Straub , Tobias F. Niehues , Jan Peters , Constantin A. Rothkopf

Given a multivariate function taking deterministic and uncertain inputs, we consider the problem of estimating a quantile set: a set of deterministic inputs for which the probability that the output belongs to a specific region remains…

Applications · Statistics 2025-07-25 Romain Ait Abdelmalek-Lomenech , Julien Bect , Emmanuel Vazquez

Markov Chain Monte Carlo (MCMC) is a well-established family of algorithms primarily used in Bayesian statistics to sample from a target distribution when direct sampling is challenging. Existing work on Bayesian decision trees uses MCMC.…

Computation · Statistics 2023-01-24 Efthyvoulos Drousiotis , Paul G. Spirakis , Simon Maskell

An important aspect of Bayesian model selection is how to deal with huge model spaces, since exhaustive enumeration of all the models entertained is unfeasible and inferences have to be based on the very small proportion of models visited.…

Methodology · Statistics 2011-01-25 Gonzalo Garcia-Donato , Miguel Angel Martinez-Beneito

Bayesian inference often faces a trade-off between computational speed and sampling accuracy. We propose an adaptive workflow that integrates rapid amortized inference with gold-standard MCMC techniques to achieve a favorable combination of…

Machine Learning · Computer Science 2026-02-19 Chengkun Li , Aki Vehtari , Paul-Christian Bürkner , Stefan T. Radev , Luigi Acerbi , Marvin Schmitt

Bayesian model comparison (BMC) offers a principled approach for assessing the relative merits of competing computational models and propagating uncertainty into model selection decisions. However, BMC is often intractable for the popular…

Machine Learning · Statistics 2023-11-27 Lasse Elsemüller , Martin Schnuerch , Paul-Christian Bürkner , Stefan T. Radev

Dynamic Bayesian predictive synthesis is a formal approach to coherently synthesizing multiple predictive distributions into a single distribution. In sequential analysis, the computation of the synthesized predictive distribution has…

Methodology · Statistics 2023-08-31 Riku Masuda , Kaoru Irie

We consider the problem of Bayesian inference for bi-variate data observed in time but with observation times which occur non-synchronously. In particular, this occurs in a wide variety of applications in finance, such as high-frequency…

Methodology · Statistics 2025-03-04 Ajay Jasra , Kengo Kamatani , Amin Wu

Importance sampling (IS) is commonly used for cross validation (CV) in Bayesian models, because it only involves reweighting existing posterior draws without needing to re-estimate the model by re-running Markov chain Monte Carlo (MCMC).…

Computation · Statistics 2025-08-12 Geonhee Han , Andrew Gelman

Hierarchical data with multiple observations per group is ubiquitous in empirical sciences and is often analyzed using mixed-effects regression. In such models, Bayesian inference gives an estimate of uncertainty but is analytically…

Machine Learning · Computer Science 2026-02-05 Alex Kipnis , Marcel Binz , Eric Schulz

Using Markov chain Monte Carlo to sample from posterior distributions was the key innovation which made Bayesian data analysis practical. Notoriously, however, MCMC is hard to tune, hard to diagnose, and hard to parallelize. This…

Computation · Statistics 2022-03-18 Cosma Rohilla Shalizi