English
Related papers

Related papers: Bayesian learning of noisy Markov decision process…

200 papers

This paper introduces a Bayesian framework that combines Markov chain Monte Carlo (MCMC) sampling, dimensionality reduction, and neural density estimation to efficiently handle inverse problems that (i) must be solved multiple times, and…

Computational Engineering, Finance, and Science · Computer Science 2026-02-24 Giacomo Bottacini , Matteo Torzoni , Andrea Manzoni

Bayesian filtering deals with computing the posterior distribution of the state of a stochastic dynamic system given noisy observations. In this paper, motivated by applications in counter-adversarial systems, we consider the following…

Systems and Control · Electrical Eng. & Systems 2020-10-28 Robert Mattila , Cristian R. Rojas , Vikram Krishnamurthy , Bo Wahlberg

We deal with Bayesian inference for Beta autoregressive processes. We restrict our attention to the class of conditionally linear processes. These processes are particularly suitable for forecasting purposes, but are difficult to estimate…

Statistics Theory · Mathematics 2010-08-03 R. Casarin , L. Dalla Valle , F. Leisen

Bayesian inference promises to ground and improve the performance of deep neural networks. It promises to be robust to overfitting, to simplify the training procedure and the space of hyperparameters, and to provide a calibrated measure of…

Machine Learning · Computer Science 2019-08-12 Jonathan Heek , Nal Kalchbrenner

We cast episodic Markov decision process (MDP) planning as Bayesian inference over policies. A policy is treated as the latent variable and is assigned an unnormalized probability of optimality that is monotone in its expected return,…

Machine Learning · Computer Science 2026-04-14 David Tolpin

We propose a machine-learning algorithm for Bayesian inverse problems in the function-space regime based on one-step generative transport. Building on the Mean Flows, we learn a fully conditional amortized sampler with a neural-operator…

Machine Learning · Statistics 2026-03-17 Zilan Cheng , Li-Lian Wang , Zhongjian Wang

Bayesian inference provides a methodology for parameter estimation and uncertainty quantification in machine learning and deep learning methods. Variational inference and Markov Chain Monte-Carlo (MCMC) sampling methods are used to…

Machine Learning · Statistics 2024-08-27 Rohitash Chandra , Joshua Simmons

We focus on generative autoencoders, such as variational or adversarial autoencoders, which jointly learn a generative model alongside an inference model. Generative autoencoders are those which are trained to softly enforce a prior on the…

Machine Learning · Computer Science 2017-01-13 Antonia Creswell , Kai Arulkumaran , Anil Anthony Bharath

Markov chain Monte Carlo (MCMC) methods have not been broadly adopted in Bayesian neural networks (BNNs). This paper initially reviews the main challenges in sampling from the parameter posterior of a neural network via MCMC. Such…

Machine Learning · Statistics 2021-10-05 Theodore Papamarkou , Jacob Hinkle , M. Todd Young , David Womble

In conducting non-linear dimensionality reduction and feature learning, it is common to suppose that the data lie near a lower-dimensional manifold. A class of model-based approaches for such problems includes latent variables in an unknown…

Machine Learning · Statistics 2020-08-20 Deborshee Sen , Theodore Papamarkou , David Dunson

We develop an approach for Bayesian learning of spatiotemporal dynamical mechanistic models. Such learning consists of statistical emulation of the mechanistic system that can efficiently interpolate the output of the system from arbitrary…

Methodology · Statistics 2025-07-11 Sudipto Banerjee , Xiang Chen , Ian Frankenburg , Daniel Zhou

The Markov Decision Process (MDP) is a popular framework for sequential decision-making problems, and uncertainty quantification is an essential component of it to learn optimal decision-making strategies. In particular, a Bayesian…

Machine Learning · Statistics 2025-05-06 Jiaqi Guo , Chon Wai Ho , Sumeetpal S. Singh

This article presents an approach to Bayesian semiparametric inference for Gaussian multivariate response regression. We are motivated by various small and medium dimensional problems from the physical and social sciences. The statistical…

Methodology · Statistics 2020-06-18 Georgios Papageorgiou , Benjamin C. Marshall

Undirected graphical models are widely used in statistics, physics and machine vision. However Bayesian parameter estimation for undirected models is extremely challenging, since evaluation of the posterior typically involves the…

Computation · Statistics 2012-03-19 Richard G. Everitt

Robots performing manipulation tasks must operate under uncertainty about both their pose and the dynamics of the system. In order to remain robust to modeling error and shifts in payload dynamics, agents must simultaneously perform…

Systems and Control · Computer Science 2017-07-31 Patrick Slade , Preston Culbertson , Zachary Sunberg , Mykel Kochenderfer

We generalise the problem of inverse reinforcement learning to multiple tasks, from multiple demonstrations. Each one may represent one expert trying to solve a different task, or as different experts trying to solve the same task. Our main…

Machine Learning · Statistics 2012-09-04 Christos Dimitrakakis , Constantin Rothkopf

Reinforcement learning provides a framework for learning to control which actions to take towards completing a task through trial-and-error. In many applications observing interactions is costly, necessitating sample-efficient learning. In…

Machine Learning · Statistics 2020-11-04 Charles Gadd , Markus Heinonen , Harri Lähdesmäki , Samuel Kaski

We propose a very fast approximate Markov Chain Monte Carlo (MCMC) sampling framework that is applicable to a large class of sparse Bayesian inference problems, where the computational cost per iteration in several models is of order…

Computation · Statistics 2021-08-17 Yves Atchadé , Liwei Wang

Advances in digital sensors, digital data storage and communications have resulted in systems being capable of accumulating large collections of data. In the light of dealing with the challenges that massive data present, this work proposes…

Computation · Statistics 2015-12-09 Allan De Freitas , François Septier , Lyudmila Mihaylova

Bayesian learning in undirected graphical models|computing posterior distributions over parameters and predictive quantities is exceptionally difficult. We conjecture that for general undirected models, there are no tractable MCMC (Markov…

Machine Learning · Computer Science 2012-07-19 Iain Murray , Zoubin Ghahramani
‹ Prev 1 2 3 10 Next ›