English
Related papers

Related papers: A Bayesian Approach to Online Planning

200 papers

We develop the theory and practice of an approach to modelling and probabilistic inference in causal networks that is suitable when application-specific or analysis-specific constraints should inform such inference or when little or no data…

Artificial Intelligence · Computer Science 2017-05-16 Paul Beaumont , Michael Huth

Decision tree learning is a popular approach for classification and regression in machine learning and statistics, and Bayesian formulations---which introduce a prior distribution over decision trees, and formulate learning as posterior…

Machine Learning · Statistics 2013-08-26 Balaji Lakshminarayanan , Daniel M. Roy , Yee Whye Teh

I describe a planning methodology for domains with uncertainty in the form of external events that are not completely predictable. The events are represented by enabling conditions and probabilities of occurrence. The planner is…

Artificial Intelligence · Computer Science 2013-02-28 Jim S. Blythe

We propose a new method to estimate a root-directed spanning tree from extreme data. A prominent example is a river network, to be discovered from extreme flow measured at a set of stations. Our new algorithm utilizes qualitative aspects of…

Machine Learning · Statistics 2023-12-29 Ngoc Mai Tran , Johannes Buck , Claudia Klüppelberg

Bayesian inference in deep neural networks is challenging due to the high-dimensional, strongly multi-modal parameter posterior density landscape. Markov chain Monte Carlo approaches asymptotically recover the true posterior but are…

We present a novel technique for tailoring Bayesian quadrature (BQ) to model selection. The state-of-the-art for comparing the evidence of multiple models relies on Monte Carlo methods, which converge slowly and are unreliable for…

Machine Learning · Computer Science 2019-03-04 Henry Chai , Jean-Francois Ton , Roman Garnett , Michael A. Osborne

Bayesian networks provide a probabilistic semantics for qualitative assertions about likelihood. A qualitative reasoner based on an algebra over these assertions can derive further conclusions about the influence of actions. While the…

Artificial Intelligence · Computer Science 2013-04-12 Michael P. Wellman

Approximate Bayesian computation (ABC) is a method for Bayesian inference when the likelihood is unavailable but simulating from the model is possible. However, many ABC algorithms require a large number of simulations, which can be costly.…

Machine Learning · Statistics 2018-10-15 Marko Järvenpää , Michael U. Gutmann , Arijus Pleska , Aki Vehtari , Pekka Marttinen

Neural network pruning is a highly effective technique aimed at reducing the computational and memory demands of large neural networks. In this research paper, we present a novel approach to pruning neural networks utilizing Bayesian…

Machine Learning · Statistics 2023-08-07 Sunil Mathew , Daniel B. Rowe

Neural Networks and Decision Trees: two popular techniques for supervised learning that are seemingly disconnected in their formulation and optimization method, have recently been combined in a single construct. The connection pivots on…

Machine Learning · Statistics 2020-02-27 Giuseppe Nuti , Lluís Antoni Jiménez Rugama , Kaspar Thommen

Bayesian optimization is a popular framework for efficiently tackling black-box search problems. As a rule, these algorithms operate by iteratively choosing what to evaluate next until some predefined budget has been exhausted. We…

Machine Learning · Statistics 2024-12-12 James T. Wilson

We consider the problem of Bayesian parameter estimation for deep neural networks, which is important in problem settings where we may have little data, and/ or where we need accurate posterior predictive densities, e.g., for applications…

Machine Learning · Computer Science 2015-11-10 Anoop Korattikara , Vivek Rathod , Kevin Murphy , Max Welling

A Bayesian framework is attractive in the context of prediction, but a fast recursive update of the predictive distribution has apparently been out of reach, in part because Monte Carlo methods are generally used to compute the predictive.…

Methodology · Statistics 2018-12-11 P. Richard Hahn , Ryan Martin , Stephen G. Walker

In the world of embedded systems, optimizing actions with the uncertain costs of multiple resources is a complex challenge. Existing methods include plan building based on Monte Carlo Tree Search (MCTS), an approach that thrives in multiple…

Systems and Control · Electrical Eng. & Systems 2024-07-18 Franco Cordeiro , Samuel Tardieu , Laurent Pautet

This paper explores the problem of path planning under uncertainty. Specifically, we consider online receding horizon based planners that need to operate in a latent environment where the latent information can be modeled via Gaussian…

Robotics · Computer Science 2016-09-19 Wen Sun , Niteesh Sood , Debadeepta Dey , Gireeja Ranade , Siddharth Prakash , Ashish Kapoor

We develop a new Bayesian modelling framework for the class of higher-order, variable-memory Markov chains, and introduce an associated collection of methodological tools for exact inference with discrete time series. We show that a version…

Bayesian optimization (BO) is a widely used iterative algorithm for optimizing black-box functions. Each iteration requires maximizing an acquisition function, such as the upper confidence bound (UCB) or a sample path from the Gaussian…

Machine Learning · Statistics 2025-06-16 Hwanwoo Kim , Chong Liu , Yuxin Chen

Multiple Classifier Systems (MCSs) allow evaluation of the uncertainty of classification outcomes that is of crucial importance for safety critical applications. The uncertainty of classification is determined by a trade-off between the…

Tree search is a fundamental tool for planning, as many sequential decision-making problems can be framed as searching over tree-structured spaces. We propose an uncertainty-guided tree search algorithm for settings where the reward…

Machine Learning · Computer Science 2025-09-05 Julia Grosse , Ruotian Wu , Ahmad Rashid , Cheng Zhang , Philipp Hennig , Pascal Poupart , Agustinus Kristiadi

Sequential decision-making under uncertainty is present in many important problems. Two popular approaches for tackling such problems are reinforcement learning and online search (e.g., Monte Carlo tree search). While the former learns a…

Artificial Intelligence · Computer Science 2024-01-23 Ava Pettet , Yunuo Zhang , Baiting Luo , Kyle Wray , Hendrik Baier , Aron Laszka , Abhishek Dubey , Ayan Mukhopadhyay