English
Related papers

Related papers: Deep Bayesian Quadrature Policy Optimization

200 papers

In this paper, we present a Model-Based Reinforcement Learning (MBRL) algorithm named \emph{Monte Carlo Probabilistic Inference for Learning COntrol} (MC-PILCO). The algorithm relies on Gaussian Processes (GPs) to model the system dynamics…

Machine Learning · Computer Science 2022-11-29 Fabio Amadio , Alberto Dalla Libera , Riccardo Antonello , Daniel Nikovski , Ruggero Carli , Diego Romeres

Deterministic Policy Gradient (DPG) removes a level of randomness from standard randomized-action Policy Gradient (PG), and demonstrates substantial empirical success for tackling complex dynamic problems involving Markov decision…

Machine Learning · Computer Science 2020-07-14 Harshat Kumar , Dionysios S. Kalogerias , George J. Pappas , Alejandro Ribeiro

Computing accurate yet efficient approximations to the solutions of the electronic Schr\"odinger equation has been a paramount challenge of computational chemistry for decades. Quantum Monte Carlo methods are a promising avenue of…

Chemical Physics · Physics 2023-09-25 Zeno Schätzle , Bernát Szabó , Matĕj Mezera , Jan Hermann , Frank Noé

In statistical dialogue management, the dialogue manager learns a policy that maps a belief state to an action for the system to perform. Efficient exploration is key to successful policy optimisation. Current deep reinforcement learning…

Machine Learning · Statistics 2017-12-04 Christopher Tegho , Paweł Budzianowski , Milica Gašić

This paper implements the Deep Deterministic Policy Gradient (DDPG) algorithm for computing optimal policies for partially observable single-product periodic review inventory control problems with setup costs and backorders. The decision…

Optimization and Control · Mathematics 2025-07-29 Eugene Feinberg , Jefferson Huang , Pavlo Kasyanov , Thomas O'Neill

Deep Deterministic Policy Gradient (DDPG) algorithm is one of the most well-known reinforcement learning methods. However, this method is inefficient and unstable in practical applications. On the other hand, the bias and variance of the Q…

Machine Learning · Computer Science 2020-07-02 Shuai Han , Wenbo Zhou , Shuai Lü , Jiayu Yu

Proposed here is a dynamic Monte-Carlo algorithm that is efficient in simulating dense systems of long flexible chain molecules. It expands on the configurational-bias Monte-Carlo method through the simultaneous generation of a large set of…

Statistical Mechanics · Physics 2018-08-29 Niels Boon

Bayesian Optimization using Gaussian Processes is a popular approach to deal with the optimization of expensive black-box functions. However, because of the a priori on the stationarity of the covariance matrix of classic Gaussian…

Machine Learning · Statistics 2019-05-10 Ali Hebbal , Loic Brevault , Mathieu Balesdent , El-Ghazali Talbi , Nouredine Melab

Traditional neural networks provide deterministic predictions without inherent uncertainty estimates. While Bayesian Neural Networks (BNNs) offer a principled approach to uncertainty quantification, their computational complexity limits…

Machine Learning · Statistics 2026-05-25 Rouaa Hoblos , Noura Dridi , Noureddine Zerhouni , Zeina Al Masry

Discrete stochastic processes (DSP) are instrumental for modelling the dynamics of probabilistic systems and have a wide spectrum of applications in science and engineering. DSPs are usually analyzed via Monte Carlo methods since the number…

Quantum Physics · Physics 2020-08-17 Carsten Blank , Daniel K. Park , Francesco Petruccione

Motivated by many application problems, we consider Markov decision processes (MDPs) with a general loss function and unknown parameters. To mitigate the epistemic uncertainty associated with unknown parameters, we take a Bayesian approach…

Machine Learning · Computer Science 2025-10-02 Xiaoshuang Wang , Yifan Lin , Enlu Zhou

Solving partial differential equations in high dimensions by deep neural network has brought significant attentions in recent years. In many scenarios, the loss function is defined as an integral over a high-dimensional domain. Monte-Carlo…

Numerical Analysis · Mathematics 2019-11-06 Jingrun Chen , Rui Du , Panchi Li , Liyao Lyu

Computing optimal control policies for complex dynamical systems requires approximation methods to remain computationally tractable. Several approximation methods have been developed to tackle this problem. However, these methods do not…

Robotics · Computer Science 2022-03-30 Ashwin Khadke , Hartmut Geyer

Discrete choice models are commonly used by applied statisticians in numerous fields, such as marketing, economics, finance, and operations research. When agents in discrete choice models are assumed to have differing preferences, exact…

Methodology · Statistics 2010-06-04 Michael Braun , Jon McAuliffe

The rise of artificial intelligence (AI) hinges on the efficient training of modern deep neural networks (DNNs) for non-convex optimization and uncertainty quantification, which boils down to a non-convex Bayesian learning problem. A…

Computation · Statistics 2023-06-01 Wei Deng

Deep Gaussian Processes (DGPs) compose GP layers to warp inputs, enabling improved emulation of computer models with nonstationary input-output behavior compared with ordinary GPs. In contrast to GPs, the predictive uncertainty for DGP…

Computation · Statistics 2026-05-12 Yiming Yang , Deyu Ming , Serge Guillas

Adaptive Bayesian quadrature (ABQ) is a powerful approach to numerical integration that empirically compares favorably with Monte Carlo integration on problems of medium dimensionality (where non-adaptive quadrature is not competitive). Its…

Machine Learning · Statistics 2019-10-29 Motonobu Kanagawa , Philipp Hennig

In this paper, we propose a novel reinforcement- learning algorithm consisting in a stochastic variance-reduced version of policy gradient for solving Markov Decision Processes (MDPs). Stochastic variance-reduced gradient (SVRG) methods…

Machine Learning · Computer Science 2018-06-15 Matteo Papini , Damiano Binaghi , Giuseppe Canonaco , Matteo Pirotta , Marcello Restelli

We present a Monte-Carlo simulation algorithm for real-time policy improvement of an adaptive controller. In the Monte-Carlo simulation, the long-term expected reward of each possible action is statistically measured, using the initial…

Machine Learning · Computer Science 2025-04-07 Gerald Tesauro , Gregory R. Galperin

Monte Carlo methods are widely used for approximating complicated, multidimensional integrals for Bayesian inference. Population Monte Carlo (PMC) is an important class of Monte Carlo methods, which utilizes a population of proposals to…

Methodology · Statistics 2022-08-30 Chaofan Huang , V. Roshan Joseph , Simon Mak