English
Related papers

Related papers: Bayesian Policy Gradients via Alpha Divergence Dro…

200 papers

Reward evaluation of episodes becomes a bottleneck in a broad range of reinforcement learning tasks. Our aim in this paper is to select a small but representative subset of a large batch of episodes, only on which we actually compute…

Machine Learning · Computer Science 2026-04-23 Satoshi Hayakawa , Tetsuro Morimura

Deterministic policies are often preferred over stochastic ones when implemented on physical systems. They can prevent erratic and harmful behaviors while being easier to implement and interpret. However, in practice, exploration is largely…

Machine Learning · Computer Science 2024-07-09 Mahdi Kallel , Debabrota Basu , Riad Akrour , Carlo D'Eramo

Models with intractable normalizing functions arise frequently in statistics. Common examples of such models include exponential random graph models for social networks and Markov point processes for ecology and disease modeling. Inference…

Computation · Statistics 2018-08-03 Jaewoo Park , Murali Haran

This paper investigates the use of prior computation to estimate the value function to improve sample efficiency in on-policy policy gradient methods in reinforcement learning. Our approach is to estimate the value function from prior…

Machine Learning · Computer Science 2023-02-06 Md Masudur Rahman , Yexiang Xue

In this paper, we propose a new policy iteration algorithm to compute the value function and the optimal controls of continuous time stochastic control problems. The algorithm relies on successive approximations using linear-quadratic…

Optimization and Control · Mathematics 2024-09-09 Dylan Possamaï , Ludovic Tangpi

We propose a gradient-free deep reinforcement learning algorithm to solve high-dimensional, finite-horizon stochastic control problems. Although the recently developed deep reinforcement learning framework has achieved great success in…

Optimization and Control · Mathematics 2025-02-03 Liyao Lyu , Jingrun Chen

Backpropagation with gradient descent is a common optimization strategy employed by most neural network architectures in machine learning. However, finding optimal hyperparameters to guide training has proven challenging. While it is widely…

Machine Learning · Computer Science 2026-05-20 Vy Bui , Hang Yu , Karthik Kantipudi , Ziv Yaniv , Stefan Jaeger

Variational inference approximates the posterior distribution of a probabilistic model with a parameterized density by maximizing a lower bound for the model evidence. Modern solutions fit a flexible approximation with stochastic gradient…

Machine Learning · Statistics 2017-07-13 Joseph Sakaya , Arto Klami

The Markov Decision Process (MDP) is a popular framework for sequential decision-making problems, and uncertainty quantification is an essential component of it to learn optimal decision-making strategies. In particular, a Bayesian…

Machine Learning · Statistics 2025-05-06 Jiaqi Guo , Chon Wai Ho , Sumeetpal S. Singh

Scenarios requiring humans to choose from multiple seemingly optimal actions are commonplace, however standard imitation learning often fails to capture this behavior. Instead, an over-reliance on replicating expert actions induces…

Robotics · Computer Science 2022-11-08 Hanbit Oh , Hikaru Sasaki , Brendan Michael , Takamitsu Matsubara

Monte Carlo sampling has become a major vehicle for approximate inference in Bayesian networks. In this paper, we investigate a family of related simulation approaches, known collectively as quasi-Monte Carlo methods based on deterministic…

Artificial Intelligence · Computer Science 2013-01-18 Jian Cheng , Marek J. Druzdzel

Accurate estimates of long-term risk probabilities and their gradients are critical for many stochastic safe control methods. However, computing such risk probabilities in real-time and in unseen or changing environments is challenging.…

Systems and Control · Electrical Eng. & Systems 2024-08-20 Zhuoyuan Wang , Yorie Nakahira

Uncertainty estimation in Neural Networks (NNs) is vital in improving reliability and confidence in predictions, particularly in safety-critical applications. Bayesian Neural Networks (BayNNs) with Dropout as an approximation offer a…

Machine Learning · Computer Science 2024-01-12 Soyed Tuhin Ahmed , Kamal Danouchi , Michael Hefenbrock , Guillaume Prenat , Lorena Anghel , Mehdi B. Tahoori

Estimating the distribution over failures is a key step in validating autonomous systems. Existing approaches focus on finding failures for a small range of initial conditions or make restrictive assumptions about the properties of the…

Robotics · Computer Science 2023-05-18 Harrison Delecki , Anthony Corso , Mykel J. Kochenderfer

Policy optimization on high-dimensional continuous control tasks exhibits its difficulty caused by the large variance of the policy gradient estimators. We present the action subspace dependent gradient (ASDG) estimator which incorporates…

Machine Learning · Computer Science 2019-05-30 Jiajin Li , Baoxiang Wang

Informed and robust decision making in the face of uncertainty is critical for robots that perform physical tasks alongside people. We formulate this as Bayesian Reinforcement Learning over latent Markov Decision Processes (MDPs). While…

Robotics · Computer Science 2020-02-11 Gilwoo Lee , Brian Hou , Sanjiban Choudhury , Siddhartha S. Srinivasa

Sequential decision problems are often approximately solvable by simulating possible future action sequences. Metalevel decision procedures have been developed for selecting which action sequences to simulate, based on estimating the…

Artificial Intelligence · Computer Science 2014-08-12 Nicholas Hay , Stuart Russell , David Tolpin , Solomon Eyal Shimony

Policy gradient methods, which have been extensively studied in the last decade, offer an effective and efficient framework for reinforcement learning problems. However, their performances can often be unsatisfactory, suffering from…

Machine Learning · Computer Science 2026-01-27 Shihab Ahmed , El Houcine Bergou , Aritra Dutta , Yue Wang

We propose a Bayesian approach for recursively estimating the classifier weights in online learning of a classifier ensemble. In contrast with past methods, such as stochastic gradient descent or online boosting, our approach estimates the…

Machine Learning · Computer Science 2015-07-09 Qinxun Bai , Henry Lam , Stan Sclaroff

Achieving robust uncertainty quantification for deep neural networks represents an important requirement in many real-world applications of deep learning such as medical imaging where it is necessary to assess the reliability of a neural…

Machine Learning · Computer Science 2024-03-15 Tim Rensmeyer , Oliver Niggemann