English
Related papers

Related papers: Dynamic Subgoal-based Exploration via Bayesian Opt…

200 papers

Finding an effective medical treatment often requires a search by trial and error. Making this search more efficient by minimizing the number of unnecessary trials could lower both costs and patient suffering. We formalize this problem as…

Machine Learning · Computer Science 2021-02-18 Samuel Håkansson , Viktor Lindblom , Omer Gottesman , Fredrik D. Johansson

Many approaches for optimizing decision making models rely on gradient based methods requiring informative feedback from the environment. However, in the case where such feedback is sparse or uninformative, such approaches may result in…

Machine Learning · Computer Science 2024-11-12 Mohit Rajpal , Lac Gia Tran , Yehong Zhang , Bryan Kian Hsiang Low

Leveraging the wealth of unlabeled data produced in recent years provides great potential for improving supervised models. When the cost of acquiring labels is high, probabilistic active learning methods can be used to greedily select the…

Machine Learning · Statistics 2021-02-09 Robert Pinsler , Jonathan Gordon , Eric Nalisnick , José Miguel Hernández-Lobato

Mastering deep reinforcement learning (DRL) proves challenging in tasks featuring scant rewards. These limited rewards merely signify whether the task is partially or entirely accomplished, necessitating various exploration actions before…

Machine Learning · Computer Science 2024-04-11 Guojian Wang , Faguo Wu , Xiao Zhang

Learning Bayesian networks is often cast as an optimization problem, where the computational task is to find a structure that maximizes a statistically motivated score. By and large, existing learning tools address this optimization problem…

Machine Learning · Computer Science 2013-01-30 Nir Friedman , Iftach Nachman , Dana Pe'er

Bayesian optimization is a popular and versatile approach that is well suited to solve challenging optimization problems. Their popularity comes from their effective minimization of expensive function evaluations, their capability to…

Optimization and Control · Mathematics 2026-05-14 André L. Marchildon , David W. Zingg

We study the problem of causal discovery through targeted interventions. Starting from few observational measurements, we follow a Bayesian active learning approach to perform those experiments which, in expectation with respect to the…

Machine Learning · Statistics 2019-10-10 Julius von Kügelgen , Paul K Rubenstein , Bernhard Schölkopf , Adrian Weller

Reinforcement learning studies how to balance exploration and exploitation in real-world systems, optimizing interactions with the world while simultaneously learning how the world operates. One general class of algorithms for such learning…

Machine Learning · Statistics 2018-08-10 Iñigo Urteaga , Chris H. Wiggins

Sample efficiency is one of the key factors when applying policy search to real-world problems. In recent years, Bayesian Optimization (BO) has become prominent in the field of robotics due to its sample efficiency and little prior…

Robotics · Computer Science 2020-11-19 Lukas P. Fröhlich , Melanie N. Zeilinger , Edgar D. Klenske

Reinforcement learning (RL) plays a major role in solving complex sequential decision-making tasks. Hierarchical and goal-conditioned RL are promising methods for dealing with two major problems in RL, namely sample inefficiency and…

Machine Learning · Computer Science 2025-02-11 Amirhossein Mesbah , Reshad Hosseini , Seyed Pooya Shariatpanahi , Majid Nili Ahmadabadi

The most data-efficient algorithms for reinforcement learning in robotics are model-based policy search algorithms, which alternate between learning a dynamical model of the robot and optimizing a policy to maximize the expected return…

Machine Learning · Computer Science 2020-03-05 Rituraj Kaushik , Konstantinos Chatzilygeroudis , Jean-Baptiste Mouret

Trained humans exhibit highly agile spatial skills, enabling them to operate vehicles with complex dynamics in demanding tasks and conditions. Prior work shows that humans achieve this performance by using strategies such as satisficing,…

Systems and Control · Electrical Eng. & Systems 2020-04-28 Andrew Feit , Bérénice Mettler

Optimization algorithms are very different from human optimizers. A human being would gain more experiences through problem-solving, which helps her/him in solving a new unseen problem. Yet an optimization algorithm never gains any…

Neural and Evolutionary Computing · Computer Science 2024-10-28 Xunzhao Yu , Yan Wang , Ling Zhu , Dimitar Filev , Xin Yao

Learning optimal policies in sparse rewards settings is difficult as the learning agent has little to no feedback on the quality of its actions. In these situations, a good strategy is to focus on exploration, hopefully leading to the…

Machine Learning · Computer Science 2023-09-28 Giuseppe Paolo , Miranda Coninx , Alban Laflaquière , Stephane Doncieux

Bayesian optimization is a coherent, ubiquitous approach to decision-making under uncertainty, with applications including multi-arm bandits, active learning, and black-box optimization. Bayesian optimization selects decisions (i.e.…

Machine Learning · Computer Science 2023-12-13 Samuel Stanton , Wesley Maddox , Andrew Gordon Wilson

Scalable and effective exploration remains a key challenge in reinforcement learning (RL). While there are methods with optimality guarantees in the setting of discrete state and action spaces, these methods cannot be applied in…

Machine Learning · Computer Science 2017-01-30 Rein Houthooft , Xi Chen , Yan Duan , John Schulman , Filip De Turck , Pieter Abbeel

Exploration is essential in reinforcement learning as an agent relies on trial and error to learn an optimal policy. However, when rewards are sparse, naive exploration strategies, like noise injection, are often insufficient. Intrinsic…

Machine Learning · Computer Science 2026-01-30 Minjae Cho , Huy Trong Tran

The performance of many machine learning models depends on their hyper-parameter settings. Bayesian Optimization has become a successful tool for hyper-parameter optimization of machine learning algorithms, which aims to identify optimal…

Machine Learning · Computer Science 2020-08-04 Lidan Wang , Franck Dernoncourt , Trung Bui

Accelerating exploration in visual reinforcement learning under sparse rewards remains challenging due to the substantial task-irrelevant variations. Despite advances in intrinsic exploration, many methods either assume access to…

Artificial Intelligence · Computer Science 2026-02-24 Dayang Liang , Ruihan Liu , Lipeng Wan , Yunlong Liu , Bo An

This paper addresses the challenge of active perception within autonomous navigation in complex, unknown environments. Revisiting the foundational principles of active perception, we introduce an end-to-end reinforcement learning framework…

Robotics · Computer Science 2026-02-03 Grzegorz Malczyk , Mihir Kulkarni , Kostas Alexis