English
Related papers

Related papers: Dynamic Exploration-Exploitation Trade-Off in Acti…

200 papers

Active search formalizes a specialized active learning setting where the goal is to collect members of a rare, valuable class. The state-of-the-art algorithm approximates the optimal Bayesian policy in a budget-aware manner, and has been…

Machine Learning · Computer Science 2024-05-27 Quan Nguyen , Anindya Sarkar , Roman Garnett

Recent advances in machine learning have led to increased deployment of black-box classifiers across a wide variety of applications. In many such situations there is a critical need to both reliably assess the performance of these…

Machine Learning · Statistics 2021-03-16 Disi Ji , Robert L. Logan , Padhraic Smyth , Mark Steyvers

Solving real-life sequential decision making problems under partial observability involves an exploration-exploitation problem. To be successful, an agent needs to efficiently gather valuable information about the state of the world for…

Machine Learning · Computer Science 2020-11-03 Haiyan Yin , Yingzhen Li , Sinno Jialin Pan , Cheng Zhang , Sebastian Tschiatschek

Although exploratory behaviors are ubiquitous in the animal kingdom, their computational underpinnings are still largely unknown. Behavioral Psychology has identified learning as a primary drive underlying many exploratory behaviors.…

Machine Learning · Computer Science 2011-12-14 Daniel Y. Little , Friedrich T. Sommer

This work pushes the boundaries of learning-based methods in autonomous robot exploration in terms of environmental scale and exploration efficiency. We present HEADER, an attention-based reinforcement learning approach with hierarchical…

Robotics · Computer Science 2025-10-20 Yuhong Cao , Yizhuo Wang , Jingsong Liang , Shuhao Liao , Yifeng Zhang , Peizhuo Li , Guillaume Sartoretti

We propose a novel holistic approach for safe autonomous exploration and map building based on constrained Bayesian optimisation. This method finds optimal continuous paths instead of discrete sensing locations that inherently satisfy…

Robotics · Computer Science 2017-03-02 Gilad Francis , Lionel Ott , Roman Marchant , Fabio Ramos

With the rising complexity of numerous novel applications that serve our modern society comes the strong need to design efficient computing platforms. Designing efficient hardware is, however, a complex multi-objective problem that deals…

Hardware Architecture · Computer Science 2023-04-11 Alireza Ghaffari , Masoud Asgharian , Yvon Savaria

Bayesian optimization (BO) is an attractive machine learning framework for performing sample-efficient global optimization of black-box functions. The optimization process is guided by an acquisition function that selects points to acquire…

Machine Learning · Computer Science 2024-10-14 Felix Teufel , Carsten Stahlhut , Jesper Ferkinghoff-Borg

Active inference (AIF) unifies exploration and exploitation by minimizing the Expected Free Energy (EFE), balancing epistemic value (information gain) and pragmatic value (task performance) through a curiosity coefficient. Yet it has been…

Machine Learning · Computer Science 2026-02-06 Yingke Li , Anjali Parashar , Enlu Zhou , Chuchu Fan

Active learning aims to select a small subset of data for annotation such that a classifier learned on the data is highly accurate. This is usually done using heuristic selection methods, however the effectiveness of such methods is limited…

Computation and Language · Computer Science 2017-08-09 Meng Fang , Yuan Li , Trevor Cohn

Online model-free reinforcement learning (RL) methods with continuous actions are playing a prominent role when dealing with real-world applications such as Robotics. However, when confronted to non-stationary environments, these methods…

Machine Learning · Computer Science 2016-10-07 Mehdi Khamassi , Costas Tzafestas

The inherent trade-off in on-line learning is between exploration and exploitation. A good balance between these two (conflicting) goals can achieve a better long-term performance. Can we define an optimal balance? We propose to study this…

Information Theory · Computer Science 2024-11-06 Ram Zamir , Kenneth Rose

Numerous heuristics and advanced approaches have been proposed for exploration in different settings for deep reinforcement learning. Noise-based exploration generally fares well with dense-shaped rewards and bonus-based exploration with…

Machine Learning · Computer Science 2025-10-22 Sebastian Griesbach , Carlo D'Eramo

To determine an optimal plan for complex tasks, one often deals with dynamic and hierarchical relationships between several entities. Traditionally, such problems are tackled with optimal control, which relies on the optimization of cost…

Robotics · Computer Science 2025-05-12 Matteo Priorelli , Ivilin Peev Stoianov

Robots with increasing autonomy progress our space exploration capabilities, particularly for in-situ exploration and sampling to stand in for human explorers. Currently, humans drive robots to meet scientific objectives, but depending on…

Robotics · Computer Science 2023-09-29 Sapphira Akins , Frances Zhu

Successful engineering requires environmentally adapted procedural and architectural approaches. While dealing with complicated issues has become an engineering standard mastering uncertainties in complex environment is still a major issue.…

Systems and Control · Computer Science 2018-06-18 Herbert Palm

While adaptive experimental design has outgrown one-dimensional, staircase-based adaptations, most cognitive experiments still control a single factor and summarize performance with a scalar. We show a validation of a Bayesian, two-axis,…

Machine Learning · Computer Science 2025-10-02 Dom CP Marticorena , Chris Wissmann , Zeyu Lu , Dennis L Barbour

This paper presents an information-theoretic framework for unifying active learning problems: level set estimation (LSE), Bayesian optimization (BO), and their generalized variant. We first introduce a novel active learning criterion that…

Machine Learning · Computer Science 2020-12-22 Quoc Phong Nguyen , Bryan Kian Hsiang Low , Patrick Jaillet

Bayesian model comparison (BMC) offers a principled approach for assessing the relative merits of competing computational models and propagating uncertainty into model selection decisions. However, BMC is often intractable for the popular…

Machine Learning · Statistics 2023-11-27 Lasse Elsemüller , Martin Schnuerch , Paul-Christian Bürkner , Stefan T. Radev

Machine learning interatomic force fields are promising for combining high computational efficiency and accuracy in modeling quantum interactions and simulating atomistic dynamics. Active learning methods have been recently developed to…

Computational Physics · Physics 2023-03-07 Yu Xie , Jonathan Vandermause , Senja Ramakers , Nakib H. Protik , Anders Johansson , Boris Kozinsky