English
Related papers

Related papers: Bayesian Optimization with Automatic Prior Selecti…

200 papers

A Bayesian optimization algorithm for the nurse scheduling problem is presented, which involves choosing a suitable scheduling rule from a set for each nurses assignment. Unlike our previous work that used Gas to implement implicit…

Neural and Evolutionary Computing · Computer Science 2010-07-05 Jingpeng Li , Uwe Aickelin

Deterministic policies are often preferred over stochastic ones when implemented on physical systems. They can prevent erratic and harmful behaviors while being easier to implement and interpret. However, in practice, exploration is largely…

Machine Learning · Computer Science 2024-07-09 Mahdi Kallel , Debabrota Basu , Riad Akrour , Carlo D'Eramo

Despite the recent success of representation learning in sequential decision making, the study of the pure exploration scenario (i.e., identify the best option and minimize the sample complexity) is still limited. In this paper, we study…

Machine Learning · Computer Science 2023-05-31 Yihan Du , Longbo Huang , Wen Sun

In robotics, it is often not possible to learn useful policies using pure model-free reinforcement learning without significant reward shaping or curriculum learning. As a consequence, many researchers rely on expert demonstrations to guide…

Robotics · Computer Science 2021-04-20 Ondrej Biza , Dian Wang , Robert Platt , Jan-Willem van de Meent , Lawson L. S. Wong

Performing multi-objective Bayesian optimisation by scalarising the objectives avoids the computation of expensive multi-dimensional integral-based acquisition functions, instead of allowing one-dimensional standard acquisition…

Machine Learning · Computer Science 2021-04-13 Clym Stock-Williams , Tinkle Chugh , Alma Rahat , Wei Yu

Interactive Machine Learning (IML) seeks to integrate human expertise into machine learning processes. However, most existing algorithms cannot be applied to Realworld Scenarios because their state spaces and/or action spaces are limited to…

Robotics · Computer Science 2024-01-24 Nikolaus Feith , Elmar Rueckert

Multi-fingered robotic grasping is an undeniable stepping stone to universal picking and dexterous manipulation. Yet, multi-fingered grippers remain challenging to control because of their rich nonsmooth contact dynamics or because of…

Robotics · Computer Science 2021-09-30 Norman Marlier , Olivier Brüls , Gilles Louppe

Bayesian optimization is an effective method for finding extrema of a black-box function. We propose a new type of Bayesian optimization for learning user preferences in high-dimensional spaces. The central assumption is that the underlying…

Machine Learning · Statistics 2020-08-17 Petrus Mikkola , Milica Todorović , Jari Järvi , Patrick Rinke , Samuel Kaski

In meta-learning an agent extracts knowledge from observed tasks, aiming to facilitate learning of novel future tasks. Under the assumption that future tasks are 'related' to previous tasks, the accumulated knowledge should be learned in a…

Machine Learning · Statistics 2019-05-21 Ron Amit , Ron Meir

Optimizing robotic action parameters is a significant challenge for manipulation tasks that demand high levels of precision and generalization. Using a model-based approach, the robot must quickly reason about the outcomes of different…

Robotics · Computer Science 2024-03-19 M. Yunus Seker , Oliver Kroemer

Bayesian Optimization critically depends on the choice of acquisition function, but no single strategy is universally optimal; the best choice is non-stationary and problem-dependent. Existing adaptive portfolio methods often base their…

Machine Learning · Computer Science 2026-02-10 Giang Ngo , Dat Phan Trong , Dang Nguyen , Sunil Gupta , Svetha Venkatesh

A new gradient-based optimization approach by automatically scheduling the learning rate has been proposed recently, which is called Binary Forward Exploration (BFE). The Adaptive version of BFE has also been discussed thereafter. In this…

Machine Learning · Computer Science 2022-09-23 Xin Cao

Deep learning is increasingly moving towards a transfer learning paradigm whereby large foundation models are fine-tuned on downstream tasks, starting from an initialization learned on the source task. But an initialization contains…

Machine Learning · Computer Science 2022-05-23 Ravid Shwartz-Ziv , Micah Goldblum , Hossein Souri , Sanyam Kapoor , Chen Zhu , Yann LeCun , Andrew Gordon Wilson

Guided policy search algorithms have been proven to work with incredible accuracy for not only controlling a complicated dynamical system, but also learning optimal policies from various unseen instances. One assumes true nature of the…

Systems and Control · Electrical Eng. & Systems 2020-10-02 Prakash Mallick , Zhiyong Chen , Mohsen Zamani

Bayesian optimization (BO) is a well-established method to optimize black-box functions whose direct evaluations are costly. In this paper, we tackle the problem of incorporating expert knowledge into BO, with the goal of further…

Machine Learning · Computer Science 2022-08-19 Daolang Huang , Louis Filstroff , Petrus Mikkola , Runkai Zheng , Samuel Kaski

Bayesian optimization is a sample-efficient approach to solving global optimization problems. Along with a surrogate model, this approach relies on theoretically motivated value heuristics (acquisition functions) to guide the search…

Machine Learning · Statistics 2017-12-04 James T. Wilson , Riccardo Moriconi , Frank Hutter , Marc Peter Deisenroth

Bayesian Optimization (BO) is a powerful, sample-efficient technique to optimize expensive-to-evaluate functions. Each of the BO components, such as the surrogate model, the acquisition function (AF), or the initial design, is subject to a…

AI agents designed to collaborate with people benefit from models that enable them to anticipate human behavior. However, realistic models tend to require vast amounts of human data, which is often hard to collect. A good prior or…

Machine Learning · Computer Science 2022-11-22 Mesut Yang , Micah Carroll , Anca Dragan

Self-improvement requires robotic systems to initially learn from human-provided data and then gradually enhance their capabilities through interaction with the environment. This is similar to how humans improve their skills through…

Robotics · Computer Science 2025-05-05 Yang Jin , Jun Lv , Wenye Yu , Hongjie Fang , Yong-Lu Li , Cewu Lu

Machine learning (ML) has found broad applicability in quantum information science in topics as diverse as experimental design, state classification, and even studies on quantum foundations. Here, we experimentally realize an approach for…