English
Related papers

Related papers: Classified Regression for Bayesian Optimization: R…

200 papers

Mathematical solvers use parametrized Optimization Problems (OPs) as inputs to yield optimal decisions. In many real-world settings, some of these parameters are unknown or uncertain. Recent research focuses on predicting the value of these…

Machine Learning · Computer Science 2024-09-10 Alan A. Lahoud , Erik Schaffernicht , Johannes A. Stork

Bayesian optimization (BO) is a framework for global optimization of expensive-to-evaluate objective functions. Classical BO methods assume that the objective function is a black box. However, internal information about objective function…

Machine Learning · Computer Science 2022-01-04 Raul Astudillo , Peter I. Frazier

Diversity of environments is a key challenge that causes learned robotic controllers to fail due to the discrepancies between the training and evaluation conditions. Training from demonstrations in various conditions can mitigate---but not…

Robotics · Computer Science 2019-03-15 Sanjay Thakur , Herke van Hoof , Juan Camilo Gamboa Higuera , Doina Precup , David Meger

Bayesian optimisation is a powerful tool to solve expensive black-box problems, but fails when the stationary assumption made on the objective function is strongly violated, which is the case in particular for ill-conditioned or…

Machine Learning · Statistics 2019-12-06 Victor Picheny , Sattar Vakili , Artem Artemev

Bayesian optimisation (BO) uses probabilistic surrogate models - usually Gaussian processes (GPs) - for the optimisation of expensive black-box functions. At each BO iteration, the GP hyperparameters are fit to previously-evaluated data by…

Machine Learning · Computer Science 2021-05-04 George De Ath , Richard Everson , Jonathan Fieldsend

In many learning based control methodologies, learning the unknown dynamic model precedes the control phase, while the aim is to control the system such that it remains in some safe region of the state space. In this work, our aim is to…

Machine Learning · Computer Science 2021-05-14 Farhad Farokhi , Alex Leong , Iman Shames , Mohammad Zamani

Finding optimal feedback controllers for nonlinear dynamic systems from data is hard. Recently, Bayesian optimization (BO) has been proposed as a powerful framework for direct controller tuning from experimental trials. For selecting the…

Systems and Control · Computer Science 2018-02-07 Alonso Marco , Philipp Hennig , Stefan Schaal , Sebastian Trimpe

We present a control method for improved repetitive path following for a ground vehicle that is geared towards long-term operation where the operating conditions can change over time and are initially unknown. We use weighted Bayesian…

Robotics · Computer Science 2019-04-10 Christopher D. McKinnon , Angela P. Schoellig

Bayesian optimization (BO) is increasingly employed in critical applications to find the optimal design with minimal cost. While BO is known for its sample efficiency, relying solely on costly high-fidelity data can still result in high…

Artificial Intelligence · Computer Science 2025-03-25 Zahra Zanjani Foumani , Ramin Bostanabad

Tuning parameters in model predictive control (MPC) presents significant challenges, particularly when there is a notable discrepancy between the controller's predictions and the actual behavior of the closed-loop plant. This mismatch may…

Systems and Control · Electrical Eng. & Systems 2024-10-11 Sebastian Hirt , Andreas Höhl , Joachim Schaeffer , Johannes Pohlodek , Richard D. Braatz , Rolf Findeisen

Parameter settings profoundly impact the performance of machine learning algorithms and laboratory experiments. The classical grid search or trial-error methods are exponentially expensive in large parameter spaces, and Bayesian…

Machine Learning · Computer Science 2017-04-18 Vu Nguyen , Santu Rana , Sunil Gupta , Cheng Li , Svetha Venkatesh

This paper deals with the identification of linear stochastic dynamical systems, where the unknowns include system coefficients and noise variances. Conventional approaches that rely on the maximum likelihood estimation (MLE) require…

Machine Learning · Statistics 2025-08-18 Jinwen Xu , Qin Lu , Yaakov Bar-Shalom

Bayesian optimization (BO) has contributed greatly to improving model performance by suggesting promising hyperparameter configurations iteratively based on observations from multiple training trials. However, only partial knowledge (i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 HyunJae Lee , Heon Song , Hyeonsoo Lee , Gi-hyeon Lee , Suyeong Park , Donggeun Yoo

Recent work on Bayesian optimization has shown its effectiveness in global optimization of difficult black-box objective functions. Many real-world optimization problems of interest also have constraints which are unknown a priori. In this…

Machine Learning · Statistics 2014-03-25 Michael A. Gelbart , Jasper Snoek , Ryan P. Adams

When learning policies for robotic systems from data, safety is a major concern, as violation of safety constraints may cause hardware damage. SafeOpt is an efficient Bayesian optimization (BO) algorithm that can learn policies while…

Robotics · Computer Science 2021-05-28 Dominik Baumann , Alonso Marco , Matteo Turchetta , Sebastian Trimpe

In this paper we develop a dynamic form of Bayesian optimization for machine learning models with the goal of rapidly finding good hyperparameter settings. Our method uses the partial information gained during the training of a machine…

Machine Learning · Statistics 2014-06-17 Kevin Swersky , Jasper Snoek , Ryan Prescott Adams

Bayesian optimization (BO) with preference-based feedback has recently garnered significant attention due to its emerging applications. We refer to this problem as Bayesian Optimization from Human Feedback (BOHF), which differs from…

Machine Learning · Computer Science 2025-05-30 Aya Kayal , Sattar Vakili , Laura Toni , Da-shan Shiu , Alberto Bernacchia

This paper introduces a framework for Bayesian Optimization (BO) with metric movement costs, addressing a critical challenge in practical applications where input alterations incur varying costs. Our approach is a convenient plug-in that…

Methodology · Statistics 2025-11-26 Qiyuan Chen , Raed Al Kontar

Not all generate-and-test search algorithms are created equal. Bayesian Optimization (BO) invests a lot of computation time to generate the candidate solution that best balances the predicted value and the uncertainty given all previous…

Neural and Evolutionary Computing · Computer Science 2020-05-11 Gongjin Lan , Jakub M. Tomczak , Diederik M. Roijers , A. E. Eiben

Bayesian Optimization is a popular approach for optimizing expensive black-box functions. Its key idea is to use a surrogate model to approximate the objective and, importantly, quantify the associated uncertainty that allows a sequential…

Machine Learning · Statistics 2025-02-05 Haoxian Chen , Henry Lam