English
Related papers

Related papers: Increasing the Scope as You Learn: Adaptive Bayesi…

200 papers

In robotics, methods and softwares usually require optimizations of hyperparameters in order to be efficient for specific tasks, for instance industrial bin-picking from homogeneous heaps of different objects. We present a developmental…

Robotics · Computer Science 2020-07-31 Maxime Petit , Emmanuel Dellandrea , Liming Chen

While Weighted Lasso sparse regression has appealing statistical guarantees that would entail a major real-world impact in finance, genomics, and brain imaging applications, it is typically scarcely adopted due to its complex…

Machine Learning · Computer Science 2022-06-13 Kenan Šehić , Alexandre Gramfort , Joseph Salmon , Luigi Nardi

While Bayesian Optimization (BO) is a very popular method for optimizing expensive black-box functions, it fails to leverage the experience of domain experts. This causes BO to waste function evaluations on bad design choices (e.g., machine…

Machine Learning · Computer Science 2021-04-20 Artur Souza , Luigi Nardi , Leonardo B. Oliveira , Kunle Olukotun , Marius Lindauer , Frank Hutter

Bayesian Optimisation (BO) is a state-of-the-art global optimisation technique for black-box problems where derivative information is unavailable, and sample efficiency is crucial. However, improving the general scalability of BO has proved…

Optimization and Control · Mathematics 2024-12-13 Luo Long , Coralia Cartis , Paz Fink Shustin

Deep learning techniques play an increasingly important role in industrial and research environments due to their outstanding results. However, the large number of hyper-parameters to be set may lead to errors if they are set manually. The…

Machine Learning · Computer Science 2020-06-04 Michele Fraccaroli , Evelina Lamma , Fabrizio Riguzzi

Bayesian optimization (BO) is a popular algorithm for solving challenging optimization tasks. It is designed for problems where the objective function is expensive to evaluate, perhaps not available in exact form, without gradient…

Machine Learning · Statistics 2018-08-22 Umberto Noè , Dirk Husmeier

Many real-world optimisation problems are defined over both categorical and continuous variables, yet efficient optimisation methods such asBayesian Optimisation (BO) are not designed tohandle such mixed-variable search spaces. Recent…

Machine Learning · Statistics 2022-02-18 Yan Zuo , Amir Dezfouli , Iadine Chades , David Alexander , Benjamin Ward Muir

Optimizing multiple, non-preferential objectives for mixed-variable, expensive black-box problems is important in many areas of engineering and science. The expensive, noisy, black-box nature of these problems makes them ideal candidates…

Machine Learning · Computer Science 2022-11-15 Haris Moazam Sheikh , Philip S. Marcus

Bayesian optimization (BO) has been widely used in machine learning and simulation optimization. With the increase in computational resources and storage capacities in these fields, high-dimensional and large-scale problems are becoming…

Machine Learning · Computer Science 2022-06-02 Haowei Wang , Ercong Zhang , Szu Hui Ng , Giulia Pedrielli

Bayesian optimization is an effective methodology for the global optimization of functions with expensive evaluations. It relies on querying a distribution over functions defined by a relatively cheap surrogate model. An accurate model for…

Many control problems require repeated tuning and adaptation of controllers across distinct closed-loop tasks, where data efficiency and adaptability are critical. We propose a hierarchical Bayesian optimization (BO) framework that is…

Systems and Control · Electrical Eng. & Systems 2026-03-27 Sebastian Hirt , Lukas Theiner , Maik Pfefferkorn , Rolf Findeisen

We consider the problem of optimizing hybrid structures (mixture of discrete and continuous input variables) via expensive black-box function evaluations. This problem arises in many real-world applications. For example, in materials design…

Machine Learning · Computer Science 2021-12-03 Aryan Deshwal , Syrine Belakaria , Janardhan Rao Doppa

We propose a novel Bayesian Optimization approach for black-box functions with an environmental variable whose value determines the tradeoff between evaluation cost and the fidelity of the evaluations. Further, we use a novel approach to…

Machine Learning · Statistics 2018-05-16 Mark McLeod , Michael A. Osborne , Stephen J. Roberts

Modern deep learning tools are remarkably effective in addressing intricate problems. However, their operation as black-box models introduces increased uncertainty in predictions. Additionally, they contend with various challenges,…

Machine Learning · Computer Science 2024-04-09 Sourav Ganguly , Saprativa Bhattacharjee

Bayesian optimization has emerged as a strong candidate tool for global optimization of functions with expensive evaluation costs. However, due to the dynamic nature of research in Bayesian approaches, and the evolution of computing…

Applications · Statistics 2018-08-24 Ran Rubin

Bayesian optimization (BO) has contributed greatly to improving model performance by suggesting promising hyperparameter configurations iteratively based on observations from multiple training trials. However, only partial knowledge (i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 HyunJae Lee , Heon Song , Hyeonsoo Lee , Gi-hyeon Lee , Suyeong Park , Donggeun Yoo

There has been a surge in interest in data-driven experimental design with applications to chemical engineering and drug manufacturing. Bayesian optimization (BO) has proven to be adaptable to such cases, since we can model the reactions of…

A body of work has been done to automate machine learning algorithm to highlight the importance of model choice. Automating the process of choosing the best forecasting model and its corresponding parameters can result to improve a wide…

Machine Learning · Computer Science 2021-09-02 Nadhir Hassen , Irina Rish

Design optimisation offers the potential to develop lightweight aircraft structures with reduced environmental impact. Due to the high number of design variables and constraints, these challenges are typically addressed using gradient-based…

Computational Engineering, Finance, and Science · Computer Science 2025-08-04 Hauke F. Maathuis , Roeland De Breuker , Saullo G. P. Castro

Bayesian Optimization (BO) is a common solution to search optimal hyperparameters based on sample observations of a machine learning model. Existing BO algorithms could converge slowly even collapse when the potential observation noise…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Lei Cui , Yangguang Li , Xin Lu , Dong An , Fenggang Liu