English
Related papers

Related papers: Semi-supervised Embedding Learning for High-dimens…

200 papers

Bayesian Optimisation (BO) methods seek to find global optima of objective functions which are only available as a black-box or are expensive to evaluate. Such methods construct a surrogate model for the objective function, quantifying the…

Machine Learning · Statistics 2023-01-10 Enrico Crovini , Simon L. Cotter , Konstantinos Zygalakis , Andrew B. Duncan

Bayesian optimization (BO) is a powerful approach for optimizing complex and expensive-to-evaluate black-box functions. Its importance is underscored in many applications, notably including hyperparameter tuning, but its efficacy depends on…

Machine Learning · Computer Science 2024-03-11 Tennison Liu , Nicolás Astorga , Nabeel Seedat , Mihaela van der Schaar

The sample efficiency of Bayesian optimization algorithms depends on carefully crafted acquisition functions (AFs) guiding the sequential collection of function evaluations. The best-performing AF can vary significantly across optimization…

At present, high-dimensional global optimization problems with time-series models have received much attention from engineering fields. Since it was proposed, Bayesian optimization has quickly become a popular and promising approach for…

Machine Learning · Computer Science 2021-08-06 Yuyang Chen , Kaiming Bi , Chih-Hang J. Wu , David Ben-Arieh , Ashesh Sinha

Multi-objective Bayesian optimization has been widely adopted in scientific experiment design, including drug discovery and hyperparameter optimization. In practice, regulatory or safety concerns often impose additional thresholds on…

Machine Learning · Computer Science 2025-04-22 Diantong Li , Fengxue Zhang , Chong Liu , Yuxin Chen

In recent years, leveraging parallel and distributed computational resources has become essential to solve problems of high computational cost. Bayesian optimization (BO) has shown attractive results in those expensive-to-evaluate problems…

Machine Learning · Statistics 2020-06-25 Masahiro Nomura

The optimal assignment of Large Language Models (LLMs) to specialized roles in multi-agent systems is a significant challenge, defined by a vast combinatorial search space, expensive black-box evaluations, and an inherent trade-off between…

Multiagent Systems · Computer Science 2025-11-18 Antonio Sabbatella

Bayesian optimization has become a successful tool for hyperparameter optimization of machine learning algorithms, such as support vector machines or deep neural networks. Despite its success, for large datasets, training and validating a…

Machine Learning · Computer Science 2017-03-08 Aaron Klein , Stefan Falkner , Simon Bartels , Philipp Hennig , Frank Hutter

In this survey, we introduce Meta-Black-Box-Optimization~(MetaBBO) as an emerging avenue within the Evolutionary Computation~(EC) community, which incorporates Meta-learning approaches to assist automated algorithm design. Despite the…

Neural and Evolutionary Computing · Computer Science 2025-05-01 Zeyuan Ma , Hongshu Guo , Yue-Jiao Gong , Jun Zhang , Kay Chen Tan

Bayesian optimization (BO) is one of the most effective methods for closed-loop experimental design and black-box optimization. However, a key limitation of BO is that it is an inherently sequential algorithm (one experiment is proposed per…

Machine Learning · Statistics 2023-11-21 Leonardo D. González , Victor M. Zavala

Bayesian optimization (BO) protocol based on Active Learning (AL) principles has garnered significant attention due to its ability to optimize black-box objective functions efficiently. This capability is a prerequisite for guiding…

Chemical Physics · Physics 2024-08-07 Osman Mamun , Markus Bause , Bhuiyan Shameem Mahmud Ebna Hai

Latent Bayesian optimization (LBO) approaches have successfully adopted Bayesian optimization over a continuous latent space by employing an encoder-decoder architecture to address the challenge of optimization in a high dimensional or…

Machine Learning · Computer Science 2024-11-11 Jaewon Chu , Jinyoung Park , Seunghun Lee , Hyunwoo J. Kim

Bayesian optimization (BO) recently became popular in robotics to optimize control parameters and parametric policies in direct reinforcement learning due to its data efficiency and gradient-free approach. However, its performance may be…

Robotics · Computer Science 2019-10-14 Noémie Jaquier , Leonel Rozo , Sylvain Calinon , Mathias Bürger

Bayesian optimization is popular for optimizing time-consuming black-box objectives. Nonetheless, for hyperparameter tuning in deep neural networks, the time required to evaluate the validation error for even a few hyperparameter settings…

Machine Learning · Computer Science 2019-03-13 Jian Wu , Saul Toscano-Palmerin , Peter I. Frazier , Andrew Gordon Wilson

This work aims to tackle the labor-intensive and resource-consuming task of indoor positioning by proposing an efficient approach. The proposed approach involves the introduction of a semi-supervised learning (SSL) with a biased teacher…

Signal Processing · Electrical Eng. & Systems 2024-08-02 Yupeng Li , Xinyu Ning , Shijian Gao , Yitong Liu , Zhi Sun , Qixing Wang , Jiangzhou Wang

Recently dictionary screening has been proposed as an effective way to improve the computational efficiency of solving the lasso problem, which is one of the most commonly used method for learning sparse representations. To address today's…

Machine Learning · Computer Science 2016-08-29 Yun Wang , Peter J. Ramadge

Bayesian optimization (BO) is a widely-used sequential method for zeroth-order optimization of complex and expensive-to-compute black-box functions. The existing BO methods assume that the function evaluation (feedback) is available to the…

Machine Learning · Computer Science 2022-06-22 Arun Verma , Zhongxiang Dai , Bryan Kian Hsiang Low

Bayesian optimization (BO) is a sample-efficient approach to optimizing costly-to-evaluate black-box functions. Most BO methods ignore how evaluation costs may vary over the optimization domain. However, these costs can be highly…

Machine Learning · Computer Science 2021-11-15 Raul Astudillo , Daniel R. Jiang , Maximilian Balandat , Eytan Bakshy , Peter I. Frazier

Design optimization under uncertainty is notoriously difficult when the objective function is expensive to evaluate. State-of-the-art techniques, e.g, stochastic optimization or sampling average approximation, fail to learn exploitable…

Optimization and Control · Mathematics 2019-06-20 Piyush Pandita , Ilias Bilionis , Jitesh Panchal

Bayesian optimization (BO) is a popular algorithm for solving challenging optimization tasks. It is designed for problems where the objective function is expensive to evaluate, perhaps not available in exact form, without gradient…

Machine Learning · Statistics 2018-08-22 Umberto Noè , Dirk Husmeier
‹ Prev 1 8 9 10 Next ›