中文
相关论文

相关论文: Transfer Learning based Search Space Design for Hy…

200 篇论文

Bayesian optimization (BO) has become an established framework and popular tool for hyperparameter optimization (HPO) of machine learning (ML) algorithms. While known for its sample-efficiency, vanilla BO can not utilize readily available…

机器学习 · 计算机科学 2022-04-26 Carl Hvarfner , Danny Stoll , Artur Souza , Marius Lindauer , Frank Hutter , Luigi Nardi

Applying Bayesian optimization in problems wherein the search space is unknown is challenging. To address this problem, we propose a systematic volume expansion strategy for the Bayesian optimization. We devise a strategy to guarantee that…

机器学习 · 统计学 2019-10-30 Huong Ha , Santu Rana , Sunil Gupta , Thanh Nguyen , Hung Tran-The , Svetha Venkatesh

Bayesian optimization (BO) is a popular technique for sequential black-box function optimization, with applications including parameter tuning, robotics, environmental monitoring, and more. One of the most important challenges in BO is the…

机器学习 · 计算机科学 2018-03-29 Paul Rolland , Jonathan Scarlett , Ilija Bogunovic , Volkan Cevher

Model selection is an integral problem of model based optimization techniques such as Bayesian optimization (BO). Current approaches often treat model selection as an estimation problem, to be periodically updated with observations coming…

机器学习 · 计算机科学 2023-08-02 Manisha Senadeera , Santu Rana , Sunil Gupta , Svetha Venkatesh

Bayesian Optimization (BO) is a well-studied hyperparameter tuning technique that is more efficient than grid search for high-cost, high-parameter machine learning problems. Echocardiography is a ubiquitous modality for evaluating heart…

图像与视频处理 · 电气工程与系统科学 2022-11-21 Son-Tung Tran , Joshua V. Stough , Xiaoyan Zhang , Christopher M. Haggerty

Bayesian optimization (BO) provides a powerful framework for optimizing black-box, expensive-to-evaluate functions. It is therefore an attractive tool for engineering design problems, typically involving multiple objectives. Thanks to the…

机器学习 · 计算机科学 2024-09-06 Navid Ansari , Alireza Javanmardi , Eyke Hüllermeier , Hans-Peter Seidel , Vahid Babaei

An automated technique has recently been proposed to transfer learning in the hierarchical Bayesian optimization algorithm (hBOA) based on distance-based statistics. The technique enables practitioners to improve hBOA efficiency by…

神经与进化计算 · 计算机科学 2012-06-22 Martin Pelikan , Mark W. Hauschild , Pier Luca Lanzi

Bayesian optimization (BO) is a powerful approach to sample-efficient optimization of black-box objective functions. However, the application of BO to areas such as recommendation systems often requires taking the interpretability and…

机器学习 · 计算机科学 2023-03-06 Sulin Liu , Qing Feng , David Eriksson , Benjamin Letham , Eytan Bakshy

Bayesian optimization (BO) based on Gaussian process models is a powerful paradigm to optimize black-box functions that are expensive to evaluate. While several BO algorithms provably converge to the global optimum of the unknown function,…

机器学习 · 统计学 2019-04-03 Felix Berkenkamp , Angela P. Schoellig , Andreas Krause

Bayesian Optimization (BO) is a popular framework for optimizing black-box functions. Despite its effectiveness, BO is often inefficient for high-dimensional problems due to the exponential growth of the search space, heterogeneity of the…

最优化与控制 · 数学 2026-05-08 Sourav Das , Debjani Chakraborty , Pabitra Mitra

Bayesian optimization (BO) is one of the most powerful strategies to solve computationally expensive-to-evaluate blackbox optimization problems. However, BO methods are conventionally used for optimization problems of small dimension…

最优化与控制 · 数学 2025-02-10 Rémy Priem , Youssef Diouane , Nathalie Bartoli , Sylvain Dubreuil , Paul Saves

Bayesian optimization (BO) is a popular approach for sample-efficient optimization of black-box objective functions. While BO has been successfully applied to a wide range of scientific applications, traditional approaches to…

机器学习 · 计算机科学 2023-05-04 Natalie Maus , Kaiwen Wu , David Eriksson , Jacob Gardner

Bayesian optimization (BO) has become an effective approach for black-box function optimization problems when function evaluations are expensive and the optimum can be achieved within a relatively small number of queries. However, many…

机器学习 · 统计学 2018-08-06 Zi Wang , Clement Gehring , Pushmeet Kohli , Stefanie Jegelka

Bayesian optimization is a broadly applied methodology to optimize the expensive black-box function. Despite its success, it still faces the challenge from the high-dimensional search space. To alleviate this problem, we propose a novel…

机器学习 · 计算机科学 2020-10-20 Jingfan Chen , Guanghui Zhu , Chunfeng Yuan , Yihua Huang

Ensuring high accuracy and efficiency of predictive models is paramount in the aerospace industry, particularly in the context of multidisciplinary design and optimization processes. These processes often require numerous evaluations of…

机器学习 · 计算机科学 2025-03-26 James M. Shihua , Paul Saves , Rhea P. Liem , Joseph Morlier

Bayesian optimisation (BO) is a standard approach for sample-efficient global optimisation of expensive black-box functions, yet its scalability to high dimensions remains challenging. Here, we investigate nonlinear dimensionality reduction…

最优化与控制 · 数学 2025-10-20 Luo Long , Coralia Cartis , Paz Fink Shustin

Bayesian Optimization (BO) is a widely used approach for blackbox optimization that leverages a Gaussian process (GP) model and an acquisition function to guide future sampling. While effective in low-dimensional settings, BO faces…

机器学习 · 计算机科学 2025-11-26 Pavankumar Koratikere , Leifur Leifsson

Bayesian optimization (BO) is an effective approach to optimize expensive black-box functions, that seeks to trade-off between exploitation (selecting parameters where the maximum is likely) and exploration (selecting parameters where we…

机器学习 · 统计学 2021-10-19 Tristan Fauvel , Matthew Chalk

Bayesian optimization (BO) is an approach to globally optimizing black-box objective functions that are expensive to evaluate. BO-powered experimental design has found wide application in materials science, chemistry, experimental physics,…

机器学习 · 计算机科学 2023-10-10 Mimi Zhang , Andrew Parnell , Dermot Brabazon , Alessio Benavoli

Bayesian optimization~(BO) is often used for accelerator tuning due to its high sample efficiency. However, the computational scalability of training over large data-set can be problematic and the adoption of historical data in a…