中文
相关论文

相关论文: Ranking over Regression for Bayesian Optimization …

200 篇论文

Carbon Capture and Storage (CCS) stands as a pivotal technology for fostering a sustainable future. The process, which involves injecting supercritical CO$_2$ into underground formations, a method already widely used for Enhanced Oil…

机器学习 · 计算机科学 2026-05-05 Sofianos Panagiotis Fotias , Vassilis Gaganis

Online tuning of real-world plants is a complex optimisation problem that continues to require manual intervention by experienced human operators. Autonomous tuning is a rapidly expanding field of research, where learning-based methods,…

We study Bayesian optimization (BO) in high-dimensional and non-stationary scenarios. Existing algorithms for such scenarios typically require extensive hyperparameter tuning, which limits their practical effectiveness. We propose a…

机器学习 · 计算机科学 2023-07-26 Fengxue Zhang , Jialin Song , James Bowden , Alexander Ladd , Yisong Yue , Thomas A. Desautels , Yuxin Chen

Model selection is an integral problem of model based optimization techniques such as Bayesian optimization (BO). Current approaches often treat model selection as an estimation problem, to be periodically updated with observations coming…

机器学习 · 计算机科学 2023-08-02 Manisha Senadeera , Santu Rana , Sunil Gupta , Svetha Venkatesh

Bayesian optimization is a class of data efficient model based algorithms typically focused on global optimization. We consider the more general case where a user is faced with multiple problems that each need to be optimized conditional on…

机器学习 · 统计学 2020-11-04 Michael Pearce , Janis Klaise , Matthew Groves

Bayesian optimization (BO) is a class of global optimization algorithms, suitable for minimizing an expensive objective function in as few function evaluations as possible. While BO budgets are typically given in iterations, this implicitly…

机器学习 · 计算机科学 2020-03-25 Eric Hans Lee , Valerio Perrone , Cedric Archambeau , Matthias Seeger

Bayesian optimization (BO) is a promising approach for hyperparameter optimization of deep neural networks (DNNs), where each model training can take minutes to hours. In BO, a computationally cheap surrogate model is employed to learn the…

机器学习 · 计算机科学 2023-09-27 Romain Egele , Isabelle Guyon , Venkatram Vishwanath , Prasanna Balaprakash

Bayesian optimization (BO) is a typical approach to solve expensive optimization problems. In each iteration of BO, a Gaussian process(GP) model is trained using the previously evaluated solutions; then next candidate solutions for…

神经与进化计算 · 计算机科学 2022-06-23 Jixiang Chen , Fu Luo , Zhenkun Wang

Bayesian optimization (BO) is a popular global optimization scheme for sample-efficient optimization in domains with expensive function evaluations. The existing BO techniques are capable of finding a single global optimum solution.…

最优化与控制 · 数学 2023-08-08 Yongsheng Mei , Tian Lan , Mahdi Imani , Suresh Subramaniam

Uncertainties such as manufacturing tolerances cause performance variations in complex engineering systems, making robust design optimization (RDO) essential. However, simulation-based RDO faces high computational cost for statistical…

最优化与控制 · 数学 2026-02-10 Hyunho Jang , Dongjin Lee

When applying Bayesian optimization (BO) to scientific workflow, a major yet often overlooked source of uncertainty is the task itself -- namely, what to optimize and how to evaluate it -- which can evolve as evidence accumulates. We…

人工智能 · 计算机科学 2026-05-11 Masaki Adachi , Yuta Suzuki , Juliusz Ziomek

Bayesian optimization (BO) is an effective approach to optimize expensive black-box functions, that seeks to trade-off between exploitation (selecting parameters where the maximum is likely) and exploration (selecting parameters where we…

机器学习 · 统计学 2021-10-19 Tristan Fauvel , Matthew Chalk

Bayesian optimisation (BO) is widely used to optimise stochastic black box functions. While most BO approaches focus on optimising conditional expectations, many applications require risk-averse strategies and alternative criteria…

机器学习 · 统计学 2022-07-11 Victor Picheny , Henry Moss , Léonard Torossian , Nicolas Durrande

Existing Bayesian Optimization (BO) methods typically balance exploration and exploitation to optimize costly objective functions. However, these methods often suffer from a significant one-step bias, which may lead to convergence towards…

机器学习 · 计算机科学 2025-10-23 Ruiyao Miao , Junren Xiao , Shiya Tsang , Hui Xiong , Yingnian Wu

While Bayesian Optimization (BO) is a very popular method for optimizing expensive black-box functions, it fails to leverage the experience of domain experts. This causes BO to waste function evaluations on bad design choices (e.g., machine…

机器学习 · 计算机科学 2021-04-20 Artur Souza , Luigi Nardi , Leonardo B. Oliveira , Kunle Olukotun , Marius Lindauer , Frank Hutter

Bayesian Optimization (BO) has shown great promise for the global optimization of functions that are expensive to evaluate, but despite many successes, standard approaches can struggle in high dimensions. To improve the performance of BO,…

机器学习 · 计算机科学 2022-06-17 Sebastian Ament , Carla Gomes

Bayesian Optimization (BO) is a surrogate-based global optimization strategy that relies on a Gaussian Process regression (GPR) model to approximate the objective function and an acquisition function to suggest candidate points. It is…

机器学习 · 计算机科学 2022-06-28 Kirill Antonov , Elena Raponi , Hao Wang , Carola Doerr

Despite the growing interest in designing truly interactive hyperparameter optimization (HPO) methods, to date, only a few allow to include human feedback. Existing interactive Bayesian optimization (BO) methods incorporate human beliefs by…

机器学习 · 计算机科学 2025-05-26 Jonas Seng , Fabrizio Ventola , Zhongjie Yu , Kristian Kersting

Bayesian optimization techniques have been successfully applied to robotics, planning, sensor placement, recommendation, advertising, intelligent user interfaces and automatic algorithm configuration. Despite these successes, the approach…

机器学习 · 统计学 2016-01-12 Ziyu Wang , Frank Hutter , Masrour Zoghi , David Matheson , Nando de Freitas

Bayesian optimization (BO) is widely used to optimize expensive-to-evaluate black-box functions.BO first builds a surrogate model to represent the objective function and assesses its uncertainty. It then decides where to sample by…

机器学习 · 计算机科学 2024-01-25 Jiayu Zhao , Renyu Yang , Shenghao Qiu , Zheng Wang