中文
相关论文

相关论文: The Parallel Knowledge Gradient Method for Batch B…

200 篇论文

In practice, objective functions of real-time control systems can have multiple local minimums or can dramatically change over the function space, making them hard to optimize. To efficiently optimize such systems, in this paper, we develop…

最优化与控制 · 数学 2022-01-26 Haowei Wang , Songhao Wang , Qun Meng , Szu Hui Ng

Bayesian Optimization is the state of the art technique for the optimization of black boxes, i.e., functions where we do not have access to their analytical expression nor its gradients, they are expensive to evaluate and its evaluation is…

人工智能 · 计算机科学 2021-01-13 Eduardo C. Garrido Merchán , Luis C. Jariego Pérez

Optimizing discrete black-box functions is key in several domains, e.g. protein engineering and drug design. Due to the lack of gradient information and the need for sample efficiency, Bayesian optimization is an ideal candidate for these…

Bayesian optimization has become a successful tool for hyperparameter optimization of machine learning algorithms, such as support vector machines or deep neural networks. Despite its success, for large datasets, training and validating a…

机器学习 · 计算机科学 2017-03-08 Aaron Klein , Stefan Falkner , Simon Bartels , Philipp Hennig , Frank Hutter

Stochastic equations play an important role in computational science, due to their ability to treat a wide variety of complex statistical problems. However, current algorithms are strongly limited by their sampling variance, which scales…

数值分析 · 数学 2017-01-04 Bogdan Opanchuk , Simon Kiesewetter , Peter D. Drummond

Bayesian optimisation is a popular, surrogate model-based approach for optimising expensive black-box functions. Given a surrogate model, the next location to expensively evaluate is chosen via maximisation of a cheap-to-query acquisition…

机器学习 · 计算机科学 2020-03-31 George De Ath , Richard M. Everson , Jonathan E. Fieldsend , Alma A. M. Rahat

Choosing appropriate hyperparameters plays a crucial role in the success of neural networks as hyper-parameters directly control the behavior and performance of the training algorithms. To obtain efficient tuning, Bayesian optimization…

机器学习 · 统计学 2024-02-08 Jiazhao Zhang , Ying Hung , Chung-Ching Lin , Zicheng Liu

Some real-world problems revolve to solve the optimization problem \max_{x\in\mathcal{X}}f\left(x\right) where f\left(.\right) is a black-box function and X might be the set of non-vectorial objects (e.g., distributions) where we can only…

机器学习 · 计算机科学 2017-09-20 Trung Le , Khanh Nguyen , Tu Dinh Nguyen , Dinh Phung

Phase estimation is known to be a robust method for single-qubit gate calibration in quantum computers, while Bayesian estimation is widely used in devising optimal methods for learning in quantum systems. We present Bayesian phase…

量子物理 · 物理学 2025-05-06 Brennan de Neeve , Andrey V. Lebedev , Vlad Negnevitsky , Jonathan P. Home

Bayesian models often involve a small set of hyperparameters determined by maximizing the marginal likelihood. Bayesian optimization is a popular iterative method where a Gaussian process posterior of the underlying function is sequentially…

统计计算 · 统计学 2022-08-18 Oskar Gustafsson , Mattias Villani , Pär Stockhammar

In this paper, the problem of estimating the level set of a black-box function from noisy and expensive evaluation queries is considered. A new algorithm for this problem in the Bayesian framework with a Gaussian Process (GP) prior is…

机器学习 · 统计学 2019-02-27 Shubhanshu Shekhar , Tara Javidi

Bayesian Optimization is methodology used in statistical modelling that utilizes a Gaussian process prior distribution to iteratively update a posterior distribution towards the true distribution of the data. Finding unbiased informative…

机器学习 · 计算机科学 2021-01-05 Ruduan Plug

As machine learning becomes more prominent there is a growing demand to perform several inference tasks in parallel. Running a dedicated model for each task is computationally expensive and therefore there is a great interest in multi-task…

机器学习 · 计算机科学 2024-05-14 Idan Achituve , Idit Diamant , Arnon Netzer , Gal Chechik , Ethan Fetaya

Bayesian optimization is an approach to optimizing objective functions that take a long time (minutes or hours) to evaluate. It is best-suited for optimization over continuous domains of less than 20 dimensions, and tolerates stochastic…

机器学习 · 统计学 2018-07-10 Peter I. Frazier

Bayesian optimization has been successfully applied throughout Chemical Engineering for the optimization of functions that are expensive-to-evaluate, or where gradients are not easily obtainable. However, domain experts often possess…

人机交互 · 计算机科学 2024-04-18 Tom Savage , Ehecatl Antonio del Rio Chanona

This paper focuses on Bayesian Optimization in combinatorial spaces. In many applications in the natural science. Broad applications include the study of molecules, proteins, DNA, device structures and quantum circuit designs, a on…

机器学习 · 计算机科学 2020-11-13 Tony C. Wu , Daniel Flam-Shepherd , Alán Aspuru-Guzik

Performance of machine learning algorithms depends critically on identifying a good set of hyperparameters. While recent approaches use Bayesian optimization to adaptively select configurations, we focus on speeding up random search through…

机器学习 · 计算机科学 2018-06-20 Lisha Li , Kevin Jamieson , Giulia DeSalvo , Afshin Rostamizadeh , Ameet Talwalkar

Batch Bayesian optimisation and Bayesian quadrature have been shown to be sample-efficient methods of performing optimisation and quadrature where expensive-to-evaluate objective functions can be queried in parallel. However, current…

Bayesian optimization (BO) is one of the most effective methods for closed-loop experimental design and black-box optimization. However, a key limitation of BO is that it is an inherently sequential algorithm (one experiment is proposed per…

机器学习 · 统计学 2023-11-21 Leonardo D. González , Victor M. Zavala

Multilevel optimization has gained renewed interest in machine learning due to its promise in applications such as hyperparameter tuning and continual learning. However, existing methods struggle with the inherent difficulty of efficiently…

机器学习 · 计算机科学 2024-10-16 Yuntian Gu , Xuzheng Chen