中文
相关论文

相关论文: Can Global Optimization Strategy Outperform Myopic…

200 篇论文

In this work, we study Bayesian quantum parameter estimation given a finite number of uses of the process encoding one or more unknown physical quantities. For multiple uses, it is conventional to classify quantum metrological protocols as…

量子物理 · 物理学 2026-02-11 Erik L. André , Jessica Bavaresco , Mohammad Mehboudi

Bayesian global optimization (BGO) is an efficient surrogate-assisted technique for problems involving expensive evaluations. A parallel technique can be used to parallelly evaluate the true-expensive objective functions in one iteration to…

人工智能 · 计算机科学 2022-08-09 Kaifeng Yang , Guozhi Dong , Michael Affenzeller

We propose a new globalization strategy that can be used in unconstrained optimization algorithms to support rapid convergence from remote starting points. Our approach is based on using multiple points at each iteration to build a…

最优化与控制 · 数学 2017-05-16 Figen Öztoprak , Ş. İlker Birbil

Bayesian optimization methods allocate limited sampling budgets to maximize expensive-to-evaluate functions. One-step-lookahead policies are often used, but computing optimal multi-step-lookahead policies remains a challenge. We consider a…

最优化与控制 · 数学 2016-07-13 J. Massey Cashore , Lemuel Kumarga , Peter I. Frazier

Bayesian optimization is an effective methodology for the global optimization of functions with expensive evaluations. It relies on querying a distribution over functions defined by a relatively cheap surrogate model. An accurate model for…

A recent development in Bayesian optimization is the use of local optimization strategies, which can deliver strong empirical performance on high-dimensional problems compared to traditional global strategies. The "folk wisdom" in the…

机器学习 · 计算机科学 2024-03-12 Kaiwen Wu , Kyurae Kim , Roman Garnett , Jacob R. Gardner

Bayesian optimization with Gaussian processes has become an increasingly popular tool in the machine learning community. It is efficient and can be used when very little is known about the objective function, making it popular in expensive…

机器学习 · 计算机科学 2011-03-08 Eric Brochu , Matthew W. Hoffman , Nando de Freitas

In the field of global optimization, many existing algorithms face challenges posed by non-convex target functions and high computational complexity or unavailability of gradient information. These limitations, exacerbated by sensitivity to…

最优化与控制 · 数学 2023-10-16 Xinyu Zhang , Sujit Ghosh

The performance of many machine learning models depends on their hyper-parameter settings. Bayesian Optimization has become a successful tool for hyper-parameter optimization of machine learning algorithms, which aims to identify optimal…

机器学习 · 计算机科学 2020-08-04 Lidan Wang , Franck Dernoncourt , Trung Bui

Empirical analysis serves as an important complement to theoretical analysis for studying practical Bayesian optimization. Often empirical insights expose strengths and weaknesses inaccessible to theoretical analysis. We define two metrics…

机器学习 · 计算机科学 2016-04-01 Ian Dewancker , Michael McCourt , Scott Clark , Patrick Hayes , Alexandra Johnson , George Ke

Bayesian optimization (BO) is a sample-efficient approach to optimizing costly-to-evaluate black-box functions. Most BO methods ignore how evaluation costs may vary over the optimization domain. However, these costs can be highly…

机器学习 · 计算机科学 2021-11-15 Raul Astudillo , Daniel R. Jiang , Maximilian Balandat , Eytan Bakshy , Peter I. Frazier

We consider parallel global optimization of derivative-free expensive-to-evaluate functions, and propose an efficient method based on stochastic approximation for implementing a conceptual Bayesian optimization algorithm proposed by…

机器学习 · 统计学 2019-05-07 Jialei Wang , Scott C. Clark , Eric Liu , Peter I. Frazier

Bayesian optimization is a powerful technique for optimizing expensive-to-evaluate black-box functions, consisting of two main components: a surrogate model and an acquisition function. In recent years, myopic acquisition functions have…

机器学习 · 计算机科学 2025-04-30 Hui Chen , Xuhui Fan , Zhangkai Wu , Longbing Cao

Many real world applications can be framed as multi-objective optimization problems, where we wish to simultaneously optimize for multiple criteria. Bayesian optimization techniques for the multi-objective setting are pertinent when the…

机器学习 · 计算机科学 2019-06-24 Biswajit Paria , Kirthevasan Kandasamy , Barnabás Póczos

Bayesian optimisation has gained great popularity as a tool for optimising the parameters of machine learning algorithms and models. Somewhat ironically, setting up the hyper-parameters of Bayesian optimisation methods is notoriously hard.…

机器学习 · 统计学 2014-07-01 Ziyu Wang , Nando de Freitas

Bayesian Optimization using Gaussian Processes is a popular approach to deal with the optimization of expensive black-box functions. However, because of the a priori on the stationarity of the covariance matrix of classic Gaussian…

机器学习 · 统计学 2019-05-10 Ali Hebbal , Loic Brevault , Mathieu Balesdent , El-Ghazali Talbi , Nouredine Melab

In Bayesian optimisation, we often seek to minimise the black-box objective functions that arise in real-world physical systems. A primary contributor to the cost of evaluating such black-box objective functions is often the effort required…

机器学习 · 计算机科学 2024-07-04 Adam X. Yang , Laurence Aitchison , Henry B. Moss

Bandit based optimisation has a remarkable advantage over gradient based approaches due to their global perspective, which eliminates the danger of getting stuck at local optima. However, for continuous optimisation problems or problems…

人工智能 · 计算机科学 2017-05-30 Ole-Christoffer Granmo

Randomized experiments are the gold standard for evaluating the effects of changes to real-world systems. Data in these tests may be difficult to collect and outcomes may have high variance, resulting in potentially large measurement error.…

机器学习 · 统计学 2018-06-27 Benjamin Letham , Brian Karrer , Guilherme Ottoni , Eytan Bakshy

Bayesian optimization is a popular tool for data-efficient optimization of expensive objective functions. In real-life applications like engineering design, the designer often wants to take multiple objectives as well as input uncertainty…

人工智能 · 计算机科学 2022-02-28 J. Qing , I. Couckuyt , T. Dhaene