中文
相关论文

相关论文: Mono-surrogate vs Multi-surrogate in Multi-objecti…

200 篇论文

Bayesian optimization (BO) is a powerful approach for seeking the global optimum of expensive black-box functions and has proven successful for fine tuning hyper-parameters of machine learning models. However, BO is practically limited to…

机器学习 · 统计学 2020-09-28 Riccardo Moriconi , Marc P. Deisenroth , K. S. Sesh Kumar

In decision-making problems, the outcome of an intervention often depends on the causal relationships between system components and is highly costly to evaluate. In such settings, causal Bayesian optimization (CBO) can exploit the causal…

机器学习 · 统计学 2025-02-21 Shriya Bhatija , Paul-David Zuercher , Jakob Thumm , Thomas Bohné

Many real-world functions are defined over both categorical and category-specific continuous variables and thus cannot be optimized by traditional Bayesian optimization (BO) methods. To optimize such functions, we propose a new method that…

机器学习 · 计算机科学 2019-12-02 Dang Nguyen , Sunil Gupta , Santu Rana , Alistair Shilton , Svetha Venkatesh

Bayesian optimisation (BO) uses probabilistic surrogate models - usually Gaussian processes (GPs) - for the optimisation of expensive black-box functions. At each BO iteration, the GP hyperparameters are fit to previously-evaluated data by…

机器学习 · 计算机科学 2021-05-04 George De Ath , Richard Everson , Jonathan Fieldsend

A key requirement for the current generation of artificial decision-makers is that they should adapt well to changes in unexpected situations. This paper addresses the situation in which an AI for aerial dog fighting, with tunable…

机器学习 · 统计学 2016-12-14 Brett W. Israelsen , Nisar Ahmed , Kenneth Center , Roderick Green , Winston Bennett

Bayesian optimization is a sample-efficient approach to solving global optimization problems. Along with a surrogate model, this approach relies on theoretically motivated value heuristics (acquisition functions) to guide the search…

机器学习 · 统计学 2017-12-04 James T. Wilson , Riccardo Moriconi , Frank Hutter , Marc Peter Deisenroth

Bayesian optimization (BO) is a popular method for black-box optimization, which relies on uncertainty as part of its decision-making process when deciding which experiment to perform next. However, not much work has addressed the effect of…

机器学习 · 统计学 2023-01-18 Jonathan Foldager , Mikkel Jordahn , Lars Kai Hansen , Michael Riis Andersen

Bayesian optimization (BO) is a popular algorithm for solving challenging optimization tasks. It is designed for problems where the objective function is expensive to evaluate, perhaps not available in exact form, without gradient…

机器学习 · 统计学 2018-08-22 Umberto Noè , Dirk Husmeier

Multi-objective optimization aims at finding trade-off solutions to conflicting objectives. These constitute the Pareto optimal set. In the context of expensive-to-evaluate functions, it is impossible and often non-informative to look for…

机器学习 · 统计学 2020-02-20 David Gaudrie , Rodolphe Le Riche , Victor Picheny , Benoit Enaux , Vincent Herbert

BayesianOptimization(BO) is a sample-efficient black-box optimizer, and extensive methods have been proposed to build the absolute function response of the black-box function through a probabilistic surrogate model, including…

机器学习 · 计算机科学 2024-02-07 Xiaoxing Wang , Jiaxing Li , Chao Xue , Wei Liu , Weifeng Liu , Xiaokang Yang , Junchi Yan , Dacheng Tao

Bayesian Optimization (BO) with Gaussian Processes relies on optimizing an acquisition function to determine sampling. We investigate the advantages and disadvantages of using a deterministic global solver (MAiNGO) compared to conventional…

Bayesian optimization (BO) methods are useful for optimizing functions that are expensive to evaluate, lack an analytical expression and whose evaluations can be contaminated by noise. These methods rely on a probabilistic model of the…

机器学习 · 统计学 2020-02-04 Eduardo C. Garrido-Merchán , Daniel Hernández-Lobato

Bayesian optimization (BO) is a powerful approach for optimizing black-box, expensive-to-evaluate functions. To enable a flexible trade-off between the cost and accuracy, many applications allow the function to be evaluated at different…

机器学习 · 计算机科学 2021-10-27 Shibo Li , Robert M. Kirby , Shandian Zhe

Several fundamental problems in science and engineering consist of global optimization tasks involving unknown high-dimensional (black-box) functions that map a set of controllable variables to the outcomes of an expensive experiment.…

机器学习 · 计算机科学 2023-09-15 Mohamed Aziz Bhouri , Michael Joly , Robert Yu , Soumalya Sarkar , Paris Perdikaris

Bayesian optimization (BO) is a global optimization strategy designed to find the minimum of an expensive black-box function, typically defined on a compact subset of $\mathcal{R}^d$, by using a Gaussian process (GP) as a surrogate model…

机器学习 · 统计学 2018-09-24 Eero Siivola , Aki Vehtari , Jarno Vanhatalo , Javier González , Michael Riis Andersen

One method to solve expensive black-box optimization problems is to use a surrogate model that approximates the objective based on previous observed evaluations. The surrogate, which is cheaper to evaluate, is optimized instead to find an…

最优化与控制 · 数学 2021-05-28 Rickard Karlsson , Laurens Bliek , Sicco Verwer , Mathijs de Weerdt

This paper presents novel mixed-type Bayesian optimization (BO) algorithms to accelerate the optimization of a target objective function by exploiting correlated auxiliary information of binary type that can be more cheaply obtained, such…

机器学习 · 统计学 2019-06-19 Yehong Zhang , Zhongxiang Dai , Kian Hsiang Low

Macro placement is the problem of placing memory blocks on a chip canvas. It can be formulated as a combinatorial optimization problem over sequence pairs, a representation which describes the relative positions of macros. Solving this…

Cyber-physical systems (CPSs) are often complex and safety-critical, making it both challenging and crucial to ensure that the system's specifications are met. Simulation-based falsification is a practical testing technique for increasing…

系统与控制 · 电气工程与系统科学 2025-02-13 Zahra Ramezani , Kenan Šehić , Luigi Nardi , Knut Åkesson

Machine learning (ML) methods offer a wide range of configurable hyperparameters that have a significant influence on their performance. While accuracy is a commonly used performance objective, in many settings, it is not sufficient.…

机器学习 · 计算机科学 2023-09-27 Romain Egele , Tyler Chang , Yixuan Sun , Venkatram Vishwanath , Prasanna Balaprakash