中文
相关论文

相关论文: qPOTS: Efficient batch multiobjective Bayesian opt…

200 篇论文

We develop parallel predictive entropy search (PPES), a novel algorithm for Bayesian optimization of expensive black-box objective functions. At each iteration, PPES aims to select a batch of points which will maximize the information gain…

机器学习 · 计算机科学 2015-11-24 Amar Shah , Zoubin Ghahramani

Bayesian optimization is a powerful global optimization technique for expensive black-box functions. One of its shortcomings is that it requires auxiliary optimization of an acquisition function at each iteration. This auxiliary…

机器学习 · 统计学 2014-02-28 Ziyu Wang , Babak Shakibi , Lin Jin , Nando de Freitas

Bayesian optimization (BO) has been widely used to optimize expensive and black-box functions across various domains. However, existing BO methods have not addressed tensor-output functions. To fill this gap, we propose a novel…

机器学习 · 计算机科学 2026-03-03 Jingru Huang , Haijie Xu , Jie Guo , Manrui Jiang , Chen Zhang

The multi-task learning (MTL) paradigm can be traced back to an early paper of Caruana (1997) in which it was argued that data from multiple tasks can be used with the aim to obtain a better performance over learning each task…

机器学习 · 计算机科学 2021-12-10 Andrea Ponti

Bayesian optimization is a sample-efficient approach to global optimization that relies on theoretically motivated value heuristics (acquisition functions) to guide its search process. Fully maximizing acquisition functions produces the…

机器学习 · 统计学 2018-12-04 James T. Wilson , Frank Hutter , Marc Peter Deisenroth

This work presents PESMOC, Predictive Entropy Search for Multi-objective Bayesian Optimization with Constraints, an information-based strategy for the simultaneous optimization of multiple expensive-to-evaluate black-box functions under the…

机器学习 · 统计学 2021-04-15 Eduardo C. Garrido-Merchán , Daniel Hernández-Lobato

BayesianOptimization(BO) is a sample-efficient black-box optimizer, and extensive methods have been proposed to build the absolute function response of the black-box function through a probabilistic surrogate model, including…

机器学习 · 计算机科学 2024-02-07 Xiaoxing Wang , Jiaxing Li , Chao Xue , Wei Liu , Weifeng Liu , Xiaokang Yang , Junchi Yan , Dacheng Tao

Many real world applications can be framed as multi-objective optimization problems, where we wish to simultaneously optimize for multiple criteria. Bayesian optimization techniques for the multi-objective setting are pertinent when the…

机器学习 · 计算机科学 2019-06-24 Biswajit Paria , Kirthevasan Kandasamy , Barnabás Póczos

Optimizing multiple competing black-box objectives is a challenging problem in many fields, including science, engineering, and machine learning. Multi-objective Bayesian optimization (MOBO) is a sample-efficient approach for identifying…

机器学习 · 计算机科学 2021-10-28 Samuel Daulton , Maximilian Balandat , Eytan Bakshy

Preference feedback, in the form of pairwise comparisons rather than scalar scores, has seen increasing use in applications such as human-, laboratory-, and expert-in-the-loop design, as well as scientific discovery. We propose a Thompson…

机器学习 · 统计学 2026-04-29 Joseph Lazzaro , Davide Buffelli , Da-shan Shiu , Sattar Vakili

Bayesian optimization (BO) methods are useful for optimizing functions that are expensive to evaluate, lack an analytical expression and whose evaluations can be contaminated by noise. These methods rely on a probabilistic model of the…

机器学习 · 统计学 2020-02-04 Eduardo C. Garrido-Merchán , Daniel Hernández-Lobato

Information-based Bayesian optimization (BO) algorithms have achieved state-of-the-art performance in optimizing a black-box objective function. However, they usually require several approximations or simplifying assumptions (without…

机器学习 · 计算机科学 2021-08-02 Quoc Phong Nguyen , Zhaoxuan Wu , Bryan Kian Hsiang Low , Patrick Jaillet

A key drawback of the current generation of artificial decision-makers is that they do not adapt well to changes in unexpected situations. This paper addresses the situation in which an AI for aerial dog fighting, with tunable parameters…

机器学习 · 统计学 2016-12-14 Brett Israelsen , Nisar Ahmed

The computational costs of inference and planning have confined Bayesian model-based reinforcement learning to one of two dismal fates: powerful Bayes-adaptive planning but only for simplistic models, or powerful, Bayesian non-parametric…

人工智能 · 计算机科学 2014-02-11 Arthur Guez , David Silver , Peter Dayan

There are a lot of real-world black-box optimization problems that need to optimize multiple criteria simultaneously. However, in a multi-objective optimization (MOO) problem, identifying the whole Pareto front requires the prohibitive…

We propose MUMBO, the first high-performing yet computationally efficient acquisition function for multi-task Bayesian optimization. Here, the challenge is to perform efficient optimization by evaluating low-cost functions somehow related…

机器学习 · 计算机科学 2020-06-23 Henry B. Moss , David S. Leslie , Paul Rayson

The key idea of Bayesian optimization is replacing an expensive target function with a cheap surrogate model. By selection of an acquisition function for Bayesian optimization, we trade off between exploration and exploitation. The…

机器学习 · 统计学 2019-02-20 Leonid Matyushin , Alexey Zaytsev , Oleg Alenkin , Andrey Ustuzhanin

Bayesian optimization (BO) has for sequential optimization of expensive black-box functions demonstrated practicality and effectiveness in many real-world settings. Meta-Bayesian optimization (meta-BO) focuses on improving the sample…

We present a general strategy for turning generative models into candidate solution samplers for batch Bayesian optimization (BO). The use of generative models for BO enables large batch scaling as generative sampling, optimization of…

机器学习 · 统计学 2026-05-15 Rafael Oliveira , Daniel M. Steinberg , Edwin V. Bonilla

This work studies how an AI-controlled dog-fighting agent with tunable decision-making parameters can learn to optimize performance against an intelligent adversary, as measured by a stochastic objective function evaluated on simulated…

机器学习 · 计算机科学 2017-08-01 Brett W. Israelsen , Nisar Ahmed , Kenneth Center , Roderick Green , Winston Bennett