中文
相关论文

相关论文: On Batch Bayesian Optimization

200 篇论文

Hyperparameter tuning is a challenging problem especially when the system itself involves uncertainty. Due to noisy function evaluations, optimization under uncertainty can be computationally expensive. In this paper, we present a novel…

机器学习 · 计算机科学 2025-10-09 Akash Yadav , Ruda Zhang

Bayesian persuasion studies how an informed sender should influence beliefs of rational receivers who take decisions through Bayesian updating of a common prior. We focus on the online Bayesian persuasion framework, in which the sender…

计算机科学与博弈论 · 计算机科学 2023-03-03 Martino Bernasconi , Matteo Castiglioni , Andrea Celli , Alberto Marchesi , Nicola Gatti , Francesco Trovò

Bayesian optimization is a popular framework for efficiently tackling black-box search problems. As a rule, these algorithms operate by iteratively choosing what to evaluate next until some predefined budget has been exhausted. We…

机器学习 · 统计学 2024-12-12 James T. Wilson

Robotic algorithms typically depend on various parameters, the choice of which significantly affects the robot's performance. While an initial guess for the parameters may be obtained from dynamic models of the robot, parameters are usually…

机器人学 · 计算机科学 2020-04-08 Felix Berkenkamp , Andreas Krause , Angela P. Schoellig

Bayesian optimization is a technique for optimizing black-box target functions. At the core of Bayesian optimization is a surrogate model that predicts the output of the target function at previously unseen inputs to facilitate the…

机器学习 · 计算机科学 2022-03-04 Felix Jimenez , Matthias Katzfuss

Among various acquisition functions (AFs) in Bayesian optimization (BO), Gaussian process upper confidence bound (GP-UCB) and Thompson sampling (TS) are well-known options with established theoretical properties regarding Bayesian…

机器学习 · 计算机科学 2024-06-05 Shion Takeno , Yu Inatsu , Masayuki Karasuyama , Ichiro Takeuchi

Bayesian optimization (BO) has become an effective approach for black-box function optimization problems when function evaluations are expensive and the optimum can be achieved within a relatively small number of queries. However, many…

机器学习 · 统计学 2018-08-06 Zi Wang , Clement Gehring , Pushmeet Kohli , Stefanie Jegelka

We address online combinatorial optimization when the player has a prior over the adversary's sequence of losses. In this framework, Russo and Van Roy proposed an information-theoretic analysis of Thompson Sampling based on the information…

机器学习 · 计算机科学 2022-04-05 Sébastien Bubeck , Mark Sellke

The Bayesian inversion method demonstrates significant potential for solving inverse problems, enabling both point estimation and uncertainty quantification (UQ). However, Bayesian maximum a posteriori (MAP) estimation may become unstable…

数值分析 · 数学 2025-06-04 Ruibiao Song , Liying Zhang

In this article, we propose and develop a novel Bayesian algorithm for optimization of functions whose first and second partial derivatives are known. The basic premise is the Gaussian process representation of the function which induces a…

最优化与控制 · 数学 2020-10-27 Sucharita Roy , Sourabh Bhattacharya

The goal of this paper is to characterize Gaussian-Process optimization in the setting where the function domain is large relative to the number of admissible function evaluations, i.e., where it is impossible to find the global optimum. We…

机器学习 · 计算机科学 2022-01-26 Manuel Wüthrich , Bernhard Schölkopf , Andreas Krause

Bayesian optimization has recently emerged as a popular and efficient tool for global optimization and hyperparameter tuning. Currently, the established Bayesian optimization practice requires a user-defined bounding box which is assumed to…

机器学习 · 统计学 2015-08-18 Bobak Shahriari , Alexandre Bouchard-Côté , Nando de Freitas

In this paper, we consider the problem of black-box optimization using Gaussian Process (GP) bandit optimization with a small number of batches. Assuming the unknown function has a low norm in the Reproducing Kernel Hilbert Space (RKHS), we…

机器学习 · 统计学 2022-02-23 Zihan Li , Jonathan Scarlett

Bilevel optimization, a hierarchical mathematical framework where one optimization problem is nested within another, has emerged as a powerful tool for modeling complex decision-making processes in various fields such as economics,…

机器学习 · 计算机科学 2024-12-25 Omer Ekmekcioglu , Nursen Aydin , Juergen Branke

Gaussian Process based Bayesian Optimization is a widely applied algorithm to learn and optimize under uncertainty, well-known for its sample efficiency. However, recently -- and more frequently -- research studies have empirically…

机器学习 · 统计学 2025-05-20 Antonio Candelieri , Andrea Ponti , Francesco Archetti

Classical evolutionary approaches for multiobjective optimization are quite accurate but incur a lot of queries to the objectives; this can be prohibitive when objectives are expensive oracles. A sample-efficient approach to solving…

最优化与控制 · 数学 2025-02-18 Ashwin Renganathan , Kade E. Carlson

Bayesian Optimisation (BO) methods seek to find global optima of objective functions which are only available as a black-box or are expensive to evaluate. Such methods construct a surrogate model for the objective function, quantifying the…

机器学习 · 统计学 2023-01-10 Enrico Crovini , Simon L. Cotter , Konstantinos Zygalakis , Andrew B. Duncan

The optimization of yields in multi-reactor systems, which are advanced tools in heterogeneous catalysis research, presents a significant challenge due to hierarchical technical constraints. To this respect, this work introduces a novel…

机器学习 · 计算机科学 2024-08-06 Markus Grimm , Sébastien Paul , Pierre Chainais

Numerical simulation of complex optical structures enables their optimization with respect to specific objectives. Often, optimization is done by multiple successive parameter scans, which are time consuming and computationally expensive.…

计算物理 · 物理学 2017-07-27 P. -I. Schneider , X. Garcia Santiago , C. Rockstuhl , S. Burger

Extending Bayesian optimization to batch evaluation can enable the designer to make the most use of parallel computing technology. However, most of current batch approaches do not scale well with the batch size. That is, their performances…

机器学习 · 计算机科学 2025-04-25 Dawei Zhan , Zhaoxi Zeng , Shuoxiao Wei , Ping Wu