中文
相关论文

相关论文: Sampling Acquisition Functions for Batch Bayesian …

200 篇论文

Many real-world functions are defined over both categorical and category-specific continuous variables and thus cannot be optimized by traditional Bayesian optimization (BO) methods. To optimize such functions, we propose a new method that…

机器学习 · 计算机科学 2019-12-02 Dang Nguyen , Sunil Gupta , Santu Rana , Alistair Shilton , Svetha Venkatesh

Bayesian optimization (BO) is widely used for black-box optimization problems, and have been shown to perform well in various real-world tasks. However, most of the existing BO methods aim to learn the optimal solution, which may become…

机器学习 · 计算机科学 2023-10-20 Xiaobin Song , Benben Jiang

In Bayesian optimization (BO) for expensive black-box optimization tasks, acquisition function (AF) guides sequential sampling and plays a pivotal role for efficient convergence to better optima. Prevailing AFs usually rely on artificial…

机器学习 · 计算机科学 2022-10-04 Zijing Liu , Xiyao Qu , Xuejun Liu , Hongqiang Lyu

Bayesian optimization (BO) is a popular technique for sequential black-box function optimization, with applications including parameter tuning, robotics, environmental monitoring, and more. One of the most important challenges in BO is the…

机器学习 · 计算机科学 2018-03-29 Paul Rolland , Jonathan Scarlett , Ilija Bogunovic , Volkan Cevher

Bayesian optimization is a sample-efficient approach to global optimization that relies on theoretically motivated value heuristics (acquisition functions) to guide its search process. Fully maximizing acquisition functions produces the…

机器学习 · 统计学 2018-12-04 James T. Wilson , Frank Hutter , Marc Peter Deisenroth

Multi-agent coordination is prevalent in many real-world applications. However, such coordination is challenging due to its combinatorial nature. An important observation in this regard is that agents in the real world often only directly…

机器学习 · 计算机科学 2020-06-25 Timothy Verstraeten , Eugenio Bargiacchi , Pieter JK Libin , Jan Helsen , Diederik M Roijers , Ann Nowé

Bayesian optimization (BO) is an efficient method for optimizing expensive black-box functions. In real-world applications, BO often faces a major problem of missing values in inputs. The missing inputs can happen in two cases. First, the…

机器学习 · 计算机科学 2020-06-22 Phuc Luong , Dang Nguyen , Sunil Gupta , Santu Rana , Svetha Venkatesh

We propose a novel, theoretically-grounded, acquisition function for Batch Bayesian optimization informed by insights from distributionally ambiguous optimization. Our acquisition function is a lower bound on the well-known Expected…

机器学习 · 统计学 2018-04-17 Nikitas Rontsis , Michael A. Osborne , Paul J. Goulart

Bayesian optimization (BO) is a widely used algorithm for solving expensive black-box optimization problems. However, its performance decreases significantly on high-dimensional problems due to the inherent high-dimensionality of the…

机器学习 · 计算机科学 2025-04-16 Jundi Huang , Dawei Zhan

Bayesian optimization (BO) has become an established framework and popular tool for hyperparameter optimization (HPO) of machine learning (ML) algorithms. While known for its sample-efficiency, vanilla BO can not utilize readily available…

机器学习 · 计算机科学 2022-04-26 Carl Hvarfner , Danny Stoll , Artur Souza , Marius Lindauer , Frank Hutter , Luigi Nardi

Bayesian optimization (BO) has become a powerful tool for solving simulation-based engineering optimization problems thanks to its ability to integrate physical and mathematical understandings, consider uncertainty, and address the…

机器学习 · 计算机科学 2024-11-01 Bach Do , Taiwo Adebiyi , Ruda Zhang

We present a general strategy for turning generative models into candidate solution samplers for batch Bayesian optimization (BO). The use of generative models for BO enables large batch scaling as generative sampling, optimization of…

机器学习 · 统计学 2026-05-15 Rafael Oliveira , Daniel M. Steinberg , Edwin V. Bonilla

Bayesian optimization (BO) developed as an approach for the efficient optimization of expensive black-box functions without gradient information. A typical BO paper introduces a new approach and compares it to some alternatives on simulated…

统计计算 · 统计学 2023-10-17 Jiajie Kong , Tony Pourmohamad , Herbert K. H. Lee

Optimizing expensive to evaluate black-box functions over an input space consisting of all permutations of d objects is an important problem with many real-world applications. For example, placement of functional blocks in hardware design…

机器学习 · 计算机科学 2021-12-03 Aryan Deshwal , Syrine Belakaria , Janardhan Rao Doppa , Dae Hyun Kim

In settings where the application of reinforcement learning (RL) requires running real-world trials, including the optimization of adaptive health interventions, the number of episodes available for learning can be severely limited due to…

机器学习 · 计算机科学 2024-12-03 Karine Karine , Susan A. Murphy , Benjamin M. Marlin

The long runtime associated with simulating multidisciplinary systems challenges the use of Bayesian optimization for multidisciplinary design optimization (MDO). This is particularly the case if the coupled system is modeled in a…

计算工程、金融与科学 · 计算机科学 2024-08-19 Susanna Baars , Jigar Parekh , Ihar Antonau , Philipp Bekemeyer , Ulrich Römer

Bayesian Optimization (BO) is a powerful, sample-efficient technique to optimize expensive-to-evaluate functions. Each of the BO components, such as the surrogate model, the acquisition function (AF), or the initial design, is subject to a…

Bayesian optimization (BO) is a widely used iterative algorithm for optimizing black-box functions. Each iteration requires maximizing an acquisition function, such as the upper confidence bound (UCB) or a sample path from the Gaussian…

机器学习 · 统计学 2025-06-16 Hwanwoo Kim , Chong Liu , Yuxin Chen

Thompson sampling is a heuristic algorithm for the multi-armed bandit problem which has a long tradition in machine learning. The algorithm has a Bayesian spirit in the sense that it selects arms based on posterior samples of reward…

机器学习 · 计算机科学 2021-02-15 Yi Liu , Veronika Rockova

Chemical space is so large that brute force searches for new interesting molecules are infeasible. High-throughput virtual screening via computer cluster simulations can speed up the discovery process by collecting very large amounts of…