中文
相关论文

相关论文: Asynchronous Parallel Bayesian Optimisation via Th…

200 篇论文

Deployments of Bayesian Optimization (BO) for functions with stochastic evaluations, such as parameter tuning via cross validation and simulation optimization, typically optimize an average of a fixed set of noisy realizations of the…

机器学习 · 计算机科学 2020-07-03 Henry B. Moss , David S. Leslie , Paul Rayson

The optimization of expensive black-box functions is ubiquitous in science and engineering. A common solution to this problem is Bayesian optimization (BO), which is generally comprised of two components: (i) a surrogate model and (ii) an…

Bayesian optimization (BO) has well-documented merits for optimizing black-box functions with an expensive evaluation cost. Such functions emerge in applications as diverse as hyperparameter tuning, drug discovery, and robotics. BO hinges…

机器学习 · 统计学 2026-05-28 Qin Lu , Konstantinos D. Polyzos , Bingcong Li , Georgios B. Giannakis

This paper proposes Bayesian optimization augmented factoring self-scheduling (BO FSS), a new parallel loop scheduling strategy. BO FSS is an automatic tuning variant of the factoring self-scheduling (FSS) algorithm and is based on Bayesian…

分布式、并行与集群计算 · 计算机科学 2022-06-14 Kyurae Kim , Youngjae Kim , Sungyong Park

Many real-world functions are defined over both categorical and category-specific continuous variables and thus cannot be optimized by traditional Bayesian optimization (BO) methods. To optimize such functions, we propose a new method that…

机器学习 · 计算机科学 2019-12-02 Dang Nguyen , Sunil Gupta , Santu Rana , Alistair Shilton , Svetha Venkatesh

Thompson sampling (TS) has optimal regret and excellent empirical performance in multi-armed bandit problems. Yet, in Bayesian optimization, TS underperforms popular acquisition functions (e.g., EI, UCB). TS samples arms according to the…

机器学习 · 统计学 2024-12-02 David Sweet

Thompson sampling (TS) is a Bayesian randomized exploration strategy that samples options (e.g., system parameters or control laws) from the current posterior and then applies the selected option that is optimal for a task, thereby…

机器学习 · 计算机科学 2026-02-06 Kaikai Zheng , Dawei Shi , Yang Shi , Long Wang

Bayesian optimization (BO) is a powerful framework for estimating parameters of expensive simulation models, particularly in settings where the likelihood is intractable and evaluations are costly. In stochastic models every simulation is…

统计方法学 · 统计学 2026-04-16 Arindam Fadikar , Abby Stevens , Mickael Binois , Nicholson Collier , David O'Gara , Jonathan Ozik

Bayesian optimization (BO) provides a powerful framework for optimizing black-box, expensive-to-evaluate functions. It is therefore an attractive tool for engineering design problems, typically involving multiple objectives. Thanks to the…

机器学习 · 计算机科学 2024-09-06 Navid Ansari , Alireza Javanmardi , Eyke Hüllermeier , Hans-Peter Seidel , Vahid Babaei

Asynchronous Bayesian optimization is widely used for gradient-free optimization in domains with independent parallel experiments and varying evaluation times. Existing methods posit that standard acquisitions lead to redundant and repeated…

机器学习 · 统计学 2026-03-17 Ben Riegler , James Odgers , Vincent Fortuin

Thompson sampling has been shown to be an effective policy across a variety of online learning tasks. Many works have analyzed the finite time performance of Thompson sampling, and proved that it achieves a sub-linear regret under a broad…

机器学习 · 计算机科学 2020-11-10 Cem Kalkanli , Ayfer Ozgur

Classical evolutionary approaches for multiobjective optimization are quite accurate but incur a lot of queries to the objectives; this can be prohibitive when objectives are expensive oracles. A sample-efficient approach to solving…

最优化与控制 · 数学 2025-02-18 Ashwin Renganathan , Kade E. Carlson

In Bayesian Optimization (BO), additive assumptions can mitigate the twin difficulties of modeling and searching a complex function in high dimension. However, common acquisition functions, like the Additive Lower Confidence Bound, ignore…

机器学习 · 统计学 2025-10-15 Nathan Wycoff

Bayesian optimization (BO) is one of the most effective methods for closed-loop experimental design and black-box optimization. However, a key limitation of BO is that it is an inherently sequential algorithm (one experiment is proposed per…

机器学习 · 统计学 2023-11-21 Leonardo D. González , Victor M. Zavala

Thompson Sampling (TS) is one of the most effective algorithms for solving contextual multi-armed bandit problems. In this paper, we propose a new algorithm, called Neural Thompson Sampling, which adapts deep neural networks for both…

机器学习 · 计算机科学 2022-01-03 Weitong Zhang , Dongruo Zhou , Lihong Li , Quanquan Gu

Bayesian optimization (BO) is a popular methodology to tune the hyperparameters of expensive black-box functions. Traditionally, BO focuses on a single task at a time and is not designed to leverage information from related functions, such…

机器学习 · 统计学 2021-04-20 David Salinas , Huibin Shen , Valerio Perrone

Thompson Sampling provides an efficient technique to introduce prior knowledge in the multi-armed bandit problem, along with providing remarkable empirical performance. In this paper, we revisit the Thompson Sampling algorithm under rewards…

机器学习 · 计算机科学 2019-12-09 Abhimanyu Dubey , Alex Pentland

Bayesian optimization (BO) has become a powerful tool for solving simulation-based engineering optimization problems thanks to its ability to integrate physical and mathematical understandings, consider uncertainty, and address the…

机器学习 · 计算机科学 2024-11-01 Bach Do , Taiwo Adebiyi , Ruda Zhang

Bayesian optimization (BO) has for sequential optimization of expensive black-box functions demonstrated practicality and effectiveness in many real-world settings. Meta-Bayesian optimization (meta-BO) focuses on improving the sample…

Bayesian optimization (BO) is a popular, sample-efficient technique for expensive, black-box optimization. One such problem arising in manufacturing is that of maximizing the reliability, or equivalently minimizing the probability of a…

机器学习 · 计算机科学 2026-02-03 Jack M. Buckingham , Ivo Couckuyt , Juergen Branke