中文
相关论文

相关论文: An adaptive switch strategy for acquisition functi…

200 篇论文

Wind farm modelling has been an area of rapidly increasing interest with numerous analytical as well as computational-based approaches developed to extend the margins of wind farm efficiency and maximise power production. In this work, we…

机器学习 · 计算机科学 2023-03-30 Sokratis Anagnostopoulos , Jens Bauer , Mariana C. A. Clare , Matthew D. Piggott

The performance of acquisition functions for Bayesian optimisation to locate the global optimum of continuous functions is investigated in terms of the Pareto front between exploration and exploitation. We show that Expected Improvement…

机器学习 · 计算机科学 2021-04-29 George De Ath , Richard M. Everson , Alma A. M. Rahat , Jonathan E. Fieldsend

With the rise of different language model architecture, fine-tuning is becoming even more important for down stream tasks Model gets messy, finding proper hyperparameters for fine-tuning. Although BO has been tried for hyperparameter…

计算与语言 · 计算机科学 2025-05-26 Zishuo Bao , Yibo Liu , Changyutao Qiu

Bayesian optimization is a powerful global optimization technique for expensive black-box functions. One of its shortcomings is that it requires auxiliary optimization of an acquisition function at each iteration. This auxiliary…

机器学习 · 统计学 2014-02-28 Ziyu Wang , Babak Shakibi , Lin Jin , Nando de Freitas

Bayesian optimization (BO) is increasingly employed in critical applications such as materials design and drug discovery. An increasingly popular strategy in BO is to forgo the sole reliance on high-fidelity data and instead use an ensemble…

机器学习 · 统计学 2023-03-22 Zahra Zanjani Foumani , Mehdi Shishehbor , Amin Yousefpour , Ramin Bostanabad

Gaussian Process based Bayesian Optimization is a well-known sample efficient sequential strategy for globally optimizing black-box, expensive, and multi-extremal functions. The role of the Gaussian Process is to provide a probabilistic…

机器学习 · 计算机科学 2023-05-16 Antonio Candelieri

Bayesian optimization (BO) is a typical approach to solve expensive optimization problems. In each iteration of BO, a Gaussian process(GP) model is trained using the previously evaluated solutions; then next candidate solutions for…

神经与进化计算 · 计算机科学 2022-06-23 Jixiang Chen , Fu Luo , Zhenkun Wang

Bayesian optimization (BO) has been widely used to optimize expensive and gradient-free objective functions across various domains. However, existing BO methods have not addressed the objective where both inputs and outputs are functions,…

机器学习 · 统计学 2025-12-11 Jingru Huang , Haijie Xu , Manrui Jiang , Chen Zhang

Bayesian optimization (BO) efficiently finds high-performing parameters by maximizing an acquisition function, which models the promise of parameters. A major computational bottleneck arises in acquisition function optimization, where…

机器学习 · 计算机科学 2025-12-10 Kaichi Irie , Shuhei Watanabe , Masaki Onishi

Bayesian models often involve a small set of hyperparameters determined by maximizing the marginal likelihood. Bayesian optimization is a popular iterative method where a Gaussian process posterior of the underlying function is sequentially…

统计计算 · 统计学 2022-08-18 Oskar Gustafsson , Mattias Villani , Pär Stockhammar

Bayesian optimization is widely used for optimizing expensive black box functions, but most existing approaches focus on scalar responses. In many scientific and engineering settings the response is functional, varying smoothly over an…

机器学习 · 计算机科学 2026-04-28 Pouya Ahadi , Reza Marzban , Ali Adibi , Kamran Paynabar

Design optimization under uncertainty is notoriously difficult when the objective function is expensive to evaluate. State-of-the-art techniques, e.g, stochastic optimization or sampling average approximation, fail to learn exploitable…

最优化与控制 · 数学 2019-06-20 Piyush Pandita , Ilias Bilionis , Jitesh Panchal

Material flow analyses (MFAs) are powerful tools for highlighting resource efficiency opportunities in supply chains. MFAs are often represented as directed graphs, with nodes denoting processes and edges representing mass flows. However,…

应用统计 · 统计学 2026-04-08 Jiankan Liao , Xun Huan , Daniel Cooper

Bayesian optimization (BO) methods choose sample points by optimizing an acquisition function derived from a statistical model of the objective. These acquisition functions are chosen to balance sampling regions with predicted good…

机器学习 · 计算机科学 2024-08-16 Darian Nwankwo , David Bindel

Bayesian optimization with Gaussian processes has become an increasingly popular tool in the machine learning community. It is efficient and can be used when very little is known about the objective function, making it popular in expensive…

机器学习 · 计算机科学 2011-03-08 Eric Brochu , Matthew W. Hoffman , Nando de Freitas

High-fidelity complex engineering simulations are highly predictive, but also computationally expensive and often require substantial computational efforts. The mitigation of computational burden is usually enabled through parallelism in…

机器学习 · 统计学 2021-02-08 Anh Tran , Mike Eldred , Tim Wildey , Scott McCann , Jing Sun , Robert J. Visintainer

Bayesian optimization (BO) conventionally relies on handcrafted acquisition functions (AFs) to sequentially determine the sample points. However, it has been widely observed in practice that the best-performing AF in terms of regret can…

机器学习 · 计算机科学 2021-06-09 Bing-Jing Hsieh , Ping-Chun Hsieh , Xi Liu

Bayesian approaches provide a principled solution to the exploration-exploitation trade-off in Reinforcement Learning. Typical approaches, however, either assume a fully observable environment or scale poorly. This work introduces the…

人工智能 · 计算机科学 2018-11-15 Sammie Katt , Frans Oliehoek , Christopher Amato

Estimating posteriors and the associated model evidences, with desired accuracy and affordable computational cost, is a core issue of Bayesian model updating, and can be of great challenge given expensive-to-evaluate models and posteriors…

统计计算 · 统计学 2026-04-09 Jingwen Song , Pengfei Wei

We propose a novel, theoretically-grounded, acquisition function for Batch Bayesian optimization informed by insights from distributionally ambiguous optimization. Our acquisition function is a lower bound on the well-known Expected…

机器学习 · 统计学 2018-04-17 Nikitas Rontsis , Michael A. Osborne , Paul J. Goulart