中文
相关论文

相关论文: Incorporating Expert Prior in Bayesian Optimisatio…

200 篇论文

In this article, we propose and develop a novel Bayesian algorithm for optimization of functions whose first and second partial derivatives are known. The basic premise is the Gaussian process representation of the function which induces a…

最优化与控制 · 数学 2020-10-27 Sucharita Roy , Sourabh Bhattacharya

Bayesian optimization has emerged at the forefront of expensive black-box optimization due to its data efficiency. Recent years have witnessed a proliferation of studies on the development of new Bayesian optimization algorithms and their…

机器学习 · 计算机科学 2022-11-14 Xilu Wang , Yaochu Jin , Sebastian Schmitt , Markus Olhofer

Information-theoretic Bayesian optimisation techniques have demonstrated state-of-the-art performance in tackling important global optimisation problems. However, current information-theoretic approaches require many approximations in…

机器学习 · 统计学 2018-06-07 Binxin Ru , Mark McLeod , Diego Granziol , Michael A. Osborne

Portfolio optimization is a critical task in investment. Most existing portfolio optimization methods require information on the distribution of returns of the assets that make up the portfolio. However, such distribution information is…

计量经济学 · 经济学 2025-10-09 Masahiro Kato , Kentaro Baba , Hibiki Kaibuchi , Ryo Inokuchi

Optimizing expensive-to-evaluate black-box functions of discrete (and potentially continuous) design parameters is a ubiquitous problem in scientific and engineering applications. Bayesian optimization (BO) is a popular, sample-efficient…

机器学习 · 计算机科学 2022-10-20 Samuel Daulton , Xingchen Wan , David Eriksson , Maximilian Balandat , Michael A. Osborne , Eytan Bakshy

Bayesian inversion is central to the quantification of uncertainty within problems arising from numerous applications in science and engineering. To formulate the approach, four ingredients are required: a forward model mapping the unknown…

机器学习 · 统计学 2025-05-15 O. Deniz Akyildiz , Mark Girolami , Andrew M. Stuart , Arnaud Vadeboncoeur

Bayesian optimization (BO) is an effective approach to optimize expensive black-box functions, that seeks to trade-off between exploitation (selecting parameters where the maximum is likely) and exploration (selecting parameters where we…

机器学习 · 统计学 2021-10-19 Tristan Fauvel , Matthew Chalk

Bayesian optimization (BO) offers an elegant approach for efficiently optimizing black-box functions. However, acquisition criteria demand their own challenging inner-optimization, which can induce significant overhead. Many practical BO…

机器学习 · 统计学 2024-12-09 Nathan Wycoff , John W. Smith , Annie S. Booth , Robert B. Gramacy

Bayesian Optimization (BO) is an efficient tool for optimizing black-box functions, but its theoretical guarantees typically hold in the asymptotic regime. In many critical real-world applications such as drug discovery or materials design,…

机器学习 · 计算机科学 2025-11-04 Diantong Li , Kyunghyun Cho , Chong Liu

Bayesian optimization (BO) is a framework for global optimization of expensive-to-evaluate objective functions. Classical BO methods assume that the objective function is a black box. However, internal information about objective function…

机器学习 · 计算机科学 2022-01-04 Raul Astudillo , Peter I. Frazier

Stability selection is a versatile framework for structure estimation and variable selection in high-dimensional setting, primarily grounded in frequentist principles. In this paper, we propose an enhanced methodology that integrates…

统计方法学 · 统计学 2026-05-05 Mahdi Nouraie , Connor Smith , Samuel Muller

This paper studies optimization on networks modeled as metric graphs. Motivated by applications where the objective function is expensive to evaluate or only available as a black box, we develop Bayesian optimization algorithms that…

机器学习 · 统计学 2026-03-30 Wenwen Li , Daniel Sanz-Alonso , Ruiyi Yang

Bayesian optimisation is a popular, surrogate model-based approach for optimising expensive black-box functions. Given a surrogate model, the next location to expensively evaluate is chosen via maximisation of a cheap-to-query acquisition…

机器学习 · 计算机科学 2020-03-31 George De Ath , Richard M. Everson , Jonathan E. Fieldsend , Alma A. M. Rahat

Bayesian calibration of black-box computer models offers an established framework to obtain a posterior distribution over model parameters. Traditional Bayesian calibration involves the emulation of the computer model and an additive model…

机器学习 · 统计学 2018-10-30 Sébastien Marmin , Maurizio Filippone

A central characteristic of Bayesian statistics is the ability to consistently incorporate prior knowledge into various modeling processes. In this paper, we focus on translating domain expert knowledge into corresponding prior…

统计方法学 · 统计学 2024-04-16 Florence Bockting , Stefan T. Radev , Paul-Christian Bürkner

We introduce BayeSQP, a novel algorithm for general black-box optimization that merges the structure of sequential quadratic programming with concepts from Bayesian optimization. BayeSQP employs second-order Gaussian process surrogates for…

机器学习 · 计算机科学 2026-02-04 Paul Brunzema , Sebastian Trimpe

Bayesian optimization (BO) is a model-based approach to sequentially optimize expensive black-box functions, such as the validation error of a deep neural network with respect to its hyperparameters. In many real-world scenarios, the…

We revisit the classic ski rental problem through the lens of Bayesian decision-making and machine-learned predictions. While traditional algorithms minimize worst-case cost without assumptions, and recent learning-augmented approaches…

机器学习 · 计算机科学 2025-12-09 Bosun Kang , Hyejun Park , Chenglin Fan

Sparse modeling for signal processing and machine learning has been at the focus of scientific research for over two decades. Among others, supervised sparsity-aware learning comprises two major paths paved by: a) discriminative methods and…

机器学习 · 统计学 2022-11-23 Lei Cheng , Feng Yin , Sergios Theodoridis , Sotirios Chatzis , Tsung-Hui Chang

The problem of optimizing unknown costly-to-evaluate functions has been studied for a long time in the context of Bayesian Optimization. Algorithms in this field aim to find the optimizer of the function by asking only a few function…

机器学习 · 计算机科学 2013-07-17 Ali Jalali , Javad Azimi , Xiaoli Fern , Ruofei Zhang