中文
相关论文

相关论文: Asynchronous Decentralized Bayesian Optimization f…

200 篇论文

Hyperparameter tuning is a challenging problem especially when the system itself involves uncertainty. Due to noisy function evaluations, optimization under uncertainty can be computationally expensive. In this paper, we present a novel…

机器学习 · 计算机科学 2025-10-09 Akash Yadav , Ruda Zhang

Many real-world tasks require optimizing expensive black-box functions accessible only through noisy evaluations, a setting commonly addressed with Bayesian optimization (BO). While Bayesian neural networks (BNNs) have recently emerged as…

机器学习 · 计算机科学 2026-01-14 Farhad Mirkarimi

We propose a novel Bayesian optimization (BO) procedure aimed at identifying the ``profile optima'' of a deterministic black-box computer simulation that has a single control parameter and multiple nuisance parameters. The profile optima…

统计方法学 · 统计学 2025-12-30 Courtney Kyger , James Fernandez , John A. Grunenwald , James Braun , Annie Booth

In high-dimensional settings, Bayesian optimization (BO) can be expensive and infeasible. The random embedding Bayesian optimization algorithm is commonly used to address high-dimensional BO challenges. However, this method relies on the…

机器学习 · 计算机科学 2024-08-12 Jiaming Lu , Rong J. B. Zhu

Bayesian Optimization (BO) is an effective framework for globally optimizing functions whose evaluations are expensive. It is particularly effective for optimizing functions defined over continuous domains and explicitly handles stochastic…

计算工程、金融与科学 · 计算机科学 2026-05-21 Buqing Ou , Frederike Dümbgen

High-dimensional Bayesian optimization (BO) tasks such as molecular design often require 10,000 function evaluations before obtaining meaningful results. While methods like sparse variational Gaussian processes (SVGPs) reduce computational…

机器学习 · 计算机科学 2025-06-11 Natalie Maus , Kyurae Kim , Geoff Pleiss , David Eriksson , John P. Cunningham , Jacob R. Gardner

In this paper, we address the problem of cost-sensitive multi-fidelity Bayesian Optimization (BO) for efficient hyperparameter optimization (HPO). Specifically, we assume a scenario where users want to early-stop the BO when the performance…

机器学习 · 计算机科学 2024-05-29 Dong Bok Lee , Aoxuan Silvia Zhang , Byungjoo Kim , Junhyeon Park , Juho Lee , Sung Ju Hwang , Hae Beom Lee

This paper considers a class of distributed bilevel optimization (DBO) problems with a coupled inner-level subproblem. Existing approaches typically rely on hypergradient estimations involving computationally expensive Hessian evaluation.…

最优化与控制 · 数学 2026-02-27 Youcheng Niu , Jinming Xu , Ying Sun , Li Chai , Jiming Chen

Bayesian optimization (BO) has become an indispensable tool for autonomous decision-making across diverse applications from autonomous vehicle control to accelerated drug and materials discovery. With the growing interest in self-driving…

机器学习 · 计算机科学 2025-08-22 Gary Tom , Stanley Lo , Samantha Corapi , Alan Aspuru-Guzik , Benjamin Sanchez-Lengeling

Efficient optimization of molecules with targeted properties remains a significant challenge due to the vast size and discrete nature of chemical compound space. Conventional machine-learning-based optimization approaches typically require…

化学物理 · 物理学 2026-03-04 Yun-Wen Mao , Roman V. Krems

Motivated by the growing need for black-box optimization and data privacy, we introduce a collaborative Bayesian optimization (BO) framework that addresses both of these challenges. In this framework agents work collaboratively to optimize…

机器学习 · 计算机科学 2025-04-16 Donglin Zhan , Haoting Zhang , Rhonda Righter , Zeyu Zheng , James Anderson

Batch Bayesian optimisation and Bayesian quadrature have been shown to be sample-efficient methods of performing optimisation and quadrature where expensive-to-evaluate objective functions can be queried in parallel. However, current…

Bayesian optimization (BO), while proved highly effective for many black-box function optimization tasks, requires practitioners to carefully select priors that well model their functions of interest. Rather than specifying by hand,…

机器学习 · 计算机科学 2023-09-29 Zhou Fan , Xinran Han , Zi Wang

Uncertainties such as manufacturing tolerances cause performance variations in complex engineering systems, making robust design optimization (RDO) essential. However, simulation-based RDO faces high computational cost for statistical…

最优化与控制 · 数学 2026-02-10 Hyunho Jang , Dongjin Lee

Bayesian optimization (BO) is a powerful method for optimizing black-box manufacturing processes, but its performance is often limited when dealing with high-dimensional multi-stage systems, where we can observe intermediate outputs.…

机器学习 · 计算机科学 2026-05-19 Saksham Kiroriwal , Julius Pfrommer , Jürgen Beyerer

Scaling Bayesian optimisation (BO) to high-dimensional search spaces is a active and open research problems particularly when no assumptions are made on function structure. The main reason is that at each iteration, BO requires to find…

机器学习 · 统计学 2026-04-28 Hung Tran-The , Sunil Gupta , Santu Rana , Svetha Venkatesh

Bayesian optimization (BO) has become a popular strategy for global optimization of many expensive real-world functions. Contrary to a common belief that BO is suited to optimizing black-box functions, it actually requires domain knowledge…

Given the increasing importance of machine learning (ML) in our lives, several algorithmic fairness techniques have been proposed to mitigate biases in the outcomes of the ML models. However, most of these techniques are specialized to…

A wide spectrum of design and decision problems, including parameter tuning, A/B testing and drug design, intrinsically are instances of black-box optimization. Bayesian optimization (BO) is a powerful tool that models and optimizes such…

机器学习 · 计算机科学 2023-02-14 Tianyi Bai , Yang Li , Yu Shen , Xinyi Zhang , Wentao Zhang , Bin Cui

In a standard setting of Bayesian optimization (BO), the objective function evaluation is assumed to be highly expensive. Multi-fidelity Bayesian optimization (MFBO) accelerates BO by incorporating lower fidelity observations available with…