中文
相关论文

相关论文: Latent Bayesian Optimization via Autoregressive No…

200 篇论文

Recent advances have extended the scope of Bayesian optimization (BO) to expensive-to-evaluate black-box functions with dozens of dimensions, aspiring to unlock impactful applications, for example, in the life sciences, neural architecture…

机器学习 · 计算机科学 2026-05-15 Leonard Papenmeier , Luigi Nardi , Matthias Poloczek

In high-dimensional settings, Bayesian optimization (BO) can be expensive and infeasible. The random embedding Bayesian optimization algorithm is commonly used to address high-dimensional BO challenges. However, this method relies on the…

机器学习 · 计算机科学 2024-08-12 Jiaming Lu , Rong J. B. Zhu

Simulation-based optimization of complex systems over discrete decision spaces is a challenging computational problem. Specifically, discrete decision spaces lead to a combinatorial explosion of possible alternatives, making it…

Because of its sample efficiency, Bayesian optimization (BO) has become a popular approach dealing with expensive black-box optimization problems, such as hyperparameter optimization (HPO). Recent empirical experiments showed that the loss…

机器学习 · 计算机科学 2021-11-11 Difan Deng , Marius Lindauer

Bayesian optimization (BO) is well known to be sample-efficient for solving black-box problems. However, the BO algorithms can sometimes get stuck in suboptimal solutions even with plenty of samples. Intrinsically, such suboptimal problem…

机器学习 · 计算机科学 2025-01-24 Zhendong Guo , Yew-Soon Ong , Tiantian He , Haitao Liu

The optimization of high-dimensional black-box functions is a challenging problem. When a low-dimensional linear embedding structure can be assumed, existing Bayesian optimization (BO) methods often transform the original problem into…

机器学习 · 统计学 2022-11-03 Shuhei A. Horiguchi , Tomoharu Iwata , Taku Tsuzuki , Yosuke Ozawa

The optimization of expensive black-box functions is ubiquitous in science and engineering. A common solution to this problem is Bayesian optimization (BO), which is generally comprised of two components: (i) a surrogate model and (ii) an…

Bayesian optimization has been challenged by datasets with large-scale, high-dimensional, and non-stationary characteristics, which are common in real-world scenarios. Recent works attempt to handle such input by applying neural networks…

机器学习 · 计算机科学 2022-03-17 Fengxue Zhang , Brian Nord , Yuxin Chen

We study how to accelerate Bayesian optimization (BO) on a target task by transferring historical knowledge from related source tasks. Existing work on BO with knowledge transfer either lacks theoretical guarantees or achieves the same…

机器学习 · 统计学 2026-04-29 Haitao Lin , Boxin Zhao , Mladen Kolar , Chong Liu

Bayesian Optimization (BO) is an effective framework for globally optimizing functions whose evaluations are expensive. It is particularly effective for optimizing functions defined over continuous domains and explicitly handles stochastic…

计算工程、金融与科学 · 计算机科学 2026-05-21 Buqing Ou , Frederike Dümbgen

Bayesian optimization (BO) is among the most effective and widely-used blackbox optimization methods. BO proposes solutions according to an explore-exploit trade-off criterion encoded in an acquisition function, many of which are computed…

机器学习 · 计算机科学 2021-02-19 Louis C. Tiao , Aaron Klein , Matthias Seeger , Edwin V. Bonilla , Cedric Archambeau , Fabio Ramos

Bayesian optimization (BO) developed as an approach for the efficient optimization of expensive black-box functions without gradient information. A typical BO paper introduces a new approach and compares it to some alternatives on simulated…

统计计算 · 统计学 2023-10-17 Jiajie Kong , Tony Pourmohamad , Herbert K. H. Lee

Bayesian optimization (BO) is widely adopted in black-box optimization problems and it relies on a surrogate model to approximate the black-box response function. With the increasing number of black-box optimization tasks solved and even…

机器学习 · 计算机科学 2023-08-10 Wenlong Lyu , Shoubo Hu , Jie Chuai , Zhitang Chen

Bayesian optimization (BO ) is an effective method for optimizing expensive-to-evaluate black-box functions. While high-dimensional problems can be particularly challenging, due to the multitude of parameter choices and the potentially high…

机器学习 · 计算机科学 2025-04-09 Erik Hellsten , Carl Hvarfner , Leonard Papenmeier , Luigi Nardi

Bayesian Optimization (BO) has been widely used to efficiently optimize expensive black-box functions with limited evaluations. In this paper, we investigate the use of BO for prompt engineering to enhance text classification with Large…

人工智能 · 计算机科学 2025-10-17 Adam Ballew , Jingbo Wang , Shaogang Ren

First Order Bayesian Optimization (FOBO) is a sample efficient sequential approach to find the global maxima of an expensive-to-evaluate black-box objective function by suitably querying for the function and its gradient evaluations. Such…

机器学习 · 计算机科学 2023-06-21 Utkarsh Prakash , Aryan Chollera , Kushagra Khatwani , Prabuchandran K. J. , Tejas Bodas

Bayesian Optimization (BO) is a widely-used method for optimizing expensive-to-evaluate black-box functions. Traditional BO assumes that the learner has full control over all query variables without additional constraints. However, in many…

机器学习 · 计算机科学 2024-12-23 Vu Viet Hoang , Quoc Anh Hoang Nguyen , Hung Tran The

Bayesian Optimization (BO) is a sample-efficient black-box optimizer commonly used in search spaces where hyperparameters are independent. However, in many practical AutoML scenarios, there will be dependencies among hyperparameters,…

机器学习 · 计算机科学 2025-01-28 Jiaxing Li , Wei Liu , Chao Xue , Yibing Zhan , Xiaoxing Wang , Weifeng Liu , Dacheng Tao

Bayesian optimization (BO) is a powerful class of algorithms for optimizing expensive black-box functions, but designing effective BO algorithms remains a manual, expertise-driven task. Recent advancements in Large Language Models (LLMs)…

机器学习 · 计算机科学 2025-05-28 Wenhu Li , Niki van Stein , Thomas Bäck , Elena Raponi

Reliable visual perception under low illumination remains a core challenge for autonomous robotic systems, where degraded image quality directly compromises navigation, inspection, and various operations. A recent training free approach…

计算机视觉与模式识别 · 计算机科学 2026-04-27 Nathan Shankar , Pawel Ladosz , Hujun Yin