English
Related papers

Related papers: Asymptotic Performance of Time-Varying Bayesian Op…

200 papers

Bayesian optimization (BO) has been widely used to optimize expensive and black-box functions across various domains. However, existing BO methods have not addressed tensor-output functions. To fill this gap, we propose a novel…

Machine Learning · Computer Science 2026-03-03 Jingru Huang , Haijie Xu , Jie Guo , Manrui Jiang , Chen Zhang

Bayesian optimization (BO) is a popular method to optimize costly black-box functions. While traditional BO optimizes each new target task from scratch, meta-learning has emerged as a way to leverage knowledge from related tasks to optimize…

Machine Learning · Computer Science 2024-07-01 Jiarong Pan , Stefan Falkner , Felix Berkenkamp , Joaquin Vanschoren

Bayesian Optimization (BO) is an efficient tool for optimizing black-box functions, but its theoretical guarantees typically hold in the asymptotic regime. In many critical real-world applications such as drug discovery or materials design,…

Machine Learning · Computer Science 2025-11-04 Diantong Li , Kyunghyun Cho , Chong Liu

Bayesian optimization usually assumes that a Bayesian prior is given. However, the strong theoretical guarantees in Bayesian optimization are often regrettably compromised in practice because of unknown parameters in the prior. In this…

Machine Learning · Computer Science 2018-11-26 Zi Wang , Beomjoon Kim , Leslie Pack Kaelbling

Preferential Bayesian optimization (PBO) is a framework for optimizing a decision maker's latent utility function using preference feedback. This work introduces the expected utility of the best option (qEUBO) as a novel acquisition…

Machine Learning · Computer Science 2023-03-29 Raul Astudillo , Zhiyuan Jerry Lin , Eytan Bakshy , Peter I. Frazier

We consider the fixed-budget best arm identification problem with rewards following normal distributions. In this problem, the forecaster is given $K$ arms (or treatments) and $T$ time steps. The forecaster attempts to find the arm with the…

Machine Learning · Statistics 2024-04-16 Junpei Komiyama

In this paper, we consider the problem of sequentially optimizing a black-box function $f$ based on noisy samples and bandit feedback. We assume that $f$ is smooth in the sense of having a bounded norm in some reproducing kernel Hilbert…

Machine Learning · Statistics 2018-06-01 Jonathan Scarlett , Ilijia Bogunovic , Volkan Cevher

This paper introduces a model-free real-time optimization (RTO) framework based on unconstrained Bayesian optimization with embedded constraint control. The main contribution lies in demonstrating how this approach simplifies the black-box…

Optimization and Control · Mathematics 2024-02-29 Dinesh Krishnamoorthy

We consider a family of learning strategies for online optimization problems that evolve in continuous time and we show that they lead to no regret. From a more traditional, discrete-time viewpoint, this continuous-time approach allows us…

Optimization and Control · Mathematics 2014-02-28 Joon Kwon , Panayotis Mertikopoulos

Bayesian optimization (BO) iteratively fits a Gaussian process (GP) surrogate to accumulated evaluations and selects new queries via an acquisition function such as expected improvement (EI). In practice, BO often concentrates evaluations…

Methodology · Statistics 2026-01-13 Jiguang Li , Hengrui Luo

I introduce and analyse an anytime version of the Optimally Confident UCB (OCUCB) algorithm designed for minimising the cumulative regret in finite-armed stochastic bandits with subgaussian noise. The new algorithm is simple, intuitive (in…

Machine Learning · Computer Science 2016-05-09 Tor Lattimore

We consider an optimization problem of an expensive-to-evaluate black-box function, in which we can obtain noisy function values in parallel. For this problem, parallel Bayesian optimization (PBO) is a promising approach, which aims to…

Machine Learning · Computer Science 2026-03-13 Shuhei Sugiura , Ichiro Takeuchi , Shion Takeno

Bandit convex optimization (BCO) is a fundamental online learning framework with partial feedback, where the learner observes only the loss incurred at the chosen decision point in each round. In this work, we investigate whether optimistic…

Machine Learning · Computer Science 2026-05-22 Shuche Wang , Adarsh Barik , Vincent Y. F. Tan

Bayesian optimization (BO) is a popular approach for expensive black-box optimization, with applications including parameter tuning, experimental design, robotics. BO usually models the objective function by a Gaussian process (GP), and…

Machine Learning · Statistics 2020-01-22 Chao Qian , Hang Xiong , Ke Xue

Most existing black-box optimization methods assume that all variables in the system being optimized have equal cost and can change freely at each iteration. However, in many real world systems, inputs are passed through a sequence of…

Machine Learning · Computer Science 2021-10-13 Chi-Heng Lin , Joseph D. Miano , Eva L. Dyer

Online bilevel optimization (OBO) has emerged as a powerful framework for many machine learning problems. Prior works have developed several algorithms that minimize the standard bilevel local regret or the window-averaged bilevel local…

Machine Learning · Computer Science 2026-05-12 Tingkai Jia , Haiguang Wang , Cheng Chen

We study the problem of performance optimization of closed-loop control systems with unmodeled dynamics. Bayesian optimization (BO) has been demonstrated to be effective for improving closed-loop performance by automatically tuning…

Machine Learning · Computer Science 2023-01-31 Wenjie Xu , Colin N Jones , Bratislav Svetozarevic , Christopher R. Laughman , Ankush Chakrabarty

We study the problem of performance optimization of closed-loop control systems with unmodeled dynamics. Bayesian optimization (BO) has been demonstrated effective for improving closed-loop performance by automatically tuning controller…

Machine Learning · Computer Science 2021-10-15 Wenjie Xu , Colin N Jones , Bratislav Svetozarevic , Christopher R. Laughman , Ankush Chakrabarty

Bayesian optimization (BO) aims to minimize a given blackbox function using a model that is updated whenever new evidence about the function becomes available. Here, we address the problem of BO under partially right-censored response data,…

Artificial Intelligence · Computer Science 2013-10-09 Frank Hutter , Holger Hoos , Kevin Leyton-Brown

We consider the predict-then-optimize paradigm for decision-making in which a practitioner (1) trains a supervised learning model on historical data of decisions, contexts, and rewards, and then (2) uses the resulting model to make future…

Machine Learning · Computer Science 2024-06-13 Samuel Tan , Peter I. Frazier