中文
相关论文

相关论文: Time-varying Gaussian Process Bandit Optimization …

200 篇论文

Bayesian optimisation (BO) is a well-known efficient algorithm for finding the global optimum of expensive, black-box functions. The current practical BO algorithms have regret bounds ranging from $\mathcal{O}(\frac{logN}{\sqrt{N}})$ to…

机器学习 · 计算机科学 2026-04-28 Hung Tran-The , Sunil Gupta , Santu Rana , Svetha Venkatesh

Black-box problems are common in real life like structural design, drug experiments, and machine learning. When optimizing black-box systems, decision-makers always consider multiple performances and give the final decision by comprehensive…

机器学习 · 计算机科学 2021-01-22 Wenjie Chen , Shengcai Liu , Ke Tang

Bayesian optimization (BO) methods are useful for optimizing functions that are expensive to evaluate, lack an analytical expression and whose evaluations can be contaminated by noise. These methods rely on a probabilistic model of the…

机器学习 · 统计学 2020-02-04 Eduardo C. Garrido-Merchán , Daniel Hernández-Lobato

Originally motivated by default risk management applications, this paper investigates a novel problem, referred to as the profitable bandit problem here. At each step, an agent chooses a subset of the K possible actions. For each action…

机器学习 · 统计学 2018-05-09 Mastane Achab , Stephan Clémençon , Aurélien Garivier

Adapting to a priori unknown noise level is a very important but challenging problem in sequential decision-making as efficient exploration typically requires knowledge of the noise level, which is often loosely specified. We report…

机器学习 · 统计学 2024-06-11 Kwang-Sung Jun , Jungtaek Kim

PAC-Bayes has recently re-emerged as an effective theory with which one can derive principled learning algorithms with tight performance guarantees. However, applications of PAC-Bayes to bandit problems are relatively rare, which is a great…

机器学习 · 计算机科学 2023-09-26 Hamish Flynn , David Reeb , Melih Kandemir , Jan Peters

This paper analyzes the problem of Gaussian process (GP) bandits with deterministic observations. The analysis uses a branch and bound algorithm that is related to the UCB algorithm of (Srinivas et al, 2010). For GPs with Gaussian…

机器学习 · 计算机科学 2012-07-03 Nando de Freitas , Alex Smola , Masrour Zoghi

Time-Varying Bayesian Optimization (TVBO) is the go-to framework for optimizing a time-varying black-box objective function that may be noisy and expensive to evaluate, but its excellent empirical performance remains to be understood…

机器学习 · 统计学 2025-10-21 Anthony Bardou , Patrick Thiran

This paper studies a non-stationary kernelized bandit (KB) problem, also called time-varying Bayesian optimization, where one seeks to minimize the regret under an unknown reward function that varies over time. In particular, we focus on a…

机器学习 · 计算机科学 2024-10-22 Shogo Iwazaki , Shion Takeno

The paper considers the problem of global optimization in the setup of stochastic process bandits. We introduce an UCB algorithm which builds a cascade of discretization trees based on generic chaining in order to render possible his…

机器学习 · 统计学 2016-02-22 Emile Contal , Nicolas Vayatis

The Greedy algorithm is the simplest heuristic in sequential decision problem that carelessly takes the locally optimal choice at each round, disregarding any advantages of exploring and/or information gathering. Theoretically, it is known…

机器学习 · 计算机科学 2021-01-05 Matthieu Jedor , Jonathan Louëdec , Vianney Perchet

Bayesian optimization through Gaussian process regression is an effective method of optimizing an unknown function for which every measurement is expensive. It approximates the objective function and then recommends a new measurement point…

机器学习 · 统计学 2017-05-17 Hildo Bijl , Thomas B. Schön , Jan-Willem van Wingerden , Michel Verhaegen

We study the problem of constrained efficient global optimization, where both the objective and constraints are expensive black-box functions that can be learned with Gaussian processes. We propose CONFIG (CONstrained efFIcient Global…

最优化与控制 · 数学 2025-02-07 Wenjie Xu , Yuning Jiang , Bratislav Svetozarevic , Colin N. Jones

Gaussian Process based Bayesian Optimization is a widely applied algorithm to learn and optimize under uncertainty, well-known for its sample efficiency. However, recently -- and more frequently -- research studies have empirically…

机器学习 · 统计学 2025-05-20 Antonio Candelieri , Andrea Ponti , Francesco Archetti

Bayesian optimization (BO) is a powerful technology for optimizing noisy expensive-to-evaluate black-box functions, with a broad range of real-world applications in science, engineering, economics, manufacturing, and beyond. In this paper,…

机器学习 · 计算机科学 2024-01-30 Joel A. Paulson , Calvin Tsay

One way to reduce the time of conducting optimization studies is to evaluate designs in parallel rather than just one-at-a-time. For expensive-to-evaluate black-boxes, batch versions of Bayesian optimization have been proposed. They work by…

最优化与控制 · 数学 2023-04-04 Mickael Binois , Nicholson Collier , Jonathan Ozik

We consider the two-armed bandit problem as applied to data processing if there are two alternative processing methods available with different a priori unknown efficiencies. One should determine the most effective method and provide its…

统计理论 · 数学 2017-04-13 Alexander V. Kolnogorov

We consider Bandits with Knapsacks (henceforth, BwK), a general model for multi-armed bandits under supply/budget constraints. In particular, a bandit algorithm needs to solve a well-known knapsack problem: find an optimal packing of items…

数据结构与算法 · 计算机科学 2023-03-08 Nicole Immorlica , Karthik Abinav Sankararaman , Robert Schapire , Aleksandrs Slivkins

Modern deep learning methods are very sensitive to many hyperparameters, and, due to the long training times of state-of-the-art models, vanilla Bayesian hyperparameter optimization is typically computationally infeasible. On the other…

机器学习 · 计算机科学 2018-07-06 Stefan Falkner , Aaron Klein , Frank Hutter

Bayesian Optimization (BO) is a sample-efficient optimization algorithm widely employed across various applications. In some challenging BO tasks, input uncertainty arises due to the inevitable randomness in the optimization process, such…

机器学习 · 计算机科学 2023-11-07 Lin Yang , Junlong Lyu , Wenlong Lyu , Zhitang Chen