中文
相关论文

相关论文: Epsilon-Greedy Thompson Sampling to Bayesian Optim…

200 篇论文

Bayesian Optimization is a sample-efficient black-box optimization procedure that is typically applied to problems with a small number of independent objectives. However, in practice we often wish to optimize objectives defined over many…

机器学习 · 计算机科学 2021-10-29 Wesley J. Maddox , Maximilian Balandat , Andrew Gordon Wilson , Eytan Bakshy

Recent growing adoption of experimentation in practice has led to a surge of attention to multiarmed bandits as a technique to reduce the opportunity cost of online experiments. In this setting, a decision-maker sequentially chooses among a…

机器学习 · 计算机科学 2022-04-04 Nima Hamidi , Mohsen Bayati

We study preferential Bayesian optimization (BO) where reliable feedback is limited to pairwise comparison called duels. An important challenge in preferential BO, which uses the preferential Gaussian process (GP) model to represent…

机器学习 · 计算机科学 2023-06-13 Shion Takeno , Masahiro Nomura , Masayuki Karasuyama

Bayesian optimization (BO) is a class of sample-efficient global optimization methods, where a probabilistic model conditioned on previous observations is used to determine future evaluations via the optimization of an acquisition function.…

机器学习 · 计算机科学 2020-06-22 Eric Hans Lee , David Eriksson , Bolong Cheng , Michael McCourt , David Bindel

Bayesian optimization in large unstructured discrete spaces is often hindered by the computational cost of maximizing acquisition functions due to the absence of gradients. We propose a scalable alternative based on Thompson sampling that…

机器学习 · 计算机科学 2026-03-02 Nicolas Menet , Aleksandar Terzić , Michael Hersche , Andreas Krause , Abbas Rahimi

Experimental (design) optimization is a key driver in designing and discovering new products and processes. Bayesian Optimization (BO) is an effective tool for optimizing expensive and black-box experimental design processes. While Bayesian…

机器学习 · 计算机科学 2024-02-28 Arun Kumar A , Alistair Shilton , Sunil Gupta , Santu Rana , Stewart Greenhill , Svetha Venkatesh

Bayesian optimization (BO) offers an elegant approach for efficiently optimizing black-box functions. However, acquisition criteria demand their own challenging inner-optimization, which can induce significant overhead. Many practical BO…

机器学习 · 统计学 2024-12-09 Nathan Wycoff , John W. Smith , Annie S. Booth , Robert B. Gramacy

Bayesian optimization (BO) provides a powerful framework for optimizing black-box, expensive-to-evaluate functions. It is therefore an attractive tool for engineering design problems, typically involving multiple objectives. Thanks to the…

机器学习 · 计算机科学 2024-09-06 Navid Ansari , Alireza Javanmardi , Eyke Hüllermeier , Hans-Peter Seidel , Vahid Babaei

Thompson sampling (TS) is a powerful and widely used strategy for sequential decision-making, with applications ranging from Bayesian optimization to reinforcement learning (RL). Despite its success, the theoretical foundations of TS remain…

机器学习 · 计算机科学 2025-10-24 Jasmine Bayrooti , Sattar Vakili , Amanda Prorok , Carl Henrik Ek

Autonomous Experimentation Platforms (AEPs) are advanced manufacturing platforms that, under intelligent control, can sequentially search the material design space (MDS) and identify parameters with the desired properties. At the heart of…

机器学习 · 计算机科学 2023-02-28 Ahmed Shoyeb Raihan , Imtiaz Ahmed

Bayesian optimisation is a powerful tool to solve expensive black-box problems, but fails when the stationary assumption made on the objective function is strongly violated, which is the case in particular for ill-conditioned or…

机器学习 · 统计学 2019-12-06 Victor Picheny , Sattar Vakili , Artem Artemev

Bayesian Optimization, the application of Bayesian function approximation to finding optima of expensive functions, has exploded in popularity in recent years. In particular, much attention has been paid to improving its efficiency on…

最优化与控制 · 数学 2022-05-18 Mickael Binois , Nathan Wycoff

Information-based Bayesian optimization (BO) algorithms have achieved state-of-the-art performance in optimizing a black-box objective function. However, they usually require several approximations or simplifying assumptions (without…

机器学习 · 计算机科学 2021-08-02 Quoc Phong Nguyen , Zhaoxuan Wu , Bryan Kian Hsiang Low , Patrick Jaillet

Contextual bandits are a core technology for personalized mobile health interventions, where decision-making requires adapting to complex, non-linear user behaviors. While Thompson Sampling (TS) is a preferred strategy for these problems,…

机器学习 · 统计学 2026-02-10 Ruizhe Deng , Bibhas Chakraborty , Ran Chen , Yan Shuo Tan

Thompson Sampling (TS) is one of the most effective algorithms for solving contextual multi-armed bandit problems. In this paper, we propose a new algorithm, called Neural Thompson Sampling, which adapts deep neural networks for both…

机器学习 · 计算机科学 2022-01-03 Weitong Zhang , Dongruo Zhou , Lihong Li , Quanquan Gu

Bayesian optimization is a powerful global optimization technique for expensive black-box functions. One of its shortcomings is that it requires auxiliary optimization of an acquisition function at each iteration. This auxiliary…

机器学习 · 统计学 2014-02-28 Ziyu Wang , Babak Shakibi , Lin Jin , Nando de Freitas

Gaussian Process based Bayesian Optimization is a well-known sample efficient sequential strategy for globally optimizing black-box, expensive, and multi-extremal functions. The role of the Gaussian Process is to provide a probabilistic…

机器学习 · 计算机科学 2023-05-16 Antonio Candelieri

Bayesian optimization (BO) is a popular approach for expensive black-box optimization, with applications including parameter tuning, experimental design, robotics. BO usually models the objective function by a Gaussian process (GP), and…

机器学习 · 统计学 2020-01-22 Chao Qian , Hang Xiong , Ke Xue

Bayesian optimization (BO) is one of the most effective methods for closed-loop experimental design and black-box optimization. However, a key limitation of BO is that it is an inherently sequential algorithm (one experiment is proposed per…

机器学习 · 统计学 2023-11-21 Leonardo D. González , Victor M. Zavala

Thompson Sampling provides an efficient technique to introduce prior knowledge in the multi-armed bandit problem, along with providing remarkable empirical performance. In this paper, we revisit the Thompson Sampling algorithm under rewards…

机器学习 · 计算机科学 2019-12-09 Abhimanyu Dubey , Alex Pentland