English
Related papers

Related papers: The Behavior and Convergence of Local Bayesian Opt…

200 papers

Bayesian Optimization, the application of Bayesian function approximation to finding optima of expensive functions, has exploded in popularity in recent years. In particular, much attention has been paid to improving its efficiency on…

Optimization and Control · Mathematics 2022-05-18 Mickael Binois , Nathan Wycoff

Bayesian optimization is a powerful method for optimizing black-box functions with limited function evaluations. Recent works have shown that optimization in a latent space through deep generative models such as variational autoencoders…

Machine Learning · Computer Science 2023-11-21 Seunghun Lee , Jaewon Chu , Sihyeon Kim , Juyeon Ko , Hyunwoo J. Kim

Many circumstances of practical importance have performance or success metrics which exist implicitly---in the eye of the beholder, so to speak. Tuning aspects of such problems requires working without defined metrics and only considering…

Machine Learning · Statistics 2019-06-11 Michael McCourt , Ian Dewancker

Bayesian coresets have emerged as a promising approach for implementing scalable Bayesian inference. The Bayesian coreset problem involves selecting a (weighted) subset of the data samples, such that the posterior inference using the…

Machine Learning · Statistics 2021-03-01 Jacky Y. Zhang , Rajiv Khanna , Anastasios Kyrillidis , Oluwasanmi Koyejo

Bayesian optimisation (BO) has been a successful approach to optimise functions which are expensive to evaluate and whose observations are noisy. Classical BO algorithms, however, do not account for errors about the location where…

Machine Learning · Computer Science 2019-02-22 Rafael Oliveira , Lionel Ott , Fabio Ramos

A local projection is a statistical framework that accounts for the relationship between an exogenous variable and an endogenous variable, measured at different time points. Local projections are often applied in impulse response analyses…

Methodology · Statistics 2020-03-03 Masahiro Tanaka

Bayesian optimization with Gaussian processes has become an increasingly popular tool in the machine learning community. It is efficient and can be used when very little is known about the objective function, making it popular in expensive…

Machine Learning · Computer Science 2011-03-08 Eric Brochu , Matthew W. Hoffman , Nando de Freitas

This paper studies the problem of online performance optimization of constrained closed-loop control systems, where both the objective and the constraints are unknown black-box functions affected by exogenous time-varying contextual…

Machine Learning · Computer Science 2023-09-22 Wenjie Xu , Yuning Jiang , Bratislav Svetozarevic , Colin N. Jones

We consider a simulation optimization problem for a context-dependent decision-making. A Gaussian mixture model is proposed to capture the performance clustering phenomena of context-dependent designs. Under a Bayesian framework, we develop…

Methodology · Statistics 2020-12-15 Haidong Li , Henry Lam , Yijie Peng

A Bayesian filtering algorithm is developed for a class of state-space systems that can be modelled via Gaussian mixtures. In general, the exact solution to this filtering problem involves an exponential growth in the number of mixture…

Machine Learning · Statistics 2023-07-03 Adrian G. Wills , Johannes Hendriks , Christopher Renton , Brett Ninness

Bayesian optimization is a class of data efficient model based algorithms typically focused on global optimization. We consider the more general case where a user is faced with multiple problems that each need to be optimized conditional on…

Machine Learning · Statistics 2020-11-04 Michael Pearce , Janis Klaise , Matthew Groves

Recently, there has been rising interest in Bayesian optimization -- the optimization of an unknown function with assumptions usually expressed by a Gaussian Process (GP) prior. We study an optimization strategy that directly uses an…

Machine Learning · Statistics 2018-08-14 Zi Wang , Bolei Zhou , Stefanie Jegelka

Computer experiments can emulate the physical systems, help computational investigations, and yield analytic solutions. They have been widely employed with many engineering applications (e.g., aerospace, automotive, energy systems.…

Methodology · Statistics 2022-08-23 Yan Wang , Meng Wang , Areej AlBahar , Xiaowei Yue

Bayesian optimization techniques have been successfully applied to robotics, planning, sensor placement, recommendation, advertising, intelligent user interfaces and automatic algorithm configuration. Despite these successes, the approach…

Machine Learning · Statistics 2016-01-12 Ziyu Wang , Frank Hutter , Masrour Zoghi , David Matheson , Nando de Freitas

In multi-task Bayesian optimization, the goal is to leverage experience from optimizing existing tasks to improve the efficiency of optimizing new ones. While approaches using multi-task Gaussian processes or deep kernel transfer exist, the…

Locally weighted regression was created as a nonparametric learning method that is computationally efficient, can learn from very large amounts of data and add data incrementally. An interesting feature of locally weighted regression is…

Machine Learning · Computer Science 2014-02-05 Franziska Meier , Philipp Hennig , Stefan Schaal

Optimization is widely used in statistics, and often efficiently delivers point estimates on useful spaces involving structural constraints or combinatorial structure. To quantify uncertainty, Gibbs posterior exponentiates the negative loss…

Methodology · Statistics 2025-07-23 Cheng Zeng , Eleni Dilma , Jason Xu , Leo L Duan

Asynchronous Bayesian optimization is a recently implemented technique that allows for parallel operation of experimental systems and disjointed workflows. Contrasting with serial Bayesian optimization which individually selects experiments…

Machine Learning · Computer Science 2024-10-23 Amanda A. Volk , Kristofer G. Reyes , Jeffrey G. Ethier , Luke A. Baldwin

Bayesian optimization has attracted huge attention from diverse research areas in science and engineering, since it is capable of efficiently finding a global optimum of an expensive-to-evaluate black-box function. In general, a…

Machine Learning · Computer Science 2025-07-29 Jungtaek Kim

Scaling Bayesian optimization to high dimensions is challenging task as the global optimization of high-dimensional acquisition function can be expensive and often infeasible. Existing methods depend either on limited active variables or…

Machine Learning · Statistics 2018-02-16 Cheng Li , Sunil Gupta , Santu Rana , Vu Nguyen , Svetha Venkatesh , Alistair Shilton