English
Related papers

Related papers: The Behavior and Convergence of Local Bayesian Opt…

200 papers

Inference in the presence of outliers is an important field of research as outliers are ubiquitous and may arise across a variety of problems and domains. Bayesian optimization is method that heavily relies on probabilistic inference. This…

Machine Learning · Computer Science 2017-12-14 Ruben Martinez-Cantin , Kevin Tee , Michael McCourt

We introduce Bayesian optimization, a technique developed for optimizing time-consuming engineering simulations and for fitting machine learning models on large datasets. Bayesian optimization guides the choice of experiments during…

Machine Learning · Statistics 2017-11-22 Peter I. Frazier , Jialei Wang

The popularity of Bayesian optimization methods for efficient exploration of parameter spaces has lead to a series of papers applying Gaussian processes as surrogates in the optimization of functions. However, most proposed approaches only…

Machine Learning · Statistics 2015-10-16 Javier González , Zhenwen Dai , Philipp Hennig , Neil D. Lawrence

Bayesian optimization is a coherent, ubiquitous approach to decision-making under uncertainty, with applications including multi-arm bandits, active learning, and black-box optimization. Bayesian optimization selects decisions (i.e.…

Machine Learning · Computer Science 2023-12-13 Samuel Stanton , Wesley Maddox , Andrew Gordon Wilson

High-dimensional black-box optimisation remains an important yet notoriously challenging problem. Despite the success of Bayesian optimisation methods on continuous domains, domains that are categorical, or that mix continuous and…

Machine Learning · Statistics 2021-06-11 Xingchen Wan , Vu Nguyen , Huong Ha , Binxin Ru , Cong Lu , Michael A. Osborne

Bayesian optimisation is a powerful tool to solve expensive black-box problems, but fails when the stationary assumption made on the objective function is strongly violated, which is the case in particular for ill-conditioned or…

Machine Learning · Statistics 2019-12-06 Victor Picheny , Sattar Vakili , Artem Artemev

Bayesian optimization has emerged at the forefront of expensive black-box optimization due to its data efficiency. Recent years have witnessed a proliferation of studies on the development of new Bayesian optimization algorithms and their…

Machine Learning · Computer Science 2022-11-14 Xilu Wang , Yaochu Jin , Sebastian Schmitt , Markus Olhofer

We propose a practical Bayesian optimization method using Gaussian process regression, of which the marginal likelihood is maximized where the number of model selection steps is guided by a pre-defined threshold. Since Bayesian optimization…

Machine Learning · Statistics 2020-10-19 Jungtaek Kim , Seungjin Choi

Bayesian optimization is a methodology for global optimization of unknown and expensive objectives. It combines a surrogate Bayesian regression model with an acquisition function to decide where to evaluate the objective. Typical regression…

Machine Learning · Computer Science 2023-04-04 Afonso Eduardo , Michael U. Gutmann

Bayesian models often involve a small set of hyperparameters determined by maximizing the marginal likelihood. Bayesian optimization is a popular iterative method where a Gaussian process posterior of the underlying function is sequentially…

Computation · Statistics 2022-08-18 Oskar Gustafsson , Mattias Villani , Pär Stockhammar

Searching large and complex design spaces for a global optimum can be infeasible and unnecessary. A practical alternative is to iteratively refine the neighborhood of an initial design using local optimization methods such as gradient…

Machine Learning · Computer Science 2025-11-25 David Stenger , Armin Lindicke , Alexander von Rohr , Sebastian Trimpe

A local optimization method based on Bayesian Gaussian Processes is developed and applied to atomic structures. The method is applied to a variety of systems including molecules, clusters, bulk materials, and molecules at surfaces. The…

Computational Physics · Physics 2019-09-11 Estefanía Garijo del Río , Jens Jørgen Mortensen , Karsten W. Jacobsen

Recent work reported that simple Bayesian optimization (BO) methods perform well for high-dimensional real-world tasks, seemingly contradicting prior work and tribal knowledge. This paper investigates why. We identify underlying challenges…

Machine Learning · Computer Science 2026-05-15 Leonard Papenmeier , Matthias Poloczek , Luigi Nardi

Sampling-based planning is the predominant paradigm for motion planning in robotics. Most sampling-based planners use a global random sampling scheme to guarantee probabilistic completeness. However, most schemes are often inefficient as…

Robotics · Computer Science 2020-01-22 Tin Lai , Philippe Morere , Fabio Ramos , Gilad Francis

Bayesian optimization is a class of global optimization techniques. In Bayesian optimization, the underlying objective function is modeled as a realization of a Gaussian process. Although the Gaussian process assumption implies a random…

Statistics Theory · Mathematics 2023-05-08 Rui Tuo , Wenjia Wang

Bayesian optimization is proposed for automatic learning of optimal controller parameters from experimental data. A probabilistic description (a Gaussian process) is used to model the unknown function from controller parameters to a…

Systems and Control · Computer Science 2019-01-24 Matthias Neumann-Brosig , Alonso Marco , Dieter Schwarzmann , Sebastian Trimpe

We propose practical extensions to Bayesian optimization for solving dynamic problems. We model dynamic objective functions using spatiotemporal Gaussian process priors which capture all the instances of the functions over time. Our…

Machine Learning · Statistics 2018-03-12 Favour M. Nyikosa , Michael A. Osborne , Stephen J. Roberts

Bayesian optimization has emerged as a strong candidate tool for global optimization of functions with expensive evaluation costs. However, due to the dynamic nature of research in Bayesian approaches, and the evolution of computing…

Applications · Statistics 2018-08-24 Ran Rubin

Bayesian optimization (BO) is a popular global optimization scheme for sample-efficient optimization in domains with expensive function evaluations. The existing BO techniques are capable of finding a single global optimum solution.…

Optimization and Control · Mathematics 2023-08-08 Yongsheng Mei , Tian Lan , Mahdi Imani , Suresh Subramaniam

We introduce a unified framework for contextual and causal Bayesian optimisation, which aims to design intervention policies maximising the expectation of a target variable. Our approach leverages both observed contextual information and…

Machine Learning · Computer Science 2026-02-04 Vahan Arsenyan , Antoine Grosnit , Haitham Bou-Ammar , Arnak Dalalyan