English
Related papers

Related papers: Curvature-aware Expected Free Energy as an Acquisi…

200 papers

Bayesian optimisation (BO) algorithms have shown remarkable success in applications involving expensive black-box functions. Traditionally BO has been set as a sequential decision-making process which estimates the utility of query points…

Machine Learning · Computer Science 2022-10-25 Rafael Oliveira , Louis Tiao , Fabio Ramos

Adaptive Bayesian quadrature (ABQ) is a powerful approach to numerical integration that empirically compares favorably with Monte Carlo integration on problems of medium dimensionality (where non-adaptive quadrature is not competitive). Its…

Machine Learning · Statistics 2019-10-29 Motonobu Kanagawa , Philipp Hennig

The exploration-exploitation trade-off is among the central challenges of reinforcement learning. The optimal Bayesian solution is intractable in general. This paper studies to what extent analytic statements about optimal learning are…

Machine Learning · Statistics 2015-03-13 Philipp Hennig

We consider the problem of estimating the expected value of information (the knowledge gradient) for Bayesian learning problems where the belief model is nonlinear in the parameters. Our goal is to maximize some metric, while simultaneously…

Machine Learning · Statistics 2016-11-23 Xinyu He , Warren B. Powell

Data-driven evolutionary algorithms usually aim to exploit the information behind a limited amount of data to perform optimization, which have proved to be successful in solving many complex real-world optimization problems. However, most…

Artificial Intelligence · Computer Science 2023-09-06 Qiqi Liu , Yuping Yan , Peter Ligeti , Yaochu Jin

Bayesian Optimization (BO) is a widely-used method for optimizing expensive-to-evaluate black-box functions. Traditional BO assumes that the learner has full control over all query variables without additional constraints. However, in many…

Machine Learning · Computer Science 2024-12-23 Vu Viet Hoang , Quoc Anh Hoang Nguyen , Hung Tran The

This paper proposes an automatic controller tuning framework based on linear optimal control combined with Bayesian optimization. With this framework, an initial set of controller gains is automatically improved according to a pre-defined…

Robotics · Computer Science 2017-09-21 Alonso Marco , Philipp Hennig , Jeannette Bohg , Stefan Schaal , Sebastian Trimpe

Bayesian optimization (BO) is a widely used algorithm for solving expensive black-box optimization problems. However, its performance decreases significantly on high-dimensional problems due to the inherent high-dimensionality of the…

Machine Learning · Computer Science 2025-04-16 Jundi Huang , Dawei Zhan

We propose a novel information-theoretic approach for Bayesian optimization called Predictive Entropy Search (PES). At each iteration, PES selects the next evaluation point that maximizes the expected information gained with respect to the…

Machine Learning · Statistics 2014-06-11 José Miguel Hernández-Lobato , Matthew W. Hoffman , Zoubin Ghahramani

We present a physics-informed Bayesian optimization (PIBO) with a concise modification to its acquisition function to incorporate the physical prior knowledge. Specifically, this method multiplies the expected improvement (EI) by a weight…

Materials Science · Physics 2026-02-06 Yuki K. Wakabayashi , Takuma Otsuka , Yoshiharu Krockenberger , Yoshitaka Taniyasu

Bayesian optimization is a popular method for solving the problem of global optimization of an expensive-to-evaluate black-box function. It relies on a probabilistic surrogate model of the objective function, upon which an acquisition…

Machine Learning · Statistics 2022-06-22 Jungtaek Kim , Seungjin Choi , Minsu Cho

Bayesian optimization (BO) is an efficient framework for optimization of black-box objectives when function evaluations are costly and gradient information is not easily accessible. BO has been successfully applied to automate the task of…

Machine Learning · Computer Science 2024-07-09 Pallavi Mitra , Felix Biessmann

Bayesian optimization (BO) is a popular approach for expensive black-box optimization, with applications including parameter tuning, experimental design, robotics. BO usually models the objective function by a Gaussian process (GP), and…

Machine Learning · Statistics 2020-01-22 Chao Qian , Hang Xiong , Ke Xue

We propose an extrinsic Bayesian optimization (eBO) framework for general optimization problems on manifolds. Bayesian optimization algorithms build a surrogate of the objective function by employing Gaussian processes and quantify the…

Optimization and Control · Mathematics 2023-01-02 Yihao Fang , Mu Niu , Pokman Cheung , Lizhen Lin

The present paper proposes an adaptive biasing potential for the computation of free energy landscapes. It is motivated by statistical learning arguments and unifies the tasks of biasing the molecular dynamics to escape free energy wells…

Mathematical Physics · Physics 2018-03-05 I. Bilionis , P. S. Koutsourelakis

We introduce a novel way to combine boosting with Gaussian process and mixed effects models. This allows for relaxing, first, the zero or linearity assumption for the prior mean function in Gaussian process and grouped random effects models…

Machine Learning · Computer Science 2024-11-06 Fabio Sigrist

In automated machine learning, scientific discovery, and other applications of Bayesian optimization, deciding when to stop evaluating expensive black-box functions in a cost-aware manner is an important but underexplored practical…

Machine Learning · Computer Science 2025-12-29 Qian Xie , Linda Cai , Alexander Terenin , Peter I. Frazier , Ziv Scully

Bayesian Optimisation (BO) methods seek to find global optima of objective functions which are only available as a black-box or are expensive to evaluate. Such methods construct a surrogate model for the objective function, quantifying the…

Machine Learning · Statistics 2023-01-10 Enrico Crovini , Simon L. Cotter , Konstantinos Zygalakis , Andrew B. Duncan

Numerical integration and emulation are fundamental topics across scientific fields. We propose novel adaptive quadrature schemes based on an active learning procedure. We consider an interpolative approach for building a surrogate…

Computation · Statistics 2021-01-20 F. Llorente , L. Martino , V. Elvira , D. Delgado , J. López-Santiago

We consider an expected utility maximization problem where the utility function is not necessarily concave and the time horizon is uncertain. We establish a necessary and sufficient condition for the optimality for general non-concave…

Portfolio Management · Quantitative Finance 2021-10-14 Christian Dehm , Thai Nguyen , Mitja Stadje