中文
相关论文

相关论文: Curvature-aware Expected Free Energy as an Acquisi…

200 篇论文

Bayesian optimisation (BO) algorithms have shown remarkable success in applications involving expensive black-box functions. Traditionally BO has been set as a sequential decision-making process which estimates the utility of query points…

机器学习 · 计算机科学 2022-10-25 Rafael Oliveira , Louis Tiao , Fabio Ramos

Adaptive Bayesian quadrature (ABQ) is a powerful approach to numerical integration that empirically compares favorably with Monte Carlo integration on problems of medium dimensionality (where non-adaptive quadrature is not competitive). Its…

机器学习 · 统计学 2019-10-29 Motonobu Kanagawa , Philipp Hennig

The exploration-exploitation trade-off is among the central challenges of reinforcement learning. The optimal Bayesian solution is intractable in general. This paper studies to what extent analytic statements about optimal learning are…

机器学习 · 统计学 2015-03-13 Philipp Hennig

We consider the problem of estimating the expected value of information (the knowledge gradient) for Bayesian learning problems where the belief model is nonlinear in the parameters. Our goal is to maximize some metric, while simultaneously…

机器学习 · 统计学 2016-11-23 Xinyu He , Warren B. Powell

Data-driven evolutionary algorithms usually aim to exploit the information behind a limited amount of data to perform optimization, which have proved to be successful in solving many complex real-world optimization problems. However, most…

人工智能 · 计算机科学 2023-09-06 Qiqi Liu , Yuping Yan , Peter Ligeti , Yaochu Jin

Bayesian Optimization (BO) is a widely-used method for optimizing expensive-to-evaluate black-box functions. Traditional BO assumes that the learner has full control over all query variables without additional constraints. However, in many…

机器学习 · 计算机科学 2024-12-23 Vu Viet Hoang , Quoc Anh Hoang Nguyen , Hung Tran The

This paper proposes an automatic controller tuning framework based on linear optimal control combined with Bayesian optimization. With this framework, an initial set of controller gains is automatically improved according to a pre-defined…

机器人学 · 计算机科学 2017-09-21 Alonso Marco , Philipp Hennig , Jeannette Bohg , Stefan Schaal , Sebastian Trimpe

Bayesian optimization (BO) is a widely used algorithm for solving expensive black-box optimization problems. However, its performance decreases significantly on high-dimensional problems due to the inherent high-dimensionality of the…

机器学习 · 计算机科学 2025-04-16 Jundi Huang , Dawei Zhan

We propose a novel information-theoretic approach for Bayesian optimization called Predictive Entropy Search (PES). At each iteration, PES selects the next evaluation point that maximizes the expected information gained with respect to the…

机器学习 · 统计学 2014-06-11 José Miguel Hernández-Lobato , Matthew W. Hoffman , Zoubin Ghahramani

We present a physics-informed Bayesian optimization (PIBO) with a concise modification to its acquisition function to incorporate the physical prior knowledge. Specifically, this method multiplies the expected improvement (EI) by a weight…

Bayesian optimization is a popular method for solving the problem of global optimization of an expensive-to-evaluate black-box function. It relies on a probabilistic surrogate model of the objective function, upon which an acquisition…

机器学习 · 统计学 2022-06-22 Jungtaek Kim , Seungjin Choi , Minsu Cho

Bayesian optimization (BO) is an efficient framework for optimization of black-box objectives when function evaluations are costly and gradient information is not easily accessible. BO has been successfully applied to automate the task of…

机器学习 · 计算机科学 2024-07-09 Pallavi Mitra , Felix Biessmann

Bayesian optimization (BO) is a popular approach for expensive black-box optimization, with applications including parameter tuning, experimental design, robotics. BO usually models the objective function by a Gaussian process (GP), and…

机器学习 · 统计学 2020-01-22 Chao Qian , Hang Xiong , Ke Xue

We propose an extrinsic Bayesian optimization (eBO) framework for general optimization problems on manifolds. Bayesian optimization algorithms build a surrogate of the objective function by employing Gaussian processes and quantify the…

最优化与控制 · 数学 2023-01-02 Yihao Fang , Mu Niu , Pokman Cheung , Lizhen Lin

The present paper proposes an adaptive biasing potential for the computation of free energy landscapes. It is motivated by statistical learning arguments and unifies the tasks of biasing the molecular dynamics to escape free energy wells…

数学物理 · 物理学 2018-03-05 I. Bilionis , P. S. Koutsourelakis

We introduce a novel way to combine boosting with Gaussian process and mixed effects models. This allows for relaxing, first, the zero or linearity assumption for the prior mean function in Gaussian process and grouped random effects models…

机器学习 · 计算机科学 2024-11-06 Fabio Sigrist

In automated machine learning, scientific discovery, and other applications of Bayesian optimization, deciding when to stop evaluating expensive black-box functions in a cost-aware manner is an important but underexplored practical…

机器学习 · 计算机科学 2025-12-29 Qian Xie , Linda Cai , Alexander Terenin , Peter I. Frazier , Ziv Scully

Bayesian Optimisation (BO) methods seek to find global optima of objective functions which are only available as a black-box or are expensive to evaluate. Such methods construct a surrogate model for the objective function, quantifying the…

机器学习 · 统计学 2023-01-10 Enrico Crovini , Simon L. Cotter , Konstantinos Zygalakis , Andrew B. Duncan

Numerical integration and emulation are fundamental topics across scientific fields. We propose novel adaptive quadrature schemes based on an active learning procedure. We consider an interpolative approach for building a surrogate…

统计计算 · 统计学 2021-01-20 F. Llorente , L. Martino , V. Elvira , D. Delgado , J. López-Santiago

We consider an expected utility maximization problem where the utility function is not necessarily concave and the time horizon is uncertain. We establish a necessary and sufficient condition for the optimality for general non-concave…

投资组合管理 · 定量金融 2021-10-14 Christian Dehm , Thai Nguyen , Mitja Stadje