中文
相关论文

相关论文: Inducing Point Allocation for Sparse Gaussian Proc…

200 篇论文

Bayesian Optimization (BO) is a powerful method for optimizing black-box functions by combining prior knowledge with ongoing function evaluations. BO constructs a probabilistic surrogate model of the objective function given the covariates,…

机器学习 · 统计学 2025-08-26 Roi Naveiro , Becky Tang

Deep Gaussian processes (DGPs) provide a robust paradigm for Bayesian deep learning. In DGPs, a set of sparse integration locations called inducing points are selected to approximate the posterior distribution of the model. This is done to…

机器学习 · 计算机科学 2024-07-25 Jian Xu , Delu Zeng , John Paisley

Bayesian optimization (BO) has become a popular strategy for global optimization of expensive real-world functions. Contrary to a common expectation that BO is suited to optimizing black-box functions, it actually requires domain knowledge…

机器学习 · 计算机科学 2024-08-06 Zi Wang , George E. Dahl , Kevin Swersky , Chansoo Lee , Zachary Nado , Justin Gilmer , Jasper Snoek , Zoubin Ghahramani

Bayesian Optimization, the application of Bayesian function approximation to finding optima of expensive functions, has exploded in popularity in recent years. In particular, much attention has been paid to improving its efficiency on…

最优化与控制 · 数学 2022-05-18 Mickael Binois , Nathan Wycoff

Bayesian optimization (BO) is a popular approach for expensive black-box optimization, with applications including parameter tuning, experimental design, robotics. BO usually models the objective function by a Gaussian process (GP), and…

机器学习 · 统计学 2020-01-22 Chao Qian , Hang Xiong , Ke Xue

Bayesian Optimization (BO) is a common approach for hyperparameter optimization (HPO) in automated machine learning. Although it is well-accepted that HPO is crucial to obtain well-performing machine learning models, tuning BO's own…

机器学习 · 计算机科学 2019-08-20 Marius Lindauer , Matthias Feurer , Katharina Eggensperger , André Biedenkapp , Frank Hutter

Bayesian optimization (BO) has established itself as a leading strategy for efficiently optimizing expensive-to-evaluate functions. Existing BO methods mostly rely on Gaussian process (GP) surrogate models and are not applicable to…

机器学习 · 计算机科学 2024-01-29 Yongsheng Mei , Mahdi Imani , Tian Lan

Bayesian optimization (BO) is a powerful framework for estimating parameters of expensive simulation models, particularly in settings where the likelihood is intractable and evaluations are costly. In stochastic models every simulation is…

统计方法学 · 统计学 2026-04-16 Arindam Fadikar , Abby Stevens , Mickael Binois , Nicholson Collier , David O'Gara , Jonathan Ozik

Bayesian optimization (BO) is one of the most powerful strategies to solve computationally expensive-to-evaluate blackbox optimization problems. However, BO methods are conventionally used for optimization problems of small dimension…

最优化与控制 · 数学 2025-02-10 Rémy Priem , Youssef Diouane , Nathalie Bartoli , Sylvain Dubreuil , Paul Saves

Gaussian Process (GP) regression is a popular and sample-efficient approach for many engineering applications, where observations are expensive to acquire, and is also a central ingredient of Bayesian optimization (BO), a highly prevailing…

机器学习 · 统计学 2025-06-06 Sébastien Da Veiga

Bayesian optimization (BO) is a widely-used sequential method for zeroth-order optimization of complex and expensive-to-compute black-box functions. The existing BO methods assume that the function evaluation (feedback) is available to the…

机器学习 · 计算机科学 2022-06-22 Arun Verma , Zhongxiang Dai , Bryan Kian Hsiang Low

Gaussian processes (GPs) are widely used in nonparametric regression, classification and spatio-temporal modeling, motivated in part by a rich literature on theoretical properties. However, a well known drawback of GPs that limits their use…

统计方法学 · 统计学 2011-06-29 Anjishnu Banerjee , David Dunson , Surya Tokdar

Bayesian optimization (BO) is an effective technique for black-box optimization. However, its applicability is typically limited to moderate-budget problems due to the cubic complexity of fitting the Gaussian process (GP) surrogate model.…

机器学习 · 统计学 2025-10-13 Qiyu Wei , Haowei Wang , Zirui Cao , Songhao Wang , Richard Allmendinger , Mauricio A Álvarez

In recent years, leveraging parallel and distributed computational resources has become essential to solve problems of high computational cost. Bayesian optimization (BO) has shown attractive results in those expensive-to-evaluate problems…

机器学习 · 统计学 2020-06-25 Masahiro Nomura

Bayesian optimization (BO) is a popular global optimization scheme for sample-efficient optimization in domains with expensive function evaluations. The existing BO techniques are capable of finding a single global optimum solution.…

最优化与控制 · 数学 2023-08-08 Yongsheng Mei , Tian Lan , Mahdi Imani , Suresh Subramaniam

Probabilistic programming systems enable users to encode model structure and naturally reason about uncertainties, which can be leveraged towards improved Bayesian optimization (BO) methods. Here we present a probabilistic program embedding…

人工智能 · 计算机科学 2019-02-06 Alexander Lavin

Bayesian optimization (BO) is an attractive machine learning framework for performing sample-efficient global optimization of black-box functions. The optimization process is guided by an acquisition function that selects points to acquire…

机器学习 · 计算机科学 2024-10-14 Felix Teufel , Carsten Stahlhut , Jesper Ferkinghoff-Borg

The partially observable constrained optimization problems (POCOPs) impede data-driven optimization techniques since an infeasible solution of POCOPs can provide little information about the objective as well as the constraints. We endeavor…

机器学习 · 计算机科学 2023-12-27 Shengbo Wang , Ke Li

Bayesian Optimization (BO) is a sample-efficient optimization algorithm widely employed across various applications. In some challenging BO tasks, input uncertainty arises due to the inevitable randomness in the optimization process, such…

机器学习 · 计算机科学 2023-11-07 Lin Yang , Junlong Lyu , Wenlong Lyu , Zhitang Chen

We study preferential Bayesian optimization (BO) where reliable feedback is limited to pairwise comparison called duels. An important challenge in preferential BO, which uses the preferential Gaussian process (GP) model to represent…

机器学习 · 计算机科学 2023-06-13 Shion Takeno , Masahiro Nomura , Masayuki Karasuyama