中文
相关论文

相关论文: Can Global Optimization Strategy Outperform Myopic…

200 篇论文

The global optimization have the very extensive applications in econometrics, science and engineering. However, the global optimization for non-convex objective functions is particularly difficult since most of the existing global…

最优化与控制 · 数学 2015-07-17 Da-Zheng Feng , Han-Zhe Feng , Hai-Qin Zhang

Scaling Bayesian optimization to high dimensions is challenging task as the global optimization of high-dimensional acquisition function can be expensive and often infeasible. Existing methods depend either on limited active variables or…

机器学习 · 统计学 2018-02-16 Cheng Li , Sunil Gupta , Santu Rana , Vu Nguyen , Svetha Venkatesh , Alistair Shilton

We propose a novel Bayesian method to solve the maximization of a time-dependent expensive-to-evaluate stochastic oracle. We are interested in the decision that maximizes the oracle at a finite time horizon, given a limited budget of noisy…

统计计算 · 统计学 2021-05-21 S. Ashwin Renganathan , Jeffrey Larson , Stefan M. Wild

Bayesian optimization is an effective method to efficiently optimize unknown objective functions with high evaluation costs. Traditional Bayesian optimization algorithms select one point per iteration for single objective function, whereas…

机器学习 · 统计学 2019-05-08 Takashi Wada , Hideitsu Hino

In practice, objective functions of real-time control systems can have multiple local minimums or can dramatically change over the function space, making them hard to optimize. To efficiently optimize such systems, in this paper, we develop…

最优化与控制 · 数学 2022-01-26 Haowei Wang , Songhao Wang , Qun Meng , Szu Hui Ng

Machine learning algorithms frequently require careful tuning of model hyperparameters, regularization terms, and optimization parameters. Unfortunately, this tuning is often a "black art" that requires expert experience, unwritten rules of…

机器学习 · 统计学 2012-08-30 Jasper Snoek , Hugo Larochelle , Ryan P. Adams

Bayesian optimization is an approach to optimizing objective functions that take a long time (minutes or hours) to evaluate. It is best-suited for optimization over continuous domains of less than 20 dimensions, and tolerates stochastic…

机器学习 · 统计学 2018-07-10 Peter I. Frazier

Probabilistic smoothing is a standard tool for global optimization, but existing methods rely on Gaussian kernels and specific transforms, often resulting in strong hyperparameter sensitivity and limited robustness. We propose a general…

机器学习 · 计算机科学 2026-05-27 Kukyoung Jang , Taehyun Cho , Junrui Zhang , Ping Xu , Kyungjae Lee

In robotics, methods and softwares usually require optimizations of hyperparameters in order to be efficient for specific tasks, for instance industrial bin-picking from homogeneous heaps of different objects. We present a developmental…

机器人学 · 计算机科学 2020-07-31 Maxime Petit , Emmanuel Dellandrea , Liming Chen

We discuss the Bayesian emulation approach to computational solution of multi-step portfolio studies in financial time series. "Bayesian emulation for decisions" involves mapping the technical structure of a decision analysis problem to…

统计方法学 · 统计学 2022-06-07 Kaoru Irie , Mike West

The computational costs of inference and planning have confined Bayesian model-based reinforcement learning to one of two dismal fates: powerful Bayes-adaptive planning but only for simplistic models, or powerful, Bayesian non-parametric…

人工智能 · 计算机科学 2014-02-11 Arthur Guez , David Silver , Peter Dayan

Bayesian optimization has emerged as a highly effective tool for the safe online optimization of systems, due to its high sample efficiency and noise robustness. To further enhance its efficiency, reduced physical models of the system can…

机器学习 · 计算机科学 2024-06-18 Jannis O. Lübsen , Christian Hespe , Annika Eichler

Global optimization finds applications in a wide range of real world problems. The multi-start methods are a popular class of global optimization techniques, which are based on the ideas of conducting local searches at multiple starting…

机器学习 · 统计学 2020-07-01 Yuzhou Gao , Tengchao Yu , Jinglai Li

It is commonly believed that Bayesian optimization (BO) algorithms are highly efficient for optimizing numerically costly functions. However, BO is not often compared to widely different alternatives, and is mostly tested on narrow sets of…

最优化与控制 · 数学 2021-10-01 Rodolphe Le Riche , Victor Picheny

Adaptive random search approaches have been shown to be effective for global optimization problems, where under certain conditions, the expected performance time increases only linearly with dimension. However, previous analyses assume that…

最优化与控制 · 数学 2022-03-22 David D. Linz , Zelda B. Zabinsky

Bayesian optimisation has proven to be a powerful tool for expensive global black-box optimisation problems. In this paper, we propose new Bayesian optimisation variants of the popular Knowledge Gradient acquisition functions for problems…

机器学习 · 计算机科学 2025-12-22 Xietao Wang Lin , Juan Ungredda , Max Butler , James Town , Alma Rahat , Hemant Singh , Juergen Branke

Global estimation strategies allow to extract information on a phase or a set of phases without any prior knowledge, which is, instead, required for local estimation strategies. We devise a global multiphase protocol based on Holevo's…

Recent advances in computationally efficient non-myopic Bayesian optimization (BO) improve query efficiency over traditional myopic methods like expected improvement while only modestly increasing computational cost. These advances have…

机器学习 · 统计学 2021-12-07 Yunxiang Zhang , Xiangyu Zhang , Peter I. Frazier

Machine learning (ML) methods offer a wide range of configurable hyperparameters that have a significant influence on their performance. While accuracy is a commonly used performance objective, in many settings, it is not sufficient.…

机器学习 · 计算机科学 2023-09-27 Romain Egele , Tyler Chang , Yixuan Sun , Venkatram Vishwanath , Prasanna Balaprakash

Performing multi-objective Bayesian optimisation by scalarising the objectives avoids the computation of expensive multi-dimensional integral-based acquisition functions, instead of allowing one-dimensional standard acquisition…

机器学习 · 计算机科学 2021-04-13 Clym Stock-Williams , Tinkle Chugh , Alma Rahat , Wei Yu