中文
相关论文

相关论文: A Lipschitz Exploration-Exploitation Scheme for Ba…

200 篇论文

Bayesian optimization is an approach to optimizing objective functions that take a long time (minutes or hours) to evaluate. It is best-suited for optimization over continuous domains of less than 20 dimensions, and tolerates stochastic…

机器学习 · 统计学 2018-07-10 Peter I. Frazier

In the paper, the global optimization problem of a multidimensional "black-box" function satisfying the Lipschitz condition over a hyperinterval with an unknown Lipschitz constant is considered. A new efficient algorithm for solving this…

最优化与控制 · 数学 2015-03-19 Yaroslav D. Sergeyev , Dmitri E. Kvasov

This paper deals with two kinds of the one-dimensional global optimization problems over a closed finite interval: (i) the objective function $f(x)$ satisfies the Lipschitz condition with a constant $L$; (ii) the first derivative of $f(x)$…

最优化与控制 · 数学 2013-07-15 Daniela Lera , Yaroslav D. Sergeyev

In Bayesian optimization, accounting for the importance of the output relative to the input is a crucial yet challenging exercise, as it can considerably improve the final result but often involves inaccurate and cumbersome entropy…

机器学习 · 计算机科学 2020-12-30 Antoine Blanchard , Themistoklis Sapsis

Optimization of complex functions, such as the output of computer simulators, is a difficult task that has received much attention in the literature. A less studied problem is that of optimization under unknown constraints, i.e., when the…

统计方法学 · 统计学 2010-07-06 Robert B. Gramacy , Herbert K. H. Lee

Bayesian Optimization (BO) is a widely-used method for optimizing expensive-to-evaluate black-box functions. Traditional BO assumes that the learner has full control over all query variables without additional constraints. However, in many…

机器学习 · 计算机科学 2024-12-23 Vu Viet Hoang , Quoc Anh Hoang Nguyen , Hung Tran The

The optimization of expensive-to-evaluate black-box functions over combinatorial structures is an ubiquitous task in machine learning, engineering and the natural sciences. The combinatorial explosion of the search space and costly…

机器学习 · 统计学 2018-10-11 Ricardo Baptista , Matthias Poloczek

The aim of black-box optimization is to optimize an objective function within the constraints of a given evaluation budget. In this problem, it is generally assumed that the computational cost for evaluating a point is large; thus, it is…

机器学习 · 统计学 2019-12-03 Masahiro Nomura , Kenshi Abe

An exciting branch of machine learning research focuses on methods for learning, optimizing, and integrating unknown functions that are difficult or costly to evaluate. A popular Bayesian approach to this problem uses a Gaussian process…

机器学习 · 统计学 2018-04-02 Anqi Wu , Mikio C. Aoi , Jonathan W. Pillow

Many expensive black-box optimisation problems are sensitive to their inputs. In these problems it makes more sense to locate a region of good designs, than a single-possibly fragile-optimal design. Expensive black-box functions can be…

机器学习 · 计算机科学 2021-12-16 Nicholas D. Sanders , Richard M. Everson , Jonathan E. Fieldsend , Alma A. M. Rahat

Bayesian optimization has recently emerged as a popular and efficient tool for global optimization and hyperparameter tuning. Currently, the established Bayesian optimization practice requires a user-defined bounding box which is assumed to…

机器学习 · 统计学 2015-08-18 Bobak Shahriari , Alexandre Bouchard-Côté , Nando de Freitas

Recently, there has been rising interest in Bayesian optimization -- the optimization of an unknown function with assumptions usually expressed by a Gaussian Process (GP) prior. We study an optimization strategy that directly uses an…

机器学习 · 统计学 2018-08-14 Zi Wang , Bolei Zhou , Stefanie Jegelka

Sequential decision tasks with incomplete information are characterized by the exploration problem; namely the trade-off between further exploration for learning more about the environment and immediate exploitation of the accrued…

人工智能 · 计算机科学 2013-02-21 Grigoris I. Karakoulas

This paper presents a tractable algorithm for estimating an unknown Lipschitz function from noisy observations and establishes an upper bound on its convergence rate. The approach extends max-affine methods from convex shape-restricted…

机器学习 · 统计学 2025-11-20 Gábor Balázs

Bayesian optimization (BO) and its batch extensions are successful for optimizing expensive black-box functions. However, these traditional BO approaches are not yet ideal for optimizing less expensive functions when the computational cost…

机器学习 · 计算机科学 2018-11-06 Vu Nguyen , Sunil Gupta , Santu Rana , Cheng Li , Svetha Venkatesh

We consider Bayesian optimization using Gaussian Process models, also referred to as kernel-based bandit optimization. We study the methodology of exploring the domain using random samples drawn from a distribution. We show that this random…

机器学习 · 计算机科学 2024-02-05 Sudeep Salgia , Sattar Vakili , Qing Zhao

Bayesian optimization (BO) has emerged during the last few years as an effective approach to optimizing black-box functions where direct queries of the objective are expensive. In this paper we consider the case where direct access to the…

机器学习 · 统计学 2017-04-13 Javier Gonzalez , Zhenwen Dai , Andreas Damianou , Neil D. Lawrence

Reinforcement learning systems are often concerned with balancing exploration of untested actions against exploitation of actions that are known to be good. The benefit of exploration can be estimated using the classical notion of Value of…

人工智能 · 计算机科学 2013-01-30 Richard Dearden , Nir Friedman , David Andre

We study the problem of estimating the average of a Lipschitz continuous function $f$ defined over a metric space, by querying $f$ at only a single point. More specifically, we explore the role of randomness in drawing this sample. Our goal…

数据结构与算法 · 计算机科学 2011-01-21 Abhimanyu Das , David Kempe

Bayesian optimisation is a popular method for efficient optimisation of expensive black-box functions. Traditionally, BO assumes that the search space is known. However, in many problems, this assumption does not hold. To this end, we…

机器学习 · 统计学 2026-04-28 Hung Tran-The , Sunil Gupta , Santu Rana , Huong Ha , Svetha Venkatesh