中文
相关论文

相关论文: SnAKe: Bayesian Optimization with Pathwise Explora…

200 篇论文

Bayesian optimization is an effective method to efficiently optimize unknown objective functions with high evaluation costs. Traditional Bayesian optimization algorithms select one point per iteration for single objective function, whereas…

机器学习 · 统计学 2019-05-08 Takashi Wada , Hideitsu Hino

Bayesian neural networks offer better estimates of model uncertainty compared to frequentist networks. However, inference involving Bayesian models requires multiple instantiations or sampling of the network parameters, requiring…

神经与进化计算 · 计算机科学 2024-01-30 Prabodh Katti , Anagha Nimbekar , Chen Li , Amit Acharyya , Bashir M. Al-Hashimi , Bipin Rajendran

Hyperparameter tuning is a challenging problem especially when the system itself involves uncertainty. Due to noisy function evaluations, optimization under uncertainty can be computationally expensive. In this paper, we present a novel…

机器学习 · 计算机科学 2025-10-09 Akash Yadav , Ruda Zhang

The popularity of Bayesian optimization methods for efficient exploration of parameter spaces has lead to a series of papers applying Gaussian processes as surrogates in the optimization of functions. However, most proposed approaches only…

机器学习 · 统计学 2015-10-16 Javier González , Zhenwen Dai , Philipp Hennig , Neil D. Lawrence

We consider black-box optimization in which only an extremely limited number of function evaluations, on the order of around 100, are affordable and the function evaluations must be performed in even fewer batches of a limited number of…

机器学习 · 计算机科学 2021-03-19 Carlos Ansotegui , Meinolf Sellmann , Tapan Shah , Kevin Tierney

Bayesian Optimization (BO) is used to find the global optima of black box functions. In this work, we propose a practical BO method of function compositions where the form of the composition is known but the constituent functions are…

机器学习 · 计算机科学 2023-05-02 Kunal Jain , Prabuchandran K. J. , Tejas Bodas

Bilevel optimization problems are a class of challenging optimization problems, which contain two levels of optimization tasks. In these problems, the optimal solutions to the lower level problem become possible feasible candidates to the…

神经与进化计算 · 计算机科学 2013-10-08 Ankur Sinha , Pekka Malo , Kalyanmoy Deb

Kalman filters are routinely used for many data fusion applications including navigation, tracking, and simultaneous localization and mapping problems. However, significant time and effort is frequently required to tune various Kalman…

机器学习 · 统计学 2018-07-25 Zhaozhong Chen , Christoffer Heckman , Simon Julier , Nisar Ahmed

We focus on the problem of black-box adversarial attacks, where the aim is to generate adversarial examples using information limited to loss function evaluations of input-output pairs. We use Bayesian optimization~(BO) to specifically…

机器学习 · 计算机科学 2019-10-01 Satya Narayan Shukla , Anit Kumar Sahu , Devin Willmott , J. Zico Kolter

Experimental (design) optimization is a key driver in designing and discovering new products and processes. Bayesian Optimization (BO) is an effective tool for optimizing expensive and black-box experimental design processes. While Bayesian…

机器学习 · 计算机科学 2024-02-28 Arun Kumar A , Alistair Shilton , Sunil Gupta , Santu Rana , Stewart Greenhill , Svetha Venkatesh

Bayesian Optimization is a widely used method for optimizing expensive black-box functions, relying on probabilistic surrogate models such as Gaussian Processes. The quality of the surrogate model is crucial for good optimization…

机器学习 · 计算机科学 2025-12-16 Carl Hvarfner , David Eriksson , Eytan Bakshy , Max Balandat

Bayesian optimization is a broadly applied methodology to optimize the expensive black-box function. Despite its success, it still faces the challenge from the high-dimensional search space. To alleviate this problem, we propose a novel…

机器学习 · 计算机科学 2020-10-20 Jingfan Chen , Guanghui Zhu , Chunfeng Yuan , Yihua Huang

Data-efficient learning algorithms are essential in many practical applications for which data collection is expensive, e.g., for the optimal deployment of wireless systems in unknown propagation scenarios. Meta-learning can address this…

机器学习 · 计算机科学 2022-05-25 Ivana Nikoloska , Osvaldo Simeone

This work presents PESMOC, Predictive Entropy Search for Multi-objective Bayesian Optimization with Constraints, an information-based strategy for the simultaneous optimization of multiple expensive-to-evaluate black-box functions under the…

机器学习 · 统计学 2021-04-15 Eduardo C. Garrido-Merchán , Daniel Hernández-Lobato

Bayesian optimization is a sample-efficient method for black-box global optimization. How- ever, the performance of a Bayesian optimization method very much depends on its exploration strategy, i.e. the choice of acquisition function, and…

Joint state and parameter estimation is a core problem for dynamic Bayesian networks. Although modern probabilistic inference toolkits make it relatively easy to specify large and practically relevant probabilistic models, the silver…

人工智能 · 计算机科学 2016-03-31 Yusuf Bugra Erol , Yi Wu , Lei Li , Stuart Russell

Preferential Bayesian optimization allows optimization of objectives that are either expensive or difficult to measure directly, by relying on a minimal number of comparative evaluations done by a human expert. Generating candidate…

Bayesian optimization (BO) aims to minimize a given blackbox function using a model that is updated whenever new evidence about the function becomes available. Here, we address the problem of BO under partially right-censored response data,…

人工智能 · 计算机科学 2013-10-09 Frank Hutter , Holger Hoos , Kevin Leyton-Brown

Bayesian methods are particularly effective for addressing inverse problems due to their ability to manage uncertainties inherent in the inference process. However, employing these methods with costly forward models poses significant…

计算工程、金融与科学 · 计算机科学 2025-10-30 G. Robalo Rei , C. P. Schmidt , J. Nitzler , M. Dinkel , W. A. Wall

Bayesian Optimisation (BO) methods seek to find global optima of objective functions which are only available as a black-box or are expensive to evaluate. Such methods construct a surrogate model for the objective function, quantifying the…

机器学习 · 统计学 2023-01-10 Enrico Crovini , Simon L. Cotter , Konstantinos Zygalakis , Andrew B. Duncan