中文
相关论文

相关论文: Two Gaussian Approaches to Black-Box Optomization

200 篇论文

Gaussian variational approximation is a popular methodology to approximate posterior distributions in Bayesian inference especially in high dimensional and large data settings. To control the computational cost while being able to capture…

机器学习 · 计算机科学 2021-04-07 Bingxin Zhou , Junbin Gao , Minh-Ngoc Tran , Richard Gerlach

This paper investigates the control of an ML component within the Covariance Matrix Adaptation Evolution Strategy (CMA-ES) devoted to black-box optimization. The known CMA-ES weakness is its sample complexity, the number of evaluations of…

机器学习 · 计算机科学 2013-08-20 Ilya Loshchilov , Marc Schoenauer , Michèle Sebag

The Covariance Matrix Adaptation Evolution Strategy (CMA-ES) is widely accepted as a robust derivative-free continuous optimization algorithm for non-linear and non-convex optimization problems. CMA-ES is well known to be almost…

神经与进化计算 · 计算机科学 2014-06-12 Ilya Loshchilov , Marc Schoenauer , Michèle Sebag , Nikolaus Hansen

We present an adaptive approach to the construction of Gaussian process surrogates for Bayesian inference with expensive-to-evaluate forward models. Our method relies on the fully Bayesian approach to training Gaussian process models and…

机器学习 · 统计学 2018-10-01 Timur Takhtaganov , Juliane Müller

The covariance matrix adaptive evolution strategy (CMA-ES) has been widely used in the field of 2D/3D registration in recent years. This optimization method exhibits exceptional robustness and usability for complex surgical scenarios.…

图像与视频处理 · 电气工程与系统科学 2024-05-17 Zhirun Zhang , Minheng Chen

This work concerns the evolutionary approaches to distributed stochastic black-box optimization, in which each worker can individually solve an approximation of the problem with nature-inspired algorithms. We propose a distributed evolution…

神经与进化计算 · 计算机科学 2022-04-12 Xiaoyu He , Zibin Zheng , Chuan Chen , Yuren Zhou , Chuan Luo , Qingwei Lin

In this paper, we study the performance of IPOP-saACM-ES and BIPOP-saACM-ES, recently proposed self-adaptive surrogate-assisted Covariance Matrix Adaptation Evolution Strategies. Both algorithms were tested using restarts till a total…

神经与进化计算 · 计算机科学 2012-06-26 Ilya Loshchilov , Marc Schoenauer , Michèle Sebag

This study modifies the Covariance Matrix Adaptation Evolution Strategy (CMA-ES) algorithm for multi-modal optimization problems. The enhancements focus on addressing the challenges of multiple global minima, improving the algorithm's…

神经与进化计算 · 计算机科学 2024-07-02 Wathsala Karunarathne , Indu Bala , Dikshit Chauhan , Matthew Roughan , Lewis Mitchell

The covariance matrix adaptation evolution strategy (CMA-ES) is one of the most successful methods for solving black-box continuous optimization problems. One practically useful aspect of the CMA-ES is that it can be used without…

神经与进化计算 · 计算机科学 2023-09-15 Masahiro Nomura , Youhei Akimoto , Isao Ono

We propose efficient computational methods to fit multivariate Gaussian additive models, where the mean vector and the covariance matrix are allowed to vary with covariates, in an empirical Bayes framework. To guarantee the…

统计计算 · 统计学 2025-04-07 Vincenzo Gioia , Matteo Fasiolo , Ruggero Bellio , Simon N. Wood

The Log-Gaussian Cox Process is a commonly used model for the analysis of spatial point patterns. Fitting this model is difficult because of its doubly-stochastic property, i.e., it is an hierarchical combination of a Poisson process at the…

统计计算 · 统计学 2017-01-05 Ming Teng , Farouk S. Nathoo , Timothy D. Johnson

For many decades now, Bayesian Model Averaging (BMA) has been a popular framework to systematically account for model uncertainty that arises in situations when multiple competing models are available to describe the same or similar…

统计计算 · 统计学 2022-03-29 Vojtech Kejzlar , Shrijita Bhattacharya , Mookyong Son , Tapabrata Maiti

Bayesian optimization is a technique for optimizing black-box target functions. At the core of Bayesian optimization is a surrogate model that predicts the output of the target function at previously unseen inputs to facilitate the…

机器学习 · 计算机科学 2022-03-04 Felix Jimenez , Matthias Katzfuss

Water distribution system design is a challenging optimisation problem with a high number of search dimensions and constraints. In this way, Evolutionary Algorithms (EAs) have been widely applied to optimise WDS to minimise cost subject…

神经与进化计算 · 计算机科学 2019-09-12 Mehdi Neshat , Bradley Alexander , Angus Simpson

Variational approximation methods have proven to be useful for scaling Bayesian computations to large data sets and highly parametrized models. Applying variational methods involves solving an optimization problem, and recent research in…

统计方法学 · 统计学 2017-01-13 Victor M. -H. Ong , David J. Nott , Michael S. Smith

Bayesian learning using Gaussian processes provides a foundational framework for making decisions in a manner that balances what is known with what could be learned by gathering data. In this dissertation, we develop techniques for…

机器学习 · 统计学 2022-04-29 Alexander Terenin

Numerical simulation of complex optical structures enables their optimization with respect to specific objectives. Often, optimization is done by multiple successive parameter scans, which are time consuming and computationally expensive.…

计算物理 · 物理学 2017-07-27 P. -I. Schneider , X. Garcia Santiago , C. Rockstuhl , S. Burger

This article is concerned with Gaussian process quadratures, which are numerical integration methods based on Gaussian process regression methods, and sigma-point methods, which are used in advanced non-linear Kalman filtering and smoothing…

统计方法学 · 统计学 2015-04-24 Simo Särkkä , Jouni Hartikainen , Lennart Svensson , Fredrik Sandblom

When faced with a specific optimization problem, choosing which algorithm to use is always a tough task. Not only is there a vast variety of algorithms to select from, but these algorithms often are controlled by many hyperparameters, which…

神经与进化计算 · 计算机科学 2020-01-07 Diederick Vermetten , Hao Wang , Carola Doerr , Thomas Bäck

Black-box optimization (BBO) can be used to optimize functions whose analytic form is unknown. A common approach to realising BBO is to learn a surrogate model which approximates the target black-box function which can then be solved via…

机器学习 · 计算机科学 2023-02-10 Jonas Nüßlein , Christoph Roch , Thomas Gabor , Jonas Stein , Claudia Linnhoff-Popien , Sebastian Feld