English
Related papers

Related papers: Parallel Mixed Bayesian Optimization Algorithm: A …

200 papers

The Bayesian Optimisation Algorithm (BOA) is an Estimation of Distribution Algorithm (EDA) that uses a Bayesian network as probabilistic graphical model (PGM). Determining the optimal Bayesian network structure given a solution sample is an…

In recent years, leveraging parallel and distributed computational resources has become essential to solve problems of high computational cost. Bayesian optimization (BO) has shown attractive results in those expensive-to-evaluate problems…

Machine Learning · Statistics 2020-06-25 Masahiro Nomura

This paper proposes the incremental Bayesian optimization algorithm (iBOA), which modifies standard BOA by removing the population of solutions and using incremental updates of the Bayesian network. iBOA is shown to be able to learn and…

Neural and Evolutionary Computing · Computer Science 2008-07-30 Martin Pelikan , Kumara Sastry , David E. Goldberg

Bayesian optimization has become a popular method for high-throughput computing, like the design of computer experiments or hyperparameter tuning of expensive models, where sample efficiency is mandatory. In these applications, distributed…

Machine Learning · Computer Science 2019-07-08 Javier Garcia-Barcos , Ruben Martinez-Cantin

Bayesian optimization has emerged as a strong candidate tool for global optimization of functions with expensive evaluation costs. However, due to the dynamic nature of research in Bayesian approaches, and the evolution of computing…

Applications · Statistics 2018-08-24 Ran Rubin

Recently the engineering optimization problems require large computational demands and long solution time even on high multi-processors computational devices. In this paper, an OpenMP inspired parallel version of the whale optimization…

Neural and Evolutionary Computing · Computer Science 2018-07-25 Amr M. Sauber , Mohammed M. Nasef , Essam H. Houssein , Aboul Ella Hassanien

This paper shows how the Bayesian network paradigm can be used in order to solve combinatorial optimization problems. To do it some methods of structure learning from data and simulation of Bayesian networks are inserted inside Estimation…

Artificial Intelligence · Computer Science 2013-01-18 Pedro Larrañaga , Ramon Etxeberria , Jose A. Lozano , Jose M. Pena

Our research has shown that schedules can be built mimicking a human scheduler by using a set of rules that involve domain knowledge. This chapter presents a Bayesian Optimization Algorithm (BOA) for the nurse scheduling problem that…

Neural and Evolutionary Computing · Computer Science 2010-07-05 Jingpeng Li , Uwe Aickelin

Multi-objective evolutionary algorithms (MOEAs) have become essential tools for solving multi-objective optimization problems (MOPs), making their running time analysis crucial for assessing algorithmic efficiency and guiding practical…

Neural and Evolutionary Computing · Computer Science 2025-07-04 Han Huang , Tianyu Wang , Chaoda Peng , Tongli He , Zhifeng Hao

In parallel with the continuously increasing parameter space dimensionality, search and optimization algorithms should support distributed parameter evaluations to reduce cumulative runtime. Intel's neuromorphic optimization library,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-10 Shay Snyder , Derek Gobin , Victoria Clerico , Sumedh R. Risbud , Maryam Parsa

We present GLASSES: Global optimisation with Look-Ahead through Stochastic Simulation and Expected-loss Search. The majority of global optimisation approaches in use are myopic, in only considering the impact of the next function value; the…

Machine Learning · Statistics 2015-10-22 Javier González , Michael Osborne , Neil D. Lawrence

Bayesian optimization is an effective methodology for the global optimization of functions with expensive evaluations. It relies on querying a distribution over functions defined by a relatively cheap surrogate model. An accurate model for…

Parallelization is a popular strategy for improving the performance of iterative algorithms. Optimization methods are no exception: design of efficient parallel optimization methods and tight analysis of their theoretical properties are…

Optimization and Control · Mathematics 2023-11-28 Alexander Tyurin , Peter Richtárik

We revisit the classical problem of Bayesian ensembles and address the challenge of learning optimal combinations of Bayesian models in an online, continual learning setting. To this end, we reinterpret existing approaches such as Bayesian…

Machine Learning · Computer Science 2026-01-26 Daniel Waxman , Fernando Llorente , Petar M. Djurić

Stochastic optimization finds a wide range of applications in operations research and management science. However, existing stochastic optimization techniques usually require the information of random samples (e.g., demands in the…

Optimization and Control · Mathematics 2019-04-18 Xi Chen , Qihang Lin , Zizhuo Wang

We provide a unifying approximate dynamic programming framework that applies to a broad variety of problems involving sequential estimation. We consider first the construction of surrogate cost functions for the purposes of optimization,…

Artificial Intelligence · Computer Science 2023-01-02 Dimitri Bertsekas

Extending Bayesian optimization to batch evaluation can enable the designer to make the most use of parallel computing technology. However, most of current batch approaches do not scale well with the batch size. That is, their performances…

Machine Learning · Computer Science 2025-04-25 Dawei Zhan , Zhaoxi Zeng , Shuoxiao Wei , Ping Wu

Not all generate-and-test search algorithms are created equal. Bayesian Optimization (BO) invests a lot of computation time to generate the candidate solution that best balances the predicted value and the uncertainty given all previous…

Neural and Evolutionary Computing · Computer Science 2020-05-11 Gongjin Lan , Jakub M. Tomczak , Diederik M. Roijers , A. E. Eiben

A novel multiscale consensus-based optimization (CBO) algorithm for solving bi- and tri-level optimization problems is introduced. Existing CBO techniques are generalized by the proposed method through the employment of multiple interacting…

Optimization and Control · Mathematics 2025-06-23 Michael Herty , Yuyang Huang , Dante Kalise , Hicham Kouhkouh

System performance for networks composed of interconnected subsystems can be increased if the traditionally separated subsystems are jointly optimized. Recently, parallel and distributed optimization methods have emerged as a powerful tool…

Optimization and Control · Mathematics 2013-02-14 Ion Necoara , Valentin Nedelcu , Ioan Dumitrache
‹ Prev 1 2 3 10 Next ›