English
Related papers

Related papers: Quality and Computation Time in Optimization Probl…

200 papers

Evolutionary computation offers a variety of tools to solve complex real-world optimization problems. However, research often focuses on smaller, simplified problems and optimization algorithms that sometimes miss expectations in real-world…

Bayesian Optimization (BO) is a sample-efficient optimization algorithm widely employed across various applications. In some challenging BO tasks, input uncertainty arises due to the inevitable randomness in the optimization process, such…

Machine Learning · Computer Science 2023-11-07 Lin Yang , Junlong Lyu , Wenlong Lyu , Zhitang Chen

Simulators often require calibration inputs estimated from real world data and the quality of the estimate can significantly affect simulation output. Particularly when performing simulation optimisation to find an optimal solution, the…

Machine Learning · Computer Science 2020-06-02 Juan Ungredda , Michael Pearce , Juergen Branke

Mixed-integer optimisation problems can be computationally challenging. Here, we introduce and analyse two efficient algorithms with a specific sequential design that are aimed at dealing with sampled problems within this class. At each…

Optimization and Control · Mathematics 2023-03-07 Mohammadreza Chamanbaz , Roland Bouffanais

Bayesian Optimization (BO) is a surrogate-assisted global optimization technique that has been successfully applied in various fields, e.g., automated machine learning and design optimization. Built upon a so-called infill-criterion and…

Neural and Evolutionary Computing · Computer Science 2020-07-03 Elena Raponi , Hao Wang , Mariusz Bujny , Simonetta Boria , Carola Doerr

A common aspect of today's cyber-physical systems is that multiple optimization-based control tasks may execute in a shared processor. Such control tasks make use of online optimization and thus have large execution times; hence, their…

Optimization and Control · Mathematics 2022-03-14 Mehdi Hosseinzadeh , Bruno Sinopoli , Ilya Kolmanovsky , Sanjoy Baruah

Online tuning of real-world plants is a complex optimisation problem that continues to require manual intervention by experienced human operators. Autonomous tuning is a rapidly expanding field of research, where learning-based methods,…

AI practitioners typically strive to develop the most accurate systems, making an implicit assumption that the AI system will function autonomously. However, in practice, AI systems often are used to provide advice to people in domains…

Artificial Intelligence · Computer Science 2021-02-23 Gagan Bansal , Besmira Nushi , Ece Kamar , Eric Horvitz , Daniel S. Weld

Bayesian optimization (BO) is a popular, sample-efficient technique for expensive, black-box optimization. One such problem arising in manufacturing is that of maximizing the reliability, or equivalently minimizing the probability of a…

Machine Learning · Computer Science 2026-02-03 Jack M. Buckingham , Ivo Couckuyt , Juergen Branke

Optimization is ubiquitous in our daily lives. In the past, (sub-)optimal solutions to any problem have been derived by trial and error, sheer luck, or the expertise of knowledgeable individuals. In our contemporary age, there thankfully…

Neural and Evolutionary Computing · Computer Science 2023-12-07 Raphael Patrick Prager

Benchmarking optimization algorithms is fundamental for the advancement of computational intelligence. However, widely adopted artificial test suites exhibit limited correspondence with the diversity and complexity of real-world engineering…

Computational Engineering, Finance, and Science · Computer Science 2026-04-17 Stefan Ivić , Siniša Družeta , Luka Grbčić

Recent research has proposed a series of specialized optimization algorithms for deep multi-task models. It is often claimed that these multi-task optimization (MTO) methods yield solutions that are superior to the ones found by simply…

Machine Learning · Computer Science 2022-09-26 Derrick Xin , Behrooz Ghorbani , Ankush Garg , Orhan Firat , Justin Gilmer

Bayesian optimization provides an effective method to optimize expensive-to-evaluate black box functions. It has been widely applied to problems in many fields, including notably in computer science, e.g. in machine learning to optimize…

Machine Learning · Computer Science 2025-11-18 Mike Diessner , Joseph O'Connor , Andrew Wynn , Sylvain Laizet , Yu Guan , Kevin Wilson , Richard D. Whalley

We formulate selecting the best optimizing system (SBOS) problems and provide solutions for those problems. In an SBOS problem, a finite number of systems are contenders. Inside each system, a continuous decision variable affects the…

Methodology · Statistics 2025-11-04 Nian Si , Yifu Tang , Zeyu Zheng

Bayesian optimization (BO) is an efficient method for optimizing expensive black-box functions. In real-world applications, BO often faces a major problem of missing values in inputs. The missing inputs can happen in two cases. First, the…

Machine Learning · Computer Science 2020-06-22 Phuc Luong , Dang Nguyen , Sunil Gupta , Santu Rana , Svetha Venkatesh

Bayesian optimisation has proven to be a powerful tool for expensive global black-box optimisation problems. In this paper, we propose new Bayesian optimisation variants of the popular Knowledge Gradient acquisition functions for problems…

Machine Learning · Computer Science 2025-12-22 Xietao Wang Lin , Juan Ungredda , Max Butler , James Town , Alma Rahat , Hemant Singh , Juergen Branke

In [1], we have explored the theoretical aspects of feature selection and evolutionary algorithms. In this chapter, we focus on optimization algorithms for enhancing data analytic process, i.e., we propose to explore applications of…

Machine Learning · Computer Science 2019-08-26 Farid Ghareh Mohammadi , M. Hadi Amini , Hamid R. Arabnia

Bayesian optimisation (BO) algorithms have shown remarkable success in applications involving expensive black-box functions. Traditionally BO has been set as a sequential decision-making process which estimates the utility of query points…

Machine Learning · Computer Science 2022-10-25 Rafael Oliveira , Louis Tiao , Fabio Ramos

Bayesian optimization (BO) is an approach to globally optimizing black-box objective functions that are expensive to evaluate. BO-powered experimental design has found wide application in materials science, chemistry, experimental physics,…

Machine Learning · Computer Science 2023-10-10 Mimi Zhang , Andrew Parnell , Dermot Brabazon , Alessio Benavoli

Many expensive black-box optimisation problems are sensitive to their inputs. In these problems it makes more sense to locate a region of good designs, than a single-possibly fragile-optimal design. Expensive black-box functions can be…

Machine Learning · Computer Science 2021-12-16 Nicholas D. Sanders , Richard M. Everson , Jonathan E. Fieldsend , Alma A. M. Rahat