English
Related papers

Related papers: Quality and Computation Time in Optimization Probl…

200 papers

A key part of any evolutionary algorithm is fitness evaluation. When fitness evaluations are corrupted by noise, as happens in many real-world problems as a consequence of various types of uncertainty, a strategy is needed in order to cope…

Neural and Evolutionary Computing · Computer Science 2017-07-13 Simon M. Lucas , Jialin Liu , Diego Pérez-Liébana

Cooking typically involves a plethora of decisions about ingredients and tools that need to be chosen in order to write a good cooking recipe. Cooking can be modelled in an optimization framework, as it involves a search space of…

Artificial Intelligence · Computer Science 2020-02-04 Eduardo C. Garrido-Merchán , Alejandro Albarca-Molina

Nature-inspired algorithms are among the most powerful algorithms for optimization. In this study, a new nature-inspired metaheuristic optimization algorithm, called bat algorithm (BA), is introduced for solving engineering optimization…

Optimization and Control · Mathematics 2012-11-29 Xin-She Yang , Amir H. Gandomi

Machine learning develops rapidly, which has made many theoretical breakthroughs and is widely applied in various fields. Optimization, as an important part of machine learning, has attracted much attention of researchers. With the…

Machine Learning · Computer Science 2019-10-24 Shiliang Sun , Zehui Cao , Han Zhu , Jing Zhao

Hyperparameter optimisation is a crucial process in searching the optimal machine learning model. The efficiency of finding the optimal hyperparameter settings has been a big concern in recent researches since the optimisation process could…

Machine Learning · Computer Science 2020-09-15 Yuxi Huan , Fan Wu , Michail Basios , Leslie Kanthan , Lingbo Li , Baowen Xu

Algorithm design is a laborious process and often requires many iterations of ideation and validation. In this paper, we explore automating algorithm design and present a method to learn an optimization algorithm, which we believe to be the…

Machine Learning · Computer Science 2016-06-07 Ke Li , Jitendra Malik

Computational models in fields such as computational neuroscience are often evaluated via stochastic simulation or numerical approximation. Fitting these models implies a difficult optimization problem over complex, possibly noisy parameter…

Machine Learning · Statistics 2017-11-03 Luigi Acerbi , Wei Ji Ma

A wide spectrum of design and decision problems, including parameter tuning, A/B testing and drug design, intrinsically are instances of black-box optimization. Bayesian optimization (BO) is a powerful tool that models and optimizes such…

Machine Learning · Computer Science 2023-02-14 Tianyi Bai , Yang Li , Yu Shen , Xinyi Zhang , Wentao Zhang , Bin Cui

Bayesian optimization (BO) developed as an approach for the efficient optimization of expensive black-box functions without gradient information. A typical BO paper introduces a new approach and compares it to some alternatives on simulated…

Computation · Statistics 2023-10-17 Jiajie Kong , Tony Pourmohamad , Herbert K. H. Lee

Machine learning algorithms have been used widely in various applications and areas. To fit a machine learning model into different problems, its hyper-parameters must be tuned. Selecting the best hyper-parameter configuration for machine…

Machine Learning · Computer Science 2022-10-06 Li Yang , Abdallah Shami

Benchmarking the performance of quantum optimization algorithms is crucial for identifying utility for industry-relevant use cases. Benchmarking processes vary between optimization applications and depend on user-specified goals. The…

Bayesian optimization (BO) provides a powerful framework for optimizing black-box, expensive-to-evaluate functions. It is therefore an attractive tool for engineering design problems, typically involving multiple objectives. Thanks to the…

Machine Learning · Computer Science 2024-09-06 Navid Ansari , Alireza Javanmardi , Eyke Hüllermeier , Hans-Peter Seidel , Vahid Babaei

Bayesian optimization is used in many areas of AI for the optimization of black-box processes and has achieved impressive improvements of the state of the art for a lot of applications. It intelligently explores large and complex design…

Materials Science · Physics 2021-08-03 Lars Kotthoff , Hud Wahab , Patrick Johnson

Bayesian optimization (BO) methods are useful for optimizing functions that are expensive to evaluate, lack an analytical expression and whose evaluations can be contaminated by noise. These methods rely on a probabilistic model of the…

Machine Learning · Statistics 2020-02-04 Eduardo C. Garrido-Merchán , Daniel Hernández-Lobato

Combinatorial optimization is anticipated to be one of the primary use cases for quantum computation in the coming years. The Quantum Approximate Optimization Algorithm (QAOA) and Quantum Annealing (QA) can potentially demonstrate…

Bayesian optimization (BO) is a principled approach to molecular design tasks. In this paper we explain three pitfalls of BO which can cause poor empirical performance: an incorrect prior width, over-smoothing, and inadequate acquisition…

Machine Learning · Computer Science 2024-07-26 Austin Tripp , José Miguel Hernández-Lobato

Multi-objective evolutionary algorithms (MOEAs) have become essential tools for solving multi-objective optimization problems (MOPs), making their running time analysis crucial for assessing algorithmic efficiency and guiding practical…

Neural and Evolutionary Computing · Computer Science 2025-07-04 Han Huang , Tianyu Wang , Chaoda Peng , Tongli He , Zhifeng Hao

Benchmarking plays an important role in the development of novel search algorithms as well as for the assessment and comparison of contemporary algorithmic ideas. This paper presents common principles that need to be taken into account when…

Neural and Evolutionary Computing · Computer Science 2018-10-08 Michael Hellwig , Hans-Georg Beyer

In a wide array of areas, algorithms are matching and surpassing the performance of human experts, leading to consideration of the roles of human judgment and algorithmic prediction in these domains. The discussion around these…

Computer Vision and Pattern Recognition · Computer Science 2019-04-01 Maithra Raghu , Katy Blumer , Greg Corrado , Jon Kleinberg , Ziad Obermeyer , Sendhil Mullainathan

Many real-world optimization problems occur in environments that change dynamically or involve stochastic components. Evolutionary algorithms and other bio-inspired algorithms have been widely applied to dynamic and stochastic problems.…

Neural and Evolutionary Computing · Computer Science 2020-01-30 Vahid Roostapour , Mojgan Pourhassan , Frank Neumann