English
Related papers

Related papers: Q(D)O-ES: Population-based Quality (Diversity) Opt…

200 papers

One of the most tedious tasks in the application of machine learning is model selection, i.e. hyperparameter selection. Fortunately, recent progress has been made in the automation of this process, through the use of sequential model-based…

Machine Learning · Computer Science 2014-02-05 Alexandre Lacoste , Hugo Larochelle , François Laviolette , Mario Marchand

In a variety of domains, from robotics to finance, Quality-Diversity algorithms have been used to generate collections of both diverse and high-performing solutions. Multi-Objective Quality-Diversity algorithms have emerged as a promising…

Artificial Intelligence · Computer Science 2026-02-03 Hannah Janmohamed , Maxence Faldor , Thomas Pierrot , Antoine Cully

Dynamic Selection (DS), where base classifiers are chosen from a classifier's pool for each new instance at test time, has shown to be highly effective in pattern recognition. However, instability and redundancy in the classifier pools can…

Machine Learning · Computer Science 2024-07-11 Hesam Jalalian , Rafael M. O. Cruz

Quality Diversity (QD) algorithms are a recent family of optimization algorithms that search for a large set of diverse but high-performing solutions. In some specific situations, they can solve multiple tasks at once. For instance, they…

Neural and Evolutionary Computing · Computer Science 2020-04-20 Jean-Baptiste Mouret , Glenn Maguire

Diversity optimization is the class of optimization problems in which we aim to find a diverse set of good solutions. One of the frequently-used approaches to solve such problems is to use evolutionary algorithms that evolve a desired…

Neural and Evolutionary Computing · Computer Science 2025-12-17 Denis Antipov , Aneta Neumann , Frank Neumann , Andrew M. Sutton

The combination of multiple classifiers using ensemble methods is increasingly important for making progress in a variety of difficult prediction problems. We present a comparative analysis of several ensemble methods through two case…

Machine Learning · Computer Science 2013-09-20 Sean Whalen , Gaurav Pandey

The remarkable performance of Large Language Models (LLMs) highly relies on crafted prompts. However, manual prompt engineering is a laborious process, creating a core bottleneck for practical application of LLMs. This phenomenon has led to…

Computation and Language · Computer Science 2025-11-21 Qing Zhang , Bing Xu , Xudong Zhang , Yifan Shi , Yang Li , Chen Zhang , Yik Chung Wu , Ngai Wong , Yijie Chen , Hong Dai , Xiansen Chen , Mian Zhang

Quality-Diversity (QD) algorithms have recently gained traction as optimisation methods due to their effectiveness at escaping local optima and capability of generating wide-ranging and high-performing solutions. Recently, Multi-Objective…

Neural and Evolutionary Computing · Computer Science 2023-05-17 Hannah Janmohamed , Thomas Pierrot , Antoine Cully

Ensemble learning has been widely used in machine learning to improve model robustness, accuracy, and generalization, but has not yet been applied to code generation tasks with large language models (LLMs). We propose an ensemble approach…

Software Engineering · Computer Science 2025-07-22 Tarek Mahmud , Bin Duan , Corina Pasareanu , Guowei Yang

In Dynamic Ensemble Selection (DES) techniques, only the most competent classifiers are selected to classify a given query sample. Hence, the key issue in DES is how to estimate the competence of each classifier in a pool to select the most…

Machine Learning · Computer Science 2018-11-06 Rafael M. O. Cruz , Robert Sabourin , George D. C. Cavalcanti

The emerging availability of trained machine learning models has put forward the novel concept of Machine Learning Model Market in which one can harness the collective intelligence of multiple well-trained models to improve the performance…

Machine Learning · Computer Science 2023-02-24 Naibo Wang , Wenjie Feng , Fusheng Liu , Moming Duan , See-Kiong Ng

The ensemble methods are meta-algorithms that combine several base machine learning techniques to increase the effectiveness of the classification. Many existing committees of classifiers use the classifier selection process to determine…

Machine Learning · Computer Science 2021-06-15 Robert Burduk

The key issue in Dynamic Ensemble Selection (DES) is defining a suitable criterion for calculating the classifiers' competence. There are several criteria available to measure the level of competence of base classifiers, such as local…

Machine Learning · Computer Science 2018-11-02 Rafael M. O Cruz , Robert Sabourin , George D. C. Cavalcanti

A prevalent limitation of optimizing over a single objective is that it can be misguided, becoming trapped in local optimum. This can be rectified by Quality-Diversity (QD) algorithms, where a population of high-quality and diverse…

Machine Learning · Computer Science 2023-04-18 Ryan Wickman , Bibek Poudel , Michael Villarreal , Xiaofei Zhang , Weizi Li

Solving constrained multi-objective optimization problems with evolutionary algorithms has attracted considerable attention. Various constrained multi-objective optimization evolutionary algorithms (CMOEAs) have been developed with the use…

Artificial Intelligence · Computer Science 2024-02-21 Fei Ming , Wenyin Gong , Ling Wang , Yaochu Jin

Dynamic ensemble selection (DES) techniques work by estimating the level of competence of each classifier from a pool of classifiers. Only the most competent ones are selected to classify a given test sample. Hence, the key issue in DES is…

Machine Learning · Computer Science 2015-09-14 Rafael M. O. Cruz , Robert Sabourin , George D. C. Cavalcanti

The subpopulationtion shift, characterized by a disparity in subpopulation distributibetween theween the training and target datasets, can significantly degrade the performance of machine learning models. Current solutions to subpopulation…

Quality-Diversity (QD) optimisation is a new family of learning algorithms that aims at generating collections of diverse and high-performing solutions. Among those algorithms, the recently introduced Covariance Matrix Adaptation MAP-Elites…

Neural and Evolutionary Computing · Computer Science 2021-07-07 Antoine Cully

Subset selection is an important component in evolutionary multiobjective optimization (EMO) algorithms. Clustering, as a classic method to group similar data points together, has been used for subset selection in some fields. However,…

Neural and Evolutionary Computing · Computer Science 2021-08-31 Weiyu Chen , Hisao Ishibuchi , Ke Shang

We propose a novel surrogate-assisted Evolutionary Algorithm for solving expensive combinatorial optimization problems. We integrate a surrogate model, which is used for fitness value estimation, into a state-of-the-art P3-like variant of…

Neural and Evolutionary Computing · Computer Science 2021-04-19 Arkadiy Dushatskiy , Tanja Alderliesten , Peter A. N. Bosman