English
Related papers

Related papers: Evolutionary algorithms for hyperparameter optimiz…

200 papers

Learning ensembles by bagging can substantially improve the generalization performance of low-bias, high-variance estimators, including those evolved by Genetic Programming (GP). To be efficient, modern GP algorithms for evolving (bagging)…

Neural and Evolutionary Computing · Computer Science 2021-02-08 Marco Virgolin

We present a novel approach to performing fitness approximation in genetic algorithms (GAs) using machine-learning (ML) models, through dynamic adaptation to the evolutionary state. Maintaining a dataset of sampled individuals along with…

Neural and Evolutionary Computing · Computer Science 2024-05-22 Itai Tzruia , Tomer Halperin , Moshe Sipper , Achiya Elyasaf

In this paper we propose a novel method for learning how algorithms perform. Classically, algorithms are compared on a finite number of existing (or newly simulated) benchmark datasets based on some fixed metrics. The algorithm(s) with the…

Data Structures and Algorithms · Computer Science 2019-11-01 Henry Wilde , Vincent Knight , Jonathan Gillard

Dynamic optimization problems (DOPs) are challenging due to their changing conditions. This requires algorithms to be highly adaptable and efficient in terms of finding rapidly new optimal solutions under changing conditions. Traditional…

Neural and Evolutionary Computing · Computer Science 2025-05-20 Federico Signorelli , Anil Yaman

Designing controllers for complex industrial electronic systems is challenging due to nonlinearities and parameter uncertainties, and traditional methods are often slow and costly. To address this, we propose a novel autonomous design…

Systems and Control · Electrical Eng. & Systems 2025-07-23 Chenggang Cui , Jiaming Liu , Peifeng Hui , Pengfeng Lin , Chuanlin Zhang

Genetic algorithm (GA) is a stochastic metaheuristic process consisting on the evolution of a population of candidate solutions for a given optimization problem. By extension, multipopulation genetic algorithm (MPGA) aims for efficiency by…

Neural and Evolutionary Computing · Computer Science 2018-06-07 Bruno Messias , Bruno W. D. Morais

We study the variant of Particle Swarm Optimization (PSO) that applies random velocities in a dimension instead of the regular velocity update equations as soon as the so-called potential of the swarm falls below a certain bound in this…

Neural and Evolutionary Computing · Computer Science 2020-12-22 Bernd Bassimir , Manuel Schmitt , Rolf Wanka

This paper discusses how particle swarm optimization (PSO) can be used to generate quantum circuits to solve an instance of the MaxOne problem. It then analyzes previous studies on evolutionary algorithms for circuit synthesis. With a brief…

Neural and Evolutionary Computing · Computer Science 2025-07-08 Mirza Hizriyan Nubli Hidayat , Tan Chye Cheah

During the training phase of machine learning (ML) models, it is usually necessary to configure several hyperparameters. This process is computationally intensive and requires an extensive search to infer the best hyperparameter set for the…

Machine Learning · Computer Science 2024-04-19 Angelos Chatzimparmpas , Rafael M. Martins , Kostiantyn Kucher , Andreas Kerren

Breast cancer is considered the most critical and frequently diagnosed cancer in women worldwide, leading to an increase in cancer-related mortality. Early and accurate detection is crucial as it can help mitigate possible threats while…

Weather forecasting plays a vital role in numerous sectors, but accurately capturing the complex dynamics of weather systems remains a challenge for traditional statistical models. Apart from Auto Regressive time forecasting models like…

Neural and Evolutionary Computing · Computer Science 2023-11-27 Anuvab Sen , Arul Rhik Mazumder , Dibyarup Dutta , Udayon Sen , Pathikrit Syam , Sandipan Dhar

In this study we address existing deficiencies in the literature on applications of Particle Swarm Optimization to generate optimal designs. We present the results of a large computer study in which we bench-mark both efficiency and…

Neural and Evolutionary Computing · Computer Science 2022-06-15 Stephen J. Walsh , John J. Borkowski

This paper provides an in-depth empirical analysis of several evolutionary algorithms on the one-dimensional spin glass model with power-law interactions. The considered spin glass model provides a mechanism for tuning the effective range…

Disordered Systems and Neural Networks · Physics 2009-07-29 Martin Pelikan , Helmut G. Katzgraber

Many real-world problems are dynamic optimization problems. In this case, the optima in the environment change dynamically. Therefore, traditional optimization algorithms disable to track and find optima. In this paper, a new multi-swarm…

Neural and Evolutionary Computing · Computer Science 2013-08-08 Somayeh Nabizadeh , Alireza Rezvanian , Mohammd Reza Meybodi

Recently, much progress has been made on particle swarm optimization (PSO). A number of works have been devoted to analyzing the convergence of the underlying algorithms. Nevertheless, in most cases, rather simplified hypotheses are used.…

Optimization and Control · Mathematics 2016-11-15 Quan Yuan , George Yin

Premature convergence in particle swarm optimization (PSO) algorithm usually leads to gaining local optimum and preventing from surveying those regions of solution space which have optimal points in. In this paper, by applying special…

Neural and Evolutionary Computing · Computer Science 2018-07-03 Anvar Bahrampour , Omid Mohamad Nezami

Particle Swarm Optimisation (PSO) is a powerful optimisation algorithm that can be used to locate global maxima in a search space. Recent interest in swarms of Micro Aerial Vehicles (MAVs) begs the question as to whether PSO can be used as…

Robotics · Computer Science 2019-07-18 Lauren Parker , James Butterworth , Shan Luo

Purpose: Machine learning is broadly used for clinical data analysis. Before training a model, a machine learning algorithm must be selected. Also, the values of one or more model parameters termed hyper-parameters must be set. Selecting…

Machine Learning · Computer Science 2018-12-10 Xueqiang Zeng , Gang Luo

Mutation is one of the most important stages of the genetic algorithm because of its impact on the exploration of global optima, and to overcome premature convergence. There are many types of mutation, and the problem lies in selection of…

Evolutionary algorithms have been frequently applied to constrained continuous optimisation problems. We carry out feature based comparisons of different types of evolutionary algorithms such as evolution strategies, differential evolution…

Artificial Intelligence · Computer Science 2015-09-24 Shayan Poursoltan , Frank Neumann