English
Related papers

Related papers: Evolutionary algorithms for hyperparameter optimiz…

200 papers

Optimization problems often require domain-specific expertise to design problem-dependent methodologies. Recently, several approaches have gained attention by integrating large language models (LLMs) into genetic algorithms. Building on…

Neural and Evolutionary Computing · Computer Science 2025-04-15 Yamato Shinohara , Jinglue Xu , Tianshui Li , Hitoshi Iba

Drones are effective for reducing human activity and interactions by performing tasks such as exploring and inspecting new environments, monitoring resources and delivering packages. Drones need a controller to maintain stability and to…

Systems and Control · Electrical Eng. & Systems 2021-05-19 Azin Shamshirgaran , Hamed Javidi , Dan Simon

A key challenge in the application of evolutionary algorithms in practice is the selection of an algorithm instance that best suits the problem at hand. What complicates this decision further is that different algorithms may be best suited…

Neural and Evolutionary Computing · Computer Science 2021-02-15 Furong Ye , Carola Doerr , Thomas Bäck

A great deal of research has been conducted in the consideration of meta-heuristic optimisation methods that are able to find global optima in settings that gradient based optimisers have traditionally struggled. Of these, so-called…

Neural and Evolutionary Computing · Computer Science 2023-05-01 Max D. Champneys , Timothy J. Rogers

Nowadays, we are immersed in tens of newly-proposed evolutionary and swam-intelligence metaheuristics, which makes it very difficult to choose a proper one to be applied on a specific optimization problem at hand. On the other hand, most of…

Neural and Evolutionary Computing · Computer Science 2020-01-27 Hamid Reza Boveiri , Raouf Khayami

This paper preliminarily investigates the duality between flow matching in generative models and particle swarm optimization (PSO) in evolutionary computation. Through theoretical analysis, we reveal the intrinsic connections between these…

Neural and Evolutionary Computing · Computer Science 2025-07-29 Kaichen Ouyang

Evolutionary optimization algorithms, including particle swarm optimization (PSO), have been successfully applied in oil industry for production planning and control. Such optimization studies are quite challenging due to large number of…

Neural and Evolutionary Computing · Computer Science 2021-06-03 Ajitabh Kumar

The choices of hyperparameters have critical effects on the performance of machine learning models. In this paper, we present a general framework that is able to construct an adaptive optimizer, which automatically adjust the appropriate…

Machine Learning · Computer Science 2022-01-31 Huayuan Sun

Since deep neural networks were developed, they have made huge contributions to everyday lives. Machine learning provides more rational advice than humans are capable of in almost every aspect of daily life. However, despite this…

Machine Learning · Computer Science 2020-03-13 Tong Yu , Hong Zhu

The particle swarm optimization (PSO) algorithm has been recently introduced in the non--linear programming, becoming widely studied and used in a variety of applications. Starting from its original formulation, many variants for…

Optimization and Control · Mathematics 2020-04-15 Silvano Chiaradonna , Felicita Di Giandomenico , Nadir Murru

Evolutionary computation (EC) algorithms, such as discrete and multi-objective versions of particle swarm optimization (PSO), have been applied to solve the Feature selection (FS) problem, tackling the combinatorial explosion of search…

Neural and Evolutionary Computing · Computer Science 2019-01-28 Hassen Dhrif , Luis G. Sanchez Giraldo , Miroslav Kubat , Stefan Wuchty

Convolutional Neural Networks (CNN) have gained great success in many artificial intelligence tasks. However, finding a good set of hyperparameters for a CNN remains a challenging task. It usually takes an expert with deep knowledge, and…

Neural and Evolutionary Computing · Computer Science 2020-06-25 Xueli Xiao , Ming Yan , Sunitha Basodi , Chunyan Ji , Yi Pan

Numerical optimization techniques are widely used in a broad area of science and technology, from finding the minimal energy of systems in Physics or Chemistry to finding optimal routes in logistics or optimal strategies for high speed…

Neural and Evolutionary Computing · Computer Science 2025-08-20 Yury Chernyak , Ijaz Ahamed Mohammad , Nikolas Masnicak , Matej Pivoluska , Martin Plesch

In transportation planning and development, transport network design problem seeks to optimize specific objectives (e.g. total travel time) through choosing among a given set of projects while keeping consumption of resources (e.g. budget)…

Optimization and Control · Mathematics 2015-02-04 Mehran Fasihozaman Langerudi

Particle swarm optimization (PSO) is an iterative search method that moves a set of candidate solution around a search-space towards the best known global and local solutions with randomized step lengths. PSO frequently accelerates…

Neural and Evolutionary Computing · Computer Science 2021-02-25 Johannes Jakubik , Adrian Binding , Stefan Feuerriegel

Learner Performance-based Behavior using Simulated Annealing (LPBSA) is an improvement of the Learner Performance-based Behavior (LPB) algorithm. LPBSA, like LPB, has been proven to deal with single and complex problems. Simulated Annealing…

Neural and Evolutionary Computing · Computer Science 2025-01-30 Dana Rasul Hamad , Tarik A. Rashid

Learning agents can make use of Reinforcement Learning (RL) to decide their actions by using a reward function. However, the learning process is greatly influenced by the elect of values of the hyperparameters used in the learning…

Robotics · Computer Science 2022-11-03 Adarsh Sehgal , Nicholas Ward , Hung La , Sushil Louis

A new model for evolving Evolutionary Algorithms (EAs) is proposed in this paper. The model is based on the Multi Expression Programming (MEP) technique. Each MEP chromosome encodes an evolutionary pattern that is repeatedly used for…

Neural and Evolutionary Computing · Computer Science 2021-10-13 Mihai Oltean

This paper presents a particle swarm optimizer for production of endurance time excitation functions. These excitations are intensifying acceleration time histories that are used as input motions in endurance time method. The accuracy of…

Signal Processing · Electrical Eng. & Systems 2019-11-01 Mohammadreza Mashayekhi , Mojtaba Harati , Homayoon E. Estekanchi

Hyperparameter optimization constitutes a large part of typical modern machine learning workflows. This arises from the fact that machine learning methods and corresponding preprocessing steps often only yield optimal performance when…