English
Related papers

Related papers: Enhancing Machine Learning Model Performance with …

200 papers

Optimization problems aim to find the optimal solution, which is becoming increasingly complex and difficult to solve. Traditional evolutionary optimization methods always overlook the granular characteristics of solution space. In the real…

Machine Learning · Computer Science 2025-02-19 Shuyin Xia , Xinyu Lin , Guan Wang , De-Gang Chen , Sen Zhao , Guoyin Wang , Jing Liang

Search-based test-generation algorithms have countless configuration options. Users rarely adjust these options and usually stick to the default values, which may not lead to the best possible results. Tuning an algorithm's hyperparameters…

Software Engineering · Computer Science 2025-10-13 Stephan Lukasczyk , Gordon Fraser

Numerical optimization techniques are widely used in a broad area of science and technology, from finding the minimal energy of systems in Physics or Chemistry to finding optimal routes in logistics or optimal strategies for high speed…

Neural and Evolutionary Computing · Computer Science 2025-08-20 Yury Chernyak , Ijaz Ahamed Mohammad , Nikolas Masnicak , Matej Pivoluska , Martin Plesch

Determining the ideal architecture for deep learning models, such as the number of layers and neurons, is a difficult and resource-intensive process that frequently relies on human tuning or computationally costly optimization approaches.…

Artificial Intelligence · Computer Science 2025-04-22 Saad Hameed , Basheer Qolomany , Samir Brahim Belhaouari , Mohamed Abdallah , Junaid Qadir , Ala Al-Fuqaha

Hyperparameter optimization (HPO) is a vital step in improving performance in deep learning (DL). Practitioners are often faced with the trade-off between multiple criteria, such as accuracy and latency. Given the high computational needs…

Machine Learning · Computer Science 2023-06-01 Shuhei Watanabe , Noor Awad , Masaki Onishi , Frank Hutter

The success of machine learning on a given task dependson, among other things, which learning algorithm is selected and its associated hyperparameters. Selecting an appropriate learning algorithm and setting its hyperparameters for a given…

Machine Learning · Computer Science 2014-07-09 Michael R. Smith , Logan Mitchell , Christophe Giraud-Carrier , Tony Martinez

This paper investigates the optimal signal detection problem with a particular interest in large-scale multiple-input multiple-output (MIMO) systems. The problem is NP-hard and can be solved optimally by searching the shortest path on the…

Machine Learning · Computer Science 2022-03-22 Le He , Ke He , Lisheng Fan , Xianfu Lei , Arumugam Nallanathan , George K. Karagiannidis

Neural architecture search (NAS) and hyperparameter optimization (HPO) make deep learning accessible to non-experts by automatically finding the architecture of the deep neural network to use and tuning the hyperparameters of the used…

Hyperparameter optimization (HPO) is a key component of machine learning models for achieving peak predictive performance. While numerous methods and algorithms for HPO have been proposed over the last years, little progress has been made…

Optimizing an expensive-to-query function is a common task in science and engineering, where it is beneficial to keep the number of queries to a minimum. A popular strategy is Bayesian optimization (BO), which leverages probabilistic models…

Machine Learning · Computer Science 2019-07-05 Willie Neiswanger , Kirthevasan Kandasamy , Barnabas Poczos , Jeff Schneider , Eric Xing

Deep learning has achieved impressive results on many problems. However, it requires high degree of expertise or a lot of experience to tune well the hyperparameters, and such manual tuning process is likely to be biased. Moreover, it is…

Computer Vision and Pattern Recognition · Computer Science 2018-01-08 Jiazhuo Wang , Jason Xu , Xuejun Wang

Solving optimal design problems through crowdsourcing faces a dilemma: On one hand, human beings have been shown to be more effective than algorithms at searching for good solutions of certain real-world problems with high-dimensional or…

Machine Learning · Computer Science 2017-04-28 Thurston Sexton , Max Yi Ren

Genetic algorithms have been widely used in many practical optimization problems. Inspired by natural selection, operators, including mutation, crossover and selection, provide effective heuristics for search and black-box optimization.…

Machine Learning · Statistics 2018-03-14 Tanmay Gangwani , Jian Peng

Optimisation problems are ubiquitous in particle and astrophysics, and involve locating the optimum of a complicated function of many parameters that may be computationally expensive to evaluate. We describe a number of global optimisation…

Swarm intelligence optimization algorithms can be adopted in swarm robotics for target searching tasks in a 2-D or 3-D space by treating the target signal strength as fitness values. Many current works in the literature have achieved good…

Neural and Evolutionary Computing · Computer Science 2021-05-28 Jian Yang , Yuhui Shi

Machine Learning algorithms have been extensively researched throughout the last decade, leading to unprecedented advances in a broad range of applications, such as image classification and reconstruction, object recognition, and text…

Artificial Intelligence · Computer Science 2022-12-20 Gustavo H. de Rosa , Mateus Roder , João Paulo Papa , Claudio F. G. dos Santos

Automatically searching for optimal hyperparameter configurations is of crucial importance for applying deep learning algorithms in practice. Recently, Bayesian optimization has been proposed for optimizing hyperparameters of various…

Artificial Intelligence · Computer Science 2017-01-24 Ilija Ilievski , Taimoor Akhtar , Jiashi Feng , Christine Annette Shoemaker

Optimization aims at selecting a feasible set of parameters in an attempt to solve a particular problem, being applied in a wide range of applications, such as operations research, machine learning fine-tuning, and control engineering,…

Neural and Evolutionary Computing · Computer Science 2020-12-03 Gustavo H. de Rosa , Douglas Rodrigues , João P. Papa

Metaheuristic algorithms are essential for solving complex optimization problems in different fields. However, the difficulty in comparing and rating these algorithms remains due to the wide range of performance metrics and problem…

Neural and Evolutionary Computing · Computer Science 2024-11-28 Evgenia-Maria K. Goula , Dimitris G. Sotiropoulos

Low-light image enhancement remains an open problem, and the new wave of artificial intelligence is at the center of this problem. This work describes the use of genetic algorithms for optimizing analytical models that can improve the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Axel Martinez , Emilio Hernandez , Matthieu Olague , Gustavo Olague