English
Related papers

Related papers: Automated Configuration of Genetic Algorithms by T…

200 papers

Robust iterative methods for solving large sparse systems of linear algebraic equations often suffer from the problem of optimizing the corresponding tuning parameters. To improve the performance of the problem of interest, specific…

Numerical Analysis · Mathematics 2023-10-18 Andrey Petrushov , Boris Krasnopolsky

We present the first nontrivial procedure for configuring heuristic algorithms to maximize the utility provided to their end users while also offering theoretical guarantees about performance. Existing procedures seek configurations that…

Artificial Intelligence · Computer Science 2023-11-01 Devon R. Graham , Kevin Leyton-Brown , Tim Roughgarden

Reinforcement learning (RL) applications, where an agent can simply learn optimal behaviors by interacting with the environment, are quickly gaining tremendous success in a wide variety of applications from controlling simple pendulums to…

Machine Learning · Computer Science 2022-01-28 Mariam Kiran , Melis Ozyildirim

Most machine learning algorithms are configured by one or several hyperparameters that must be carefully chosen and often considerably impact performance. To avoid a time consuming and unreproducible manual trial-and-error process to find…

Population-based evolutionary algorithms are often considered when approaching computationally expensive black-box optimization problems. They employ a selection mechanism to choose the best solutions from a given population after comparing…

Neural and Evolutionary Computing · Computer Science 2024-01-30 Judith Echevarrieta , Etor Arza , Aritz Pérez

Automatic performance tuning (auto-tuning) is essential for optimizing high-performance applications, where vast and irregular search spaces make manual exploration infeasible. While auto-tuners traditionally rely on classical approaches…

Machine Learning · Computer Science 2026-04-01 Floris-Jan Willemsen , Niki van Stein , Ben van Werkhoven

In real-time trajectory planning for unmanned vehicles, on-board sensors, radars and other instruments are used to collect information on possible obstacles to be avoided and pathways to be followed. Since, in practice, observations of the…

Methodology · Statistics 2013-09-25 Adriano Zanin Zambom , Julian A. A. Collazos , Ronaldo Dias

With neural networks having demonstrated their versatility and benefits, the need for their optimal performance is as prevalent as ever. A defining characteristic, hyperparameters, can greatly affect its performance. Thus engineers go…

Neural and Evolutionary Computing · Computer Science 2020-09-21 Keshav Ganapathy

Hyperparameter optimisation is a crucial process in searching the optimal machine learning model. The efficiency of finding the optimal hyperparameter settings has been a big concern in recent researches since the optimisation process could…

Machine Learning · Computer Science 2020-09-15 Yuxi Huan , Fan Wu , Michail Basios , Leslie Kanthan , Lingbo Li , Baowen Xu

The choices of hyperparameters have critical effects on the performance of machine learning models. In this paper, we present a general framework that is able to construct an adaptive optimizer, which automatically adjust the appropriate…

Machine Learning · Computer Science 2022-01-31 Huayuan Sun

The field of algorithmic optimization has significantly advanced with the development of methods for the automatic configuration of algorithmic parameters. This article delves into the Algorithm Configuration Problem, focused on optimizing…

Artificial Intelligence · Computer Science 2024-03-05 Gabriele Iommazzo , Claudia D'Ambrosio , Antonio Frangioni , Leo Liberti

Over the last decade, research on automated parameter tuning, often referred to as automatic algorithm configuration (AAC), has made significant progress. Although the usefulness of such tools has been widely recognized in real world…

Machine Learning · Computer Science 2019-11-20 Shengcai Liu , Ke Tang , Yunwen Lei , Xin Yao

Optimizing a neural network's performance is a tedious and time taking process, this iterative process does not have any defined solution which can work for all the problems. Optimization can be roughly categorized into - Architecture and…

Machine Learning · Computer Science 2019-12-16 Siddhartha Dhar Choudhury , Shashank Pandey , Kunal Mehrotra

The identification of performance-optimizing parameter settings is an important part of the development and application of algorithms. We describe an automatic framework for this algorithm configuration problem. More formally, we provide…

Artificial Intelligence · Computer Science 2014-01-16 Frank Hutter , Thomas Stuetzle , Kevin Leyton-Brown , Holger H. Hoos

Recently it has been proved that a simple algorithm configurator called ParamRLS can efficiently identify the optimal neighbourhood size to be used by stochastic local search to optimise two standard benchmark problem classes. In this paper…

Neural and Evolutionary Computing · Computer Science 2020-04-10 George T. Hall , Pietro Simone Oliveto , Dirk Sudholt

It is known that the $(1+(\lambda,\lambda))$~Genetic Algorithm (GA) with self-adjusting parameter choices achieves a linear expected optimization time on OneMax if its hyper-parameters are suitably chosen. However, it is not very well…

Neural and Evolutionary Computing · Computer Science 2019-04-10 Nguyen Dang , Carola Doerr

We consider the problem of configuring general-purpose solvers to run efficiently on problem instances drawn from an unknown distribution. The goal of the configurator is to find a configuration that runs fast on average on most instances,…

Machine Learning · Computer Science 2018-07-03 Gellért Weisz , András György , Csaba Szepesvári

Resource constrained job scheduling is a hard combinatorial optimisation problem that originates in the mining industry. Off-the-shelf solvers cannot solve this problem satisfactorily in reasonable timeframes, while other solution methods…

Neural and Evolutionary Computing · Computer Science 2024-07-23 Su Nguyen , Dhananjay Thiruvady , Yuan Sun , Mengjie Zhang

This paper discusses various types of constraints, difficulties and solutions to overcome the challenges regarding university course allocation problem. A hybrid evolutionary algorithm has been defined combining Local Repair Algorithm and…

Neural and Evolutionary Computing · Computer Science 2023-07-25 Dibyo Fabian Dofadar , Riyo Hayat Khan , Shafqat Hasan , Towshik Anam Taj , Arif Shakil , Mahbub Majumdar

The performance of optimizers, particularly in deep learning, depends considerably on their chosen hyperparameter configuration. The efficacy of optimizers is often studied under near-optimal problem-specific hyperparameters, and finding…

Machine Learning · Computer Science 2020-08-18 Prabhu Teja Sivaprasad , Florian Mai , Thijs Vogels , Martin Jaggi , François Fleuret