English
Related papers

Related papers: Comparing Optimization Algorithms Through the Lens…

200 papers

This paper proposes a novel population-based meta-heuristic optimization algorithm, called Perfectionism Search Algorithm (PSA), which is based on the psychological aspects of perfectionism. The PSA algorithm takes inspiration from one of…

Optimization and Control · Mathematics 2023-10-16 A. Ghodousian , M. Mollakazemiha , N. Karimian

The verification and validation of automated and autonomous driving systems impose a major challenge, especially the identification of suitable test scenarios. This work presents a methodology that adopts metaheuristic search to optimize…

Software Engineering · Computer Science 2019-01-18 Florian Hauer , Bernd Holzmüller

Particle swarm optimisation is a metaheuristic algorithm which finds reasonable solutions in a wide range of applied problems if suitable parameters are used. We study the properties of the algorithm in the framework of random dynamical…

Neural and Evolutionary Computing · Computer Science 2015-11-20 J. Michael Herrmann , Adam Erskine , Thomas Joyce

We show how combinatorial optimisation algorithms can be applied to the problem of identifying c-optimal experimental designs when there may be correlation between and within experimental units and evaluate the performance of relevant…

Computation · Statistics 2023-02-24 Samuel I Watson , Yi Pan

Combining test statistics from independent trials or experiments is a popular method of meta-analysis. However, there is very limited theoretical understanding of the power of the combined test, especially in high-dimensional models…

Statistics Theory · Mathematics 2023-10-31 Botond Szabó , Aad van der Vaart , Lasse Vuursteen , Harry van Zanten

Many computer vision algorithms depend on a variety of parameter choices and settings that are typically hand-tuned in the course of evaluating the algorithm. While such parameter tuning is often presented as being incidental to the…

Computer Vision and Pattern Recognition · Computer Science 2012-09-25 J. Bergstra , D. Yamins , D. D. Cox

Besides training, mathematical optimization is also used in deep learning to model and solve formulations over trained neural networks for purposes such as verification, compression, and optimization with learned constraints. However,…

Optimization and Control · Mathematics 2024-01-30 Jiatai Tong , Junyang Cai , Thiago Serra

Multi-label classification (MLC) is an ML task of predictive modeling in which a data instance can simultaneously belong to multiple classes. MLC is increasingly gaining interest in different application domains such as text mining,…

Machine Learning · Computer Science 2022-11-22 Ana Kostovska , Carola Doerr , Sašo Džeroski , Dragi Kocev , Panče Panov , Tome Eftimov

Firefly algorithms belong to modern meta-heuristic algorithms inspired by nature that can be successfully applied to continuous optimization problems. In this paper, we have been applied the firefly algorithm, hybridized with local search…

Optimization and Control · Mathematics 2012-05-14 Iztok Fister , Xin-She Yang , Iztok Fister , Janez Brest

There is no free lunch, no single learning algorithm that will outperform other algorithms on all data. In practice different approaches are tried and the best algorithm selected. An alternative solution is to build new algorithms on demand…

Machine Learning · Computer Science 2018-06-19 Włodzisław Duch , Karol Grudzińsk

In the power and energy systems area, a progressive increase of literature contributions containing applications of metaheuristic algorithms is occurring. In many cases, these applications are merely aimed at proposing the testing of an…

Artificial Intelligence · Computer Science 2020-08-19 Gianfranco Chicco , Andrea Mazza

The best algorithm for a computational problem generally depends on the "relevant inputs," a concept that depends on the application domain and often defies formal articulation. While there is a large literature on empirical approaches to…

Machine Learning · Computer Science 2016-09-06 Rishi Gupta , Tim Roughgarden

The research area of real-time heuristics search has produced quite many algorithms. In the landscape of real-time heuristics search research, it is not rare to find that an algorithm X that appears to perform better than algorithm Y on a…

Artificial Intelligence · Computer Science 2018-05-23 Md Solimul Chowdhury , Victor Silva

Probabilistic mixture models have been widely used for different machine learning and pattern recognition tasks such as clustering, dimensionality reduction, and classification. In this paper, we focus on trying to solve the most common…

Machine Learning · Computer Science 2020-04-08 Gustavo A Valencia-Zapata , Daniel Mejia , Gerhard Klimeck , Michael Zentner , Okan Ersoy

Determining the number of algorithm runs is a critical aspect of experimental design, as it directly influences the experiment's duration and the reliability of its outcomes. This paper introduces an empirical approach to estimating the…

Neural and Evolutionary Computing · Computer Science 2025-07-03 Tome Eftimov , Peter Korošec

Stochastic optimisation algorithms are the de facto standard for machine learning with large amounts of data. Handling only a subset of available data in each optimisation step dramatically reduces the per-iteration computational costs,…

Numerical Analysis · Mathematics 2024-12-19 Matthias J. Ehrhardt , Zeljko Kereta , Jingwei Liang , Junqi Tang

Hyperparameters are configuration variables controlling the behavior of machine learning algorithms. They are ubiquitous in machine learning and artificial intelligence and the choice of their values determines the effectiveness of systems…

The selection of the most appropriate algorithm to solve a given problem instance, known as algorithm selection, is driven by the potential to capitalize on the complementary performance of different algorithms across sets of problem…

Machine Learning · Computer Science 2024-06-12 Gjorgjina Cenikj , Ana Nikolikj , Gašper Petelin , Niki van Stein , Carola Doerr , Tome Eftimov

The Algorithm Selection Problem is concerned with selecting the best algorithm to solve a given problem on a case-by-case basis. It has become especially relevant in the last decade, as researchers are increasingly investigating how to…

Artificial Intelligence · Computer Science 2012-10-31 Lars Kotthoff

Consider a collection of competing machine learning algorithms. Given their performance on a benchmark of datasets, we would like to identify the best performing algorithm. Specifically, which algorithm is most likely to rank highest on a…

Machine Learning · Computer Science 2025-08-08 Amichai Painsky