English
Related papers

Related papers: Error Analysis of Elitist Randomized Search Heuris…

200 papers

We study the problem of approximate ranking from observations of pairwise interactions. The goal is to estimate the underlying ranks of $n$ objects from data through interactions of comparison or collaboration. Under a general framework of…

Statistics Theory · Mathematics 2019-06-26 Chao Gao

Estimation-of-distribution algorithms (EDAs) are general metaheuristics used in optimization that represent a more recent alternative to classical approaches like evolutionary algorithms. In a nutshell, EDAs typically do not directly evolve…

Neural and Evolutionary Computing · Computer Science 2018-06-15 Martin S. Krejca , Carsten Witt

This paper describes practical randomized algorithms for low-rank matrix approximation that accommodate any budget for the number of views of the matrix. The presented algorithms, which are aimed at being as pass efficient as needed, expand…

Numerical Analysis · Mathematics 2018-05-25 Elvar K. Bjarkason

Runtime analysis aims at contributing to our understanding of evolutionary algorithms through mathematical analyses of their runtimes. In the context of discrete optimization problems, runtime analysis classically studies the time needed to…

Neural and Evolutionary Computing · Computer Science 2022-06-17 Maxim Buzdalov , Benjamin Doerr , Carola Doerr , Dmitry Vinokurov

Evolutionary neural architecture search (ENAS) is a key part of evolutionary machine learning, which commonly utilizes evolutionary algorithms (EAs) to automatically design high-performing deep neural architectures. During past years,…

Neural and Evolutionary Computing · Computer Science 2025-06-09 Zeqiong Lv , Chao Qian , Yun Liu , Jiahao Fan , Yanan Sun

In this era of large-scale data, distributed systems built on top of clusters of commodity hardware provide cheap and reliable storage and scalable processing of massive data. Here, we review recent work on developing and implementing…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-07-28 Jiyan Yang , Xiangrui Meng , Michael W. Mahoney

Multi-mode resource-constrained project scheduling problems (MRCPSPs) are classified as NP-hard problems, in which a task has different execution modes characterized by different resource requirements. Estimation of distribution algorithm…

Other Computer Science · Computer Science 2014-02-25 Omar S. Soliman , Elshimaa A. R. Elgendi

The expectation maximization (EM) algorithm is a widespread method for empirical Bayesian inference, but its expectation step (E-step) is often intractable. Employing a stochastic approximation scheme with Markov chain Monte Carlo (MCMC)…

Computation · Statistics 2024-02-29 Samuel Gruffaz , Kyurae Kim , Alain Oliviero Durmus , Jacob R. Gardner

In graph-based active learning, algorithms based on expected error minimization (EEM) have been popular and yield good empirical performance. The exact computation of EEM optimally balances exploration and exploitation. In practice,…

Machine Learning · Statistics 2016-09-06 Kwang-Sung Jun , Robert Nowak

Parameterized runtime analysis seeks to understand the influence of problem structure on algorithmic runtime. In this paper, we contribute to the theoretical understanding of evolutionary algorithms and carry out a parameterized analysis of…

Neural and Evolutionary Computing · Computer Science 2012-10-10 Andrew M. Sutton , Frank Neumann

This article deals with stochastic processes endowed with the Markov (memoryless) property and evolving over general (uncountable) state spaces. The models further depend on a non-deterministic quantity in the form of a control input, which…

Systems and Control · Computer Science 2015-09-11 Sofie Haesaert , Robert Babuska , Alessandro Abate

In recent years, there has been growing interest in utilizing modern machine learning techniques to learn heuristic functions for forward search algorithms. Despite this, there has been little theoretical understanding of what they should…

Artificial Intelligence · Computer Science 2025-01-07 Carlos Núñez-Molina , Masataro Asai , Pablo Mesejo , Juan Fernández-Olivares

In certain real-world optimization scenarios, practitioners are not interested in solving multiple problems but rather in finding the best solution to a single, specific problem. When the computational budget is large relative to the cost…

Machine Learning · Computer Science 2026-02-10 Judith Echevarrieta , Etor Arza , Aritz Pérez , Josu Ceberio

Understanding how the time-complexity of evolutionary algorithms (EAs) depend on their parameter settings and characteristics of fitness landscapes is a fundamental problem in evolutionary computation. Most rigorous results were derived…

Neural and Evolutionary Computing · Computer Science 2016-10-28 Dogan Corus , Duc-Cuong Dang , Anton V. Eremeev , Per Kristian Lehre

Empirical risk minimization is a standard principle for choosing algorithms in learning theory. In this paper we study the properties of empirical risk minimization for time series. The analysis is carried out in a general framework that…

Machine Learning · Statistics 2021-08-12 Christian Brownlees , Jordi Llorens-Terrazas

Many evolutionary algorithms (EAs) take advantage of parallel evaluation of candidates. However, if evaluation times vary significantly, many worker nodes (i.e.,\ compute clients) are idle much of the time, waiting for the next generation…

Neural and Evolutionary Computing · Computer Science 2024-01-02 Jason Liang , Hormoz Shahrzad , Risto Miikkulainen

Path planning is typically considered in Artificial Intelligence as a graph searching problem and R* is state-of-the-art algorithm tailored to solve it. The algorithm decomposes given path finding task into the series of subtasks each of…

Artificial Intelligence · Computer Science 2015-11-04 Konstantin Yakovlev , Egor Baskin , Ivan Hramoin

Finding the best configuration of algorithms' hyperparameters for a given optimization problem is an important task in evolutionary computation. We compare in this work the results of four different hyperparameter tuning approaches for a…

Neural and Evolutionary Computing · Computer Science 2022-03-18 Furong Ye , Carola Doerr , Hao Wang , Thomas Bäck

Determining the number of algorithm runs is a critical aspect of experimental design, as it directly influences the experiment's duration and the reliability of its outcomes. This paper introduces an empirical approach to estimating the…

Neural and Evolutionary Computing · Computer Science 2025-07-03 Tome Eftimov , Peter Korošec

A key trait of stochastic optimizers is that multiple runs of the same optimizer in attempting to solve the same problem can produce different results. As a result, their performance is evaluated over several repeats, or runs, on the…

Machine Learning · Computer Science 2026-05-18 Moslem Noori , Elisabetta Valiante , Thomas Van Vaerenbergh , Masoud Mohseni , Ignacio Rozada