English
Related papers

Related papers: A Study on the Global Convergence Time Complexity …

200 papers

Estimation of Distribution Algorithms (EDAs) and Innovation Method are recognized methods for solving global optimization problems and for the estimation of parameters in diffusion processes, respectively. Well known is also that the…

Numerical Analysis · Mathematics 2018-04-10 Zochil González Arenas , Juan Carlos Jimenez , Li-Vang Lozada-Chang , Roberto Santana

In this paper is proposed a new heuristic approach belonging to the field of evolutionary Estimation of Distribution Algorithms (EDAs). EDAs builds a probability model and a set of solutions is sampled from the model which characterizes the…

Estimation-of-distribution algorithms (EDAs) are general metaheuristics used in optimization that represent a more recent alternative to classical approaches like evolutionary algorithms. In a nutshell, EDAs typically do not directly evolve…

Neural and Evolutionary Computing · Computer Science 2018-06-15 Martin S. Krejca , Carsten Witt

This paper shows how the Bayesian network paradigm can be used in order to solve combinatorial optimization problems. To do it some methods of structure learning from data and simulation of Bayesian networks are inserted inside Estimation…

Artificial Intelligence · Computer Science 2013-01-18 Pedro Larrañaga , Ramon Etxeberria , Jose A. Lozano , Jose M. Pena

We show that a large class of Estimation of Distribution Algorithms, including, but not limited to, Covariance Matrix Adaption, can be written as a Monte Carlo Expectation-Maximization algorithm, and as exact EM in the limit of infinite…

Machine Learning · Computer Science 2022-06-14 David H. Brookes , Akosua Busia , Clara Fannjiang , Kevin Murphy , Jennifer Listgarten

Finding a large set of optima in a multimodal optimization landscape is a challenging task. Classical population-based evolutionary algorithms typically converge only to a single solution. While this can be counteracted by applying niching…

Neural and Evolutionary Computing · Computer Science 2023-10-10 Benjamin Doerr , Martin S. Krejca

We propose a general formulation of a univariate estimation-of-distribution algorithm (EDA). It naturally incorporates the three classic univariate EDAs \emph{compact genetic algorithm}, \emph{univariate marginal distribution algorithm} and…

Neural and Evolutionary Computing · Computer Science 2022-10-07 Benjamin Doerr , Marc Dufay

Estimation of Distribution Algorithms (EDAs) are stochastic heuristics that search for optimal solutions by learning and sampling from probabilistic models. Despite their popularity in real-world applications, there is little rigorous…

Neural and Evolutionary Computing · Computer Science 2018-07-27 Duc-Cuong Dang , Per Kristian Lehre , Phan Trung Hai Nguyen

Estimation of distribution algorithms (EDA) are stochastic optimization algorithms. EDA establishes a probability model to describe the distribution of solution from the perspective of population macroscopically by statistical learning…

Neural and Evolutionary Computing · Computer Science 2020-03-19 Zhenyu Liang , Yunfan Li , Zhongwei Wan

The population-based optimization algorithms have provided promising results in feature selection problems. However, the main challenges are high time complexity. Moreover, the interaction between features is another big challenge in FS…

Neural and Evolutionary Computing · Computer Science 2021-10-26 Motahare Namakin , Modjtaba Rouhani , Mostafa Sabzekar

Estimation-of-distribution algorithms (EDAs) are randomized search heuristics that create a probabilistic model of the solution space, which is updated iteratively, based on the quality of the solutions sampled according to the model. As…

Neural and Evolutionary Computing · Computer Science 2020-12-23 Benjamin Doerr , Martin Krejca

In this paper, we obtain bounds on the probability of convergence to the optimal solution for the compact Genetic Algorithm (cGA) and the Population Based Incremental Learning (PBIL). We also give a sufficient condition for convergence of…

Neural and Evolutionary Computing · Computer Science 2010-09-14 Reza Rastegar

Understanding how the time-complexity of evolutionary algorithms (EAs) depend on their parameter settings and characteristics of fitness landscapes is a fundamental problem in evolutionary computation. Most rigorous results were derived…

Neural and Evolutionary Computing · Computer Science 2016-10-28 Dogan Corus , Duc-Cuong Dang , Anton V. Eremeev , Per Kristian Lehre

The Expectation-Maximization (EM) algorithm is an iterative method to maximize the log-likelihood function for parameter estimation. Previous works on the convergence analysis of the EM algorithm have established results on the asymptotic…

Statistics Theory · Mathematics 2017-05-31 Chong Wu , Can Yang , Hongyu Zhao , Ji Zhu

A new technique of global optimization and its applications in particular to neural networks are presented. The algorithm is also compared to other global optimization algorithms such as Gradient descent (GD), Monte Carlo (MC), Genetic…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-18 Homayoun Valafar , Okan K. Ersoy , Faramarz Valafar

Expectation Maximization (EM) is among the most popular algorithms for estimating parameters of statistical models. However, EM, which is an iterative algorithm based on the maximum likelihood principle, is generally only guaranteed to find…

Statistics Theory · Mathematics 2016-08-30 Ji Xu , Daniel Hsu , Arian Maleki

Contemporary global optimization algorithms are based on local measures of utility, rather than a probability measure over location and value of the optimum. They thus attempt to collect low function values, not to learn about the optimum.…

Machine Learning · Statistics 2011-12-07 Philipp Hennig , Christian J. Schuler

Selecting the appropriate requirements to develop in the next release of an open market software product under evolution, is a compulsory step of each software development project. This selection should be done by maximizing stakeholders'…

Software Engineering · Computer Science 2023-02-07 Jose del Sagrado , Jose Antonio Sierra Ibanez , Isabel M. del Aguila

As a typical model-based evolutionary algorithm (EA), estimation of distribution algorithm (EDA) possesses unique characteristics and has been widely applied to global optimization. However, the common-used Gaussian EDA (GEDA) usually…

Neural and Evolutionary Computing · Computer Science 2018-08-01 Yongsheng Liang , Zhigang Ren , Xianghua Yao , Zuren Feng , An Chen

Schedules can be built in a similar way to a human scheduler by using a set of rules that involve domain knowledge. This paper presents an Estimation of Distribution Algorithm (eda) for the nurse scheduling problem, which involves choosing…

Neural and Evolutionary Computing · Computer Science 2010-07-05 Uwe Aickelin , Jingpeng Li
‹ Prev 1 2 3 10 Next ›