English
Related papers

Related papers: New directional bat algorithm for continuous optim…

200 papers

Cellular Automata (CAs) are computational models that can capture the essential features of systems in which global behavior emerges from the collective effect of simple components, which interact locally. During the last decades, CAs have…

Normalization techniques such as Batch Normalization have been applied successfully for training deep neural networks. Yet, despite its apparent empirical benefits, the reasons behind the success of Batch Normalization are mostly…

Machine Learning · Statistics 2018-10-09 Jonas Kohler , Hadi Daneshmand , Aurelien Lucchi , Ming Zhou , Klaus Neymeyr , Thomas Hofmann

Realization of universal computing units for nanorobots is highly promising in creating new and wide arrays of applications, particularly in the realm of distributed computation. However, such realization is also a challenging problem due…

Systems and Control · Electrical Eng. & Systems 2021-11-24 Alireza Rowhanimanesh , Mohammad-R Akbarzadeh-T

Bayesian Optimisation (BO) methods seek to find global optima of objective functions which are only available as a black-box or are expensive to evaluate. Such methods construct a surrogate model for the objective function, quantifying the…

Machine Learning · Statistics 2023-01-10 Enrico Crovini , Simon L. Cotter , Konstantinos Zygalakis , Andrew B. Duncan

A genetic algorithm (GA) is a search method that optimises a population of solutions by simulating natural evolution. Good solutions reproduce together to create better candidates. The standard GA assumes that any two solutions can mate.…

Neural and Evolutionary Computing · Computer Science 2021-04-12 Aymeric Vie

We study the batched best arm identification (BBAI) problem, where the learner's goal is to identify the best arm while switching the policy as less as possible. In particular, we aim to find the best arm with probability $1-\delta$ for…

Machine Learning · Computer Science 2025-03-05 Tianyuan Jin , Yu Yang , Jing Tang , Xiaokui Xiao , Pan Xu

The Cuckoo Search Algorithm (CSA), while effective in solving complex optimization problems, faces limitations in random population initialization and reliance on fixed parameters. Random initialization of the population often results in…

Neural and Evolutionary Computing · Computer Science 2025-02-20 Marcus Andre Villanueva , Charles Matthew Ching , Khatalyn Mata

The probabilistic bisection algorithm (PBA) solves a class of stochastic root-finding problems in one dimension by successively updating a prior belief on the location of the root based on noisy responses to queries at chosen points. The…

Probability · Mathematics 2016-12-14 Peter I. Frazier , Shane G. Henderson , Rolf Waeber

In engineering optimization problems, multiple objectives with a large number of variables under highly nonlinear constraints are usually required to be simultaneously optimized. Significant computing effort are required to find the Pareto…

Neural and Evolutionary Computing · Computer Science 2020-08-06 Junfei Zhang , Yimiao Huang , Guowei Ma , Brett Nener

Operational maturity of biological control systems have fuelled the inspiration for a large number of mathematical and logical models for control, automation and optimisation. The human brain represents the most sophisticated control…

Neural and Evolutionary Computing · Computer Science 2017-09-13 Shubham Dokania , Ayush Chopra , Feroz Ahmad , Anil Singh Parihar

To improve the convergence speed and optimization accuracy of the Dung Beetle Optimizer (DBO), this paper proposes an improved algorithm based on circle mapping and longitudinal-horizontal crossover strategy (CICRDBO). First, the Circle…

Optimization and Control · Mathematics 2024-11-28 Lianghao Tan , Xiaoyi Liu , Dong Liu , Shubing Liu , Weixi Wu , Huangqi Jiang

Deployments of Bayesian Optimization (BO) for functions with stochastic evaluations, such as parameter tuning via cross validation and simulation optimization, typically optimize an average of a fixed set of noisy realizations of the…

Machine Learning · Computer Science 2020-07-03 Henry B. Moss , David S. Leslie , Paul Rayson

This article concerns the review of a special class of swarm intelligence based algorithms for solving optimization problems and these algorithms can be referred to as social algorithms. Social algorithms use multiple agents and the social…

Neural and Evolutionary Computing · Computer Science 2018-05-16 Xin-She Yang

It is commonly believed that Bayesian optimization (BO) algorithms are highly efficient for optimizing numerically costly functions. However, BO is not often compared to widely different alternatives, and is mostly tested on narrow sets of…

Optimization and Control · Mathematics 2021-10-01 Rodolphe Le Riche , Victor Picheny

Nature-inspired metaheuristic algorithms are important components of artificial intelligence, and are increasingly used across disciplines to tackle various types of challenging optimization problems. This paper demonstrates the usefulness…

Neural and Evolutionary Computing · Computer Science 2024-08-20 Elvis Han Cui , Zizhao Zhang , Culsome Junwen Chen , Weng Kee Wong

This paper investigates a hitherto unaddressed aspect of best arm identification (BAI) in stochastic multi-armed bandits in the fixed-confidence setting. Two key metrics for assessing bandit algorithms are computational efficiency and…

Machine Learning · Statistics 2023-06-26 Arpan Mukherjee , Ali Tajer

This paper considers convex optimization problems where nodes of a network have access to summands of a global objective. Each of these local objectives is further assumed to be an average of a finite set of functions. The motivation for…

Optimization and Control · Mathematics 2015-06-16 Aryan Mokhtari , Alejandro Ribeiro

Bayesian optimization (BO) is a typical approach to solve expensive optimization problems. In each iteration of BO, a Gaussian process(GP) model is trained using the previously evaluated solutions; then next candidate solutions for…

Neural and Evolutionary Computing · Computer Science 2022-06-23 Jixiang Chen , Fu Luo , Zhenkun Wang

A new technique of global optimization and its applications in particular to neural networks are presented. The algorithm is also compared to other global optimization algorithms such as Gradient descent (GD), Monte Carlo (MC), Genetic…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-18 Homayoun Valafar , Okan K. Ersoy , Faramarz Valafar

Modern artificial intelligence relies on networks of agents that collect data, process information, and exchange it with neighbors to collaboratively solve optimization and learning problems. This article introduces a novel distributed…

Optimization and Control · Mathematics 2026-01-15 Diego Deplano , Nicola Bastianello , Mauro Franceschelli , Karl H. Johansson