English
Related papers

Related papers: A global optimization paradigm based on change of …

200 papers

In this paper, a new sequential surrogate-based optimization (SSBO) algorithm is developed, which aims to improve the global search ability and local search efficiency for the global optimization of expensive black-box models. The proposed…

Machine Learning · Statistics 2018-11-30 Chunlin Gong , Xu Li , Hua Su , Jinlei Guo , Liangxian Gu

Consensus-based optimization (CBO) is a versatile multi-particle optimization method for performing nonconvex and nonsmooth global optimizations in high dimensions. Proofs of global convergence in probability have been achieved for a broad…

Optimization and Control · Mathematics 2026-01-13 Jonas Beddrich , Enis Chenchene , Massimo Fornasier , Hui Huang , Barbara Wohlmuth

We apply two evolutionary search algorithms: Particle Swarm Optimization (PSO) and Genetic Algorithms (GAs) to the design of Cellular Automata (CA) that can perform computational tasks requiring global coordination. In particular, we…

Artificial Intelligence · Computer Science 2019-09-10 Anthony D. Rhodes

In this paper we propose a variant of a consensus-based global optimization (CBO) method that uses personal best information in order to compute the global minimum of a non-convex, locally Lipschitz continuous function. The proposed…

Optimization and Control · Mathematics 2020-08-25 Claudia Totzeck , Marie-Therese Wolfram

Multi- or many-objective evolutionary algorithm- s(MOEAs), especially the decomposition-based MOEAs have been widely concerned in recent years. The decomposition-based MOEAs emphasize convergence and diversity in a simple model and have…

Neural and Evolutionary Computing · Computer Science 2018-03-19 Yingyu Zhang , Bing Zeng , Yuanzhen Li , Junqing Li

Many real-world optimization problems consist of multiple tightly coupled subproblems whose solutions must be coordinated to achieve high overall performance. However, existing large language model driven automated heuristic design…

Neural and Evolutionary Computing · Computer Science 2026-05-08 Thomas Bömer , Bastian Amberg , Max Disselnmeyer , Anne Meyer

Evolutionary algorithms have been frequently applied to constrained continuous optimisation problems. We carry out feature based comparisons of different types of evolutionary algorithms such as evolution strategies, differential evolution…

Artificial Intelligence · Computer Science 2015-09-24 Shayan Poursoltan , Frank Neumann

In many real world problems, optimization decisions have to be made with limited information. The decision maker may have no a priori or posteriori data about the often nonconvex objective function except from on a limited number of points…

Optimization and Control · Mathematics 2011-11-10 Tansu Alpcan

Distributed optimization methods for large-scale machine learning suffer from a communication bottleneck. It is difficult to reduce this bottleneck while still efficiently and accurately aggregating partial work from different machines. In…

Machine Learning · Computer Science 2015-07-06 Chenxin Ma , Virginia Smith , Martin Jaggi , Michael I. Jordan , Peter Richtárik , Martin Takáč

Due to the increasing demand for high performance and cost reduction within the framework of complex system design, numerical optimization of computationally costly problems is an increasingly popular topic in most engineering fields. In…

Optimization and Control · Mathematics 2018-06-12 Julien Pelamatti , Loïc Brevault , Mathieu Balesdent , El-Ghazali Talbi , Yannick Guerin

Molecular optimization, which aims to discover improved molecules from a vast chemical search space, is a critical step in chemical development. Various artificial intelligence technologies have demonstrated high effectiveness and…

Chemical Physics · Physics 2024-11-26 Xin Xia , Yajie Zhang , Xiangxiang Zeng , Xingyi Zhang , Chunhou Zheng , Yansen Su

Multi-modal optimization involves identifying multiple global and local optima of a function, offering valuable insights into diverse optimal solutions within the search space. Evolutionary algorithms (EAs) excel at finding multiple…

Neural and Evolutionary Computing · Computer Science 2025-09-09 Dikshit Chauhan , Shivani , Donghwi Jung , Anupam Yadav

Differential evolution(DE) is a conventional algorithm with fast convergence speed. However, DE may be trapped in local optimal solution easily. Many researchers devote themselves to improving DE. In our previously work, whale swarm…

Neural and Evolutionary Computing · Computer Science 2019-09-05 Haozhen Dong , Liang Gao , Xinyu Li , Haoran Zhong , Bing Zeng

Many-objective evolutionary algorithms (MOEAs), especially the decomposition-based MOEAs, have attracted wide attention in recent years. Recent studies show that a well designed combination of the decomposition method and the domination…

Neural and Evolutionary Computing · Computer Science 2019-09-05 Yingyu Zhang , Yuanzhen Li , Quan-Ke Panb , P. N. Suganthan

In this paper, we study consensus-based optimization (CBO), which is a multi-agent metaheuristic derivative-free optimization method that can globally minimize nonconvex nonsmooth functions and is amenable to theoretical analysis. Based on…

Numerical Analysis · Mathematics 2024-09-10 Massimo Fornasier , Timo Klock , Konstantin Riedl

Although real-coded differential evolution (DE) algorithms can perform well on continuous optimization problems (CoOPs), it is still a challenging task to design an efficient binary-coded DE algorithm. Inspired by the learning mechanism of…

Neural and Evolutionary Computing · Computer Science 2014-05-13 Yu Chen , Weicheng Xie , Xiufen Zou

Large-scale problems are nonlinear problems that need metaheuristics, or global optimization algorithms. This paper reviews nature-inspired metaheuristics, then it introduces a framework named Competitive Ant Colony Optimization inspired by…

Neural and Evolutionary Computing · Computer Science 2013-12-17 M. A. El-Dosuky

Zeroth-order or derivative-free optimization (MeZO) is an attractive strategy for finetuning large language models (LLMs) because it eliminates the memory overhead of backpropagation. However, it converges slowly due to the inherent curse…

Machine Learning · Computer Science 2026-04-21 Lejs Deen Behric , Liang Zhang , Bingcong Li , Kiran Koshy Thekumparampil

Multimodal optimization requires finding many optima rather than merely keeping a diverse population. Yet most niching-based evolutionary algorithms rely on distances or density estimators without explicitly recovering the underlying…

Neural and Evolutionary Computing · Computer Science 2026-05-19 Meng Xiang , Pei Yan

Despite recent progress in constructing generalizable parallel algorithm portfolios (PAPs), no general-purpose approach is yet available for multi-objective binary optimization problems (MOBOPs). To fill this gap, this paper proposes…

Neural and Evolutionary Computing · Computer Science 2026-05-18 Zhiyuan Wang , Shengcai Liu , Shaofeng Zhang , Ke Tang