English
Related papers

Related papers: A parallel implementation of the covariance matrix…

200 papers

We describe the decomposition of QSO absorption line ensembles applying an evolutionary forward modelling technique. The modelling is optimized using an evolution strategy (ES) based on a novel concept of completely derandomized…

Astrophysics · Physics 2009-11-10 R. Quast , R. Baade , D. Reimers

Constrained multi-objective optimization problems (CMOPs) are ubiquitous in real-world engineering optimization scenarios. A key issue in constrained multi-objective optimization is to strike a balance among convergence, diversity and…

Neural and Evolutionary Computing · Computer Science 2021-03-12 Xinyu Shan , Ke Li

Constrained multi-objective optimization problems (CMOPs) pervade real-world applications in science, engineering, and design. Constraint violation has been a building block in designing evolutionary multi-objective optimization algorithms…

Neural and Evolutionary Computing · Computer Science 2024-01-03 Shuang Li , Ke Li , Wei Li , Ming Yang

Finding optimal solutions to combinatorial optimization problems is pivotal in both scientific and technological domains, within academic research and industrial applications. A considerable amount of effort has been invested in the…

Statistical Mechanics · Physics 2024-12-13 Zi-Song Shen , Feng Pan , Yao Wang , Yi-Ding Men , Wen-Biao Xu , Man-Hong Yung , Pan Zhang

We introduce PACE, a backpropagation-free continual test-time adaptation system that directly optimizes the affine parameters of normalization layers. Existing derivative-free approaches struggle to balance runtime efficiency with learning…

Machine Learning · Computer Science 2026-03-31 Damian Sójka , Sebastian Cygert , Marc Masana

The use of derivative-based solvers to compute solutions to optimal control problems with non-differentiable cost or dynamics often requires reformulations or relaxations that complicate the implementation or increase computational…

Optimization and Control · Mathematics 2021-10-12 Ian McInerney , Lucian Nita , Yuanbo Nie , Alberto Oliveri , Eric C. Kerrigan

The mutation process in evolution strategies has been interlinked with the normal distribution since its inception. Many lines of reasoning have been given for this strong dependency, ranging from maximum entropy arguments to the need for…

Neural and Evolutionary Computing · Computer Science 2025-04-11 Jacob de Nobel , Diederick Vermetten , Hao Wang , Anna V. Kononova , Günter Rudolph , Thomas Bäck

A novel class of derivative-free optimization algorithms is developed. The main idea is to utilize certain non-commutative maps in order to approximate the gradient of the objective function. Convergence properties of the novel algorithms…

Optimization and Control · Mathematics 2018-05-21 Jan Feiling , Amelie Zeller , Christian Ebenbauer

Evolution Strategies (ESs) have recently become popular for training deep neural networks, in particular on reinforcement learning tasks, a special form of controller design. Compared to classic problems in continuous direct search, deep…

Neural and Evolutionary Computing · Computer Science 2018-07-03 Nils Müller , Tobias Glasmachers

In supply chain management, decision-making often involves balancing multiple conflicting objectives, such as cost reduction, service level improvement, and environmental sustainability. Traditional multi-objective optimization methods,…

Artificial Intelligence · Computer Science 2025-09-09 Niki Kotecha , Ehecatl Antonio del Rio Chanona

The time parallel solution of optimality systems arising in PDE constraint optimization could be achieved by simply applying any time parallel algorithm, such as Parareal, to solve the forward and backward evolution problems arising in the…

Analysis of PDEs · Mathematics 2020-07-27 Martin Gander , Félix Kwok , Julien Salomon

The CSA-ES is an Evolution Strategy with Cumulative Step size Adaptation, where the step size is adapted measuring the length of a so-called cumulative path. The cumulative path is a combination of the previous steps realized by the…

Machine Learning · Computer Science 2013-02-19 Alexandre Chotard , Anne Auger , Nikolaus Hansen

This paper presents the main characteristics of the evolutionary optimization code named EOS, Evolutionary Optimization at Sapienza, and its successful application to challenging, real-world space trajectory optimization problems. EOS is a…

Neural and Evolutionary Computing · Computer Science 2020-07-14 Lorenzo Federici , Boris Benedikter , Alessandro Zavoli

The domain of an optimization problem is seen as one of its most important characteristics. In particular, the distinction between continuous and discrete optimization is rather impactful. Based on this, the optimizing algorithm, analyzing…

Neural and Evolutionary Computing · Computer Science 2023-04-27 André Thomaser , Jacob de Nobel , Diederick Vermetten , Furong Ye , Thomas Bäck , Anna V. Kononova

In this work, we consider alternative discretizations for PDEs which use expansions involving integral operators to approximate spatial derivatives. These constructions use explicit information within the integral terms, but treat boundary…

Computational Physics · Physics 2024-11-12 Andrew J. Christlieb , Pierson T. Guthrey , William A. Sands , Mathialakan Thavappiragasm

We consider computationally expensive blackbox optimization problems and present a method that employs surrogate models and concurrent computing at the search step of the mesh adaptive direct search (MADS) algorithm. Specifically, we solve…

Optimization and Control · Mathematics 2021-07-28 Bastien Talgorn , Stéphane Alarie , Michael Kokkolaras

Large-scale optimization problems that involve thousands of decision variables have extensively arisen from various industrial areas. As a powerful optimization tool for many real-world applications, evolutionary algorithms (EAs) fail to…

Neural and Evolutionary Computing · Computer Science 2023-09-26 Peng Yang , Ke Tang , Xin Yao

Many state-of-the-art automated machine learning (AutoML) systems use greedy ensemble selection (GES) by Caruana et al. (2004) to ensemble models found during model selection post hoc. Thereby, boosting predictive performance and likely…

Machine Learning · Computer Science 2023-07-04 Lennart Purucker , Joeran Beel

Evolution Strategies (ES) have emerged as a scalable gradient-free alternative to reinforcement learning based LLM fine-tuning, but it remains unclear whether comparable task performance implies comparable solutions in parameter space. We…

Machine Learning · Computer Science 2026-04-03 William Hoy , Binxu Wang , Xu Pan

Multi-Agent Systems have recently emerged as a promising paradigm for collaborative reasoning and solving complex tasks. However, the design of collaborative learning algorithms in multi-agent systems faces several challenges, including…

Multiagent Systems · Computer Science 2025-08-27 Yingfan Deng , Anhao Zhou , Yuan Yuan , Xiao Zhang , Yifei Zou , Dongxiao Yu