English
Related papers

Related papers: Consensus-based Optimization and Ensemble Kalman I…

200 papers

This paper is concerned with the large particle limit for the consensus-based optimization (CBO), which was postulated in the pioneering works [6,28]. In order to solve this open problem, we adapt a compactness argument by first proving the…

Optimization and Control · Mathematics 2022-07-20 Hui Huang , Jinniao Qiu

Ensemble Kalman Sampler (EKS) is a method to find approximately $i.i.d.$ samples from a target distribution. As of today, why the algorithm works and how it converges is mostly unknown. The continuous version of the algorithm is a set of…

Numerical Analysis · Mathematics 2025-03-07 Zhiyan Ding , Qin Li

This paper investigates ensemble Kalman inversion (EKI) for variational inverse problems with convex, potentially non-smooth regularization. While deterministic EKI and its Tikhonov-regularized variants have primarily been analyzed for…

Numerical Analysis · Mathematics 2026-03-24 Simon Weissmann

In this paper we consider a continuous description based on stochastic differential equations of the popular particle swarm optimization (PSO) process for solving global optimization problems and derive in the large particle limit the…

Numerical Analysis · Mathematics 2020-12-11 Sara Grassi , Lorenzo Pareschi

We improve recently introduced consensus-based optimization method, proposed in [R. Pinnau, C. Totzeck, O. Tse and S. Martin, Math. Models Methods Appl. Sci., 27(01):183--204, 2017], which is a gradient-free optimization method for general…

Optimization and Control · Mathematics 2020-03-06 José A. Carrillo , Shi Jin , Lei Li , Yuhua Zhu

Consensus based optimization is a derivative-free particles-based method for the solution of global optimization problems. Several versions of the method have been proposed in the literature, and different convergence results have been…

Optimization and Control · Mathematics 2025-04-04 Stefania Bellavia , Greta Malaspina

This work proposes a novel Alternating Direction Method of Multipliers (ADMM)-based Ensemble Kalman Inversion (EKI) algorithm for solving constrained nonlinear model predictive control (NMPC) problems. First, stage-wise nonlinear inequality…

Optimization and Control · Mathematics 2026-03-26 Ahmed Khalil , Mohamed Safwat , Efstathios Bakolas

A self-interacting dynamics that mimics the standard Consensus-Based Optimization (CBO) model is introduced. This single-particle dynamics is shown to converge to a unique invariant measure that approximates the global minimum of a given…

Optimization and Control · Mathematics 2024-11-18 Hui Huang , Hicham Kouhkouh

We propose Discrete Consensus-Based Optimization (DCBO), a fully discrete version of the Consensus-Based Optimization (CBO) framework. DCBO is a multi-agent method for the global optimization of possibly non-convex and non-differentiable…

Optimization and Control · Mathematics 2024-04-17 Junhyeok Byeon , Seung-Yeal Ha , Joong-Ho Won

We establish a uniform-in-time estimate for the mean-field convergence of the Consensus-Based Optimization (CBO) algorithm by rescaling the consensus point in the dynamics with a small parameter $\kappa \in (0,1)$. This uniform-in-time…

Optimization and Control · Mathematics 2025-07-01 Hui Huang , Hicham Kouhkouh

In this work we study the mean-field description of Consensus-Based Optimization (CBO), a derivative-free particle optimization method. Such a description is provided by a non-local SDE of McKean-Vlasov type, whose fields lack of global…

Optimization and Control · Mathematics 2025-12-30 Alessandro Baldi

The Ensemble Kalman Filter (EnKF) belongs to the class of iterative particle filtering methods and can be used for solving control--to--observable inverse problems. In this context, the EnKF is known as Ensemble Kalman Inversion (EKI). In…

Numerical Analysis · Mathematics 2022-02-17 Dieter Armbruster , Michael Herty , Giuseppe Visconti

Metaheuristic algorithms are powerful tools for global optimization, particularly for non-convex and non-differentiable problems where exact methods are often impractical. Particle-based optimization methods, inspired by swarm intelligence…

Optimization and Control · Mathematics 2026-03-23 Giacomo Borghi , Hyesung Im , Lorenzo Pareschi

This paper is focused on the optimization approach to the solution of inverse problems. We introduce a stochastic dynamical system in which the parameter-to-data map is embedded, with the goal of employing techniques from nonlinear Kalman…

Numerical Analysis · Mathematics 2022-04-29 Daniel Zhengyu Huang , Tapio Schneider , Andrew M. Stuart

Electromagnetismlike Optimization (EMO) is a global optimization algorithm, particularly well suited to solve problems featuring nonlinear and multimodal cost functions. EMO employs searcher agents that emulate a population of charged…

Artificial Intelligence · Computer Science 2014-05-21 Erik Cuevas , Diego Oliva , Daniel Zaldivar , Marco Perez , Gonzalo Pajares

We study the finite-agent behavior of Consensus-Based Optimization (CBO), a recent metaheuristic for the global minimization of a function, that combines drift toward a consensus estimate with stochastic exploration. While previous analyses…

Optimization and Control · Mathematics 2025-10-23 Simone Göttlich , Jacob Heieck , Andreas Neuenkirch

In this paper we study anisotropic consensus-based optimization (CBO), a multi-agent metaheuristic derivative-free optimization method capable of globally minimizing nonconvex and nonsmooth functions in high dimensions. CBO is based on…

Numerical Analysis · Mathematics 2024-03-26 Massimo Fornasier , Timo Klock , Konstantin Riedl

We study the derivative-free global optimization algorithm Consensus-Based Optimization (CBO), establishing uniform-in-time propagation of chaos as well as an almost uniform-in-time stability result for the microscopic particle system.…

Probability · Mathematics 2026-02-20 Nicolai Gerber , Franca Hoffmann , Dohyeon Kim , Urbain Vaes

We propose a zero-order optimization method for sequential min-max problems based on two populations of interacting particles. The systems are coupled so that one population aims to solve the inner maximization problem, while the other aims…

Optimization and Control · Mathematics 2024-07-25 Giacomo Borghi , Hui Huang , Jinniao Qiu

The ensemble Kalman inversion (EKI) is a particle based method which has been introduced as the application of the ensemble Kalman filter to inverse problems. In practice it has been widely used as derivative-free optimization method in…

Numerical Analysis · Mathematics 2022-09-21 Simon Weissmann