English
Related papers

Related papers: Self-interacting CBO: Existence, uniqueness, and l…

200 papers

We study the finite-agent behavior of Consensus-Based Optimization (CBO), a recent metaheuristic for the global minimization of a function, that combines drift toward a consensus estimate with stochastic exploration. While previous analyses…

Optimization and Control · Mathematics 2025-10-23 Simone Göttlich , Jacob Heieck , Andreas Neuenkirch

In this work we extend the class of Consensus-Based Optimization (CBO) metaheuristic methods by considering memory effects and a random selection strategy. The proposed algorithm iteratively updates a population of particles according to a…

Optimization and Control · Mathematics 2023-08-16 Giacomo Borghi , Sara Grassi , Lorenzo Pareschi

Zero-order optimization has recently received significant attention for designing optimal trajectories and policies for robotic systems. However, most existing methods (e.g., MPPI, CEM, and CMA-ES) are local in nature, as they rely on…

Robotics · Computer Science 2026-02-09 Xudong Sun , Armand Jordana , Massimo Fornasier , Jalal Etesami , Majid Khadiv

We study the derivative-free global optimization algorithm Consensus-Based Optimization (CBO), establishing uniform-in-time propagation of chaos as well as an almost uniform-in-time stability result for the microscopic particle system.…

Probability · Mathematics 2026-02-20 Nicolai Gerber , Franca Hoffmann , Dohyeon Kim , Urbain Vaes

In this paper we propose polarized consensus-based dynamics in order to make consensus-based optimization (CBO) and sampling (CBS) applicable for objective functions with several global minima or distributions with many modes, respectively.…

Optimization and Control · Mathematics 2023-10-10 Leon Bungert , Tim Roith , Philipp Wacker

Lately, a novel swarm intelligence model, namely the consensus-based optimization (CBO) algorithm, was introduced to deal with the global optimization problems. Limited by the conditions of Ito's formula, the convergence analysis of the…

Optimization and Control · Mathematics 2025-01-14 Jiazhen Wei , Wei Bian

This paper studies the problem of globally optimizing a variable of interest that is part of a causal model in which a sequence of interventions can be performed. This problem arises in biology, operational research, communications and,…

Machine Learning · Statistics 2020-05-27 Virginia Aglietti , Xiaoyu Lu , Andrei Paleyes , Javier González

In this paper, we propose a predictor-corrector type Consensus Based Optimization (CBO) algorithm on a convex feasible set. Our proposed algorithm generalizes the CBO algorithm in [11] to tackle a constrained optimization problem for the…

Optimization and Control · Mathematics 2021-10-14 Hyeong-Ohk Bae , Seung-Yeal Ha , Myeongju Kang , Hyuncheul Lim , Chanho Min , Jane Yoo

Discovering optimal designs through sequential data collection is essential in many real-world applications. While Bayesian Optimization (BO) has achieved remarkable success in this setting, growing attention has recently turned to…

Machine Learning · Computer Science 2026-04-22 Chih-Yu Chang , Qiyuan Chen , Tianhan Gao , David Fenning , Chinedum Okwudire , Neil Dasgupta , Wei Lu , Raed Al Kontar

In this paper we study anisotropic consensus-based optimization (CBO), a multi-agent metaheuristic derivative-free optimization method capable of globally minimizing nonconvex and nonsmooth functions in high dimensions. CBO is based on…

Numerical Analysis · Mathematics 2024-03-26 Massimo Fornasier , Timo Klock , Konstantin Riedl

In this work we propose MirrorCBO, a consensus-based optimization (CBO) method which generalizes standard CBO in the same way that mirror descent generalizes gradient descent. For this we apply the CBO methodology to a swarm of dual…

Optimization and Control · Mathematics 2025-07-17 Leon Bungert , Franca Hoffmann , Dohyeon Kim , Tim Roith

Global optimization of a non-convex objective function often appears in large-scale machine-learning and artificial intelligence applications. Recently, consensus-based optimization (in short CBO) methods have been introduced as one of the…

Optimization and Control · Mathematics 2019-10-21 Seung-Yeal Ha , Shi Jin , Doheon Kim

We analyze the Consensus-Based Optimization (CBO) algorithm with a consensus point rescaled by a small fixed parameter $\kappa \in (0,1)$. Under minimal assumptions on the objective function and the initial data, we establish its…

Optimization and Control · Mathematics 2026-01-19 Hui Huang , Hicham Kouhkouh , Lukang Sun

This paper presents a particle-based optimization method designed for addressing minimization problems with equality constraints, particularly in cases where the loss function exhibits non-differentiability or non-convexity. The proposed…

Optimization and Control · Mathematics 2026-03-31 José A. Carrillo , Shi Jin , Haoyu Zhang , Yuhua Zhu

We propose constrained causal Bayesian optimization (cCBO), an approach for finding interventions in a known causal graph that optimize a target variable under some constraints. cCBO first reduces the search space by exploiting the graph…

Machine Learning · Statistics 2023-06-14 Virginia Aglietti , Alan Malek , Ira Ktena , Silvia Chiappa

We study second-order Consensus-Based Optimization (CBO), a derivative-free global optimization algorithm in which the consensus force and the multiplicative exploratory noise act on particle velocities. We prove quantitative…

Probability · Mathematics 2026-05-29 Seung-Yeal Ha , Franca Hoffmann , Dohyeon Kim

In this work we are interested in the construction of numerical methods for high dimensional constrained nonlinear optimization problems by particle-based gradient-free techniques. A consensus-based optimization (CBO) approach combined with…

Optimization and Control · Mathematics 2021-11-23 Giacomo Borghi , Michael Herty , Lorenzo Pareschi

This paper studies the problem of performing a sequence of optimal interventions in a causal dynamical system where both the target variable of interest and the inputs evolve over time. This problem arises in a variety of domains e.g.…

Machine Learning · Statistics 2021-10-27 Virginia Aglietti , Neil Dhir , Javier González , Theodoros Damoulas

Consensus based optimization is a derivative-free particles-based method for the solution of global optimization problems. Several versions of the method have been proposed in the literature, and different convergence results have been…

Optimization and Control · Mathematics 2025-04-04 Stefania Bellavia , Greta Malaspina

This paper is concerned with the large particle limit for the consensus-based optimization (CBO), which was postulated in the pioneering works [6,28]. In order to solve this open problem, we adapt a compactness argument by first proving the…

Optimization and Control · Mathematics 2022-07-20 Hui Huang , Jinniao Qiu