English
Related papers

Related papers: On the mean-field limit for the consensus-based op…

200 papers

Particle swarm optimization algorithm is a stochastic meta-heuristic solving global optimization problems appreciated for its efficacity and simplicity. It consists in a swarm of particles interacting among themselves and searching the…

Probability · Mathematics 2024-09-23 Vianney Bruned , André Mas , Sylvain Wlodarczyk

We analyze the Consensus-Based Optimization (CBO) algorithm with a consensus point rescaled by a small fixed parameter $\kappa \in (0,1)$. Under minimal assumptions on the objective function and the initial data, we establish its…

Optimization and Control · Mathematics 2026-01-19 Hui Huang , Hicham Kouhkouh , Lukang Sun

Global optimization of a non-convex objective function often appears in large-scale machine-learning and artificial intelligence applications. Recently, consensus-based optimization (in short CBO) methods have been introduced as one of the…

Optimization and Control · Mathematics 2019-10-21 Seung-Yeal Ha , Shi Jin , Doheon Kim

In this paper, we propose a predictor-corrector type Consensus Based Optimization (CBO) algorithm on a convex feasible set. Our proposed algorithm generalizes the CBO algorithm in [11] to tackle a constrained optimization problem for the…

Optimization and Control · Mathematics 2021-10-14 Hyeong-Ohk Bae , Seung-Yeal Ha , Myeongju Kang , Hyuncheul Lim , Chanho Min , Jane Yoo

Recently, the paper [12] introduces a derivative-free consensus-based particle method that finds the Nash equilibrium of non-convex multiplayer games, where it proves the global exponential convergence in the sense of mean-field law. This…

Optimization and Control · Mathematics 2025-05-21 Hui Huang , Jethro Warnett

Bayesian optimization (BO) is an efficient framework for optimization of black-box objectives when function evaluations are costly and gradient information is not easily accessible. BO has been successfully applied to automate the task of…

Machine Learning · Computer Science 2024-07-09 Pallavi Mitra , Felix Biessmann

A consensus-based optimization (CBO) algorithm, which enables derivative and mesh-free optimization, is presented to localize a bioluminescent source. The light propagation is modeled by the radiative transfer equation approximated by…

Quantitative Methods · Quantitative Biology 2024-11-04 Jan Friedrich , Sarah Schraven , Fabian Kiessling , Michael Herty

Consensus based optimization is a derivative-free particles-based method for the solution of global optimization problems. Several versions of the method have been proposed in the literature, and different convergence results have been…

Optimization and Control · Mathematics 2025-04-04 Stefania Bellavia , Greta Malaspina

We introduce a modified Consensus-Based Optimization model that admits a fully unified and rigorous analysis of its finite-particle dynamics, the associated McKean--Vlasov equation, and their optimization behavior under a single set of…

Probability · Mathematics 2025-11-25 Young-Pil Choi , Seungchan Lee , Sihyun Song

It has been well documented that the use of exponentially-averaged momentum (EM) in particle swarm optimization (PSO) is advantageous over the vanilla PSO algorithm. In the single-objective setting, it leads to faster convergence and…

Neural and Evolutionary Computing · Computer Science 2022-11-15 Anwesh Bhattacharya , Snehanshu Saha , Nithin Nagaraj

We present stochastic consensus and convergence of the discrete consensus-based optimization (CBO) algorithm with random batch interactions and heterogeneous external noises. Despite the wide applications and successful performance in many…

Optimization and Control · Mathematics 2021-08-02 Dongnam Ko , Seung-Yeal Ha , Shi Jin , Doheon Kim

Zero-order optimization has recently received significant attention for designing optimal trajectories and policies for robotic systems. However, most existing methods (e.g., MPPI, CEM, and CMA-ES) are local in nature, as they rely on…

Robotics · Computer Science 2026-02-09 Xudong Sun , Armand Jordana , Massimo Fornasier , Jalal Etesami , Majid Khadiv

We propose a consensus based optimization algorithm with average drift (in short Ad-CBO) and provide a theoretical framework for it. In the theoretical analysis, we show that particle solutions to Ad-CBO converge to a global minimizer. In…

Optimization and Control · Mathematics 2026-02-24 Hyeong-Ohk Bae , Seung-Yeal Ha , Chanho Min , Jane Yoo , Jaeyoung Yoon

In this paper we provide an analytical framework for investigating the efficiency of a consensus-based model for tackling global optimization problems. This work justifies the optimization algorithm in the mean-field sense showing the…

Analysis of PDEs · Mathematics 2018-02-08 José A. Carrillo , Young-Pil Choi , Claudia Totzeck , Oliver Tse

Consensus-based optimization (CBO) is an agent-based derivative-free method for non-smooth global optimization that has been introduced in 2017, leveraging a surprising interplay between stochastic exploration and Laplace principle. In…

Analysis of PDEs · Mathematics 2024-10-01 Massimo Fornasier , Lukang Sun

We propose Discrete Consensus-Based Optimization (DCBO), a fully discrete version of the Consensus-Based Optimization (CBO) framework. DCBO is a multi-agent method for the global optimization of possibly non-convex and non-differentiable…

Optimization and Control · Mathematics 2024-04-17 Junhyeok Byeon , Seung-Yeal Ha , Joong-Ho Won

In this paper we propose polarized consensus-based dynamics in order to make consensus-based optimization (CBO) and sampling (CBS) applicable for objective functions with several global minima or distributions with many modes, respectively.…

Optimization and Control · Mathematics 2023-10-10 Leon Bungert , Tim Roith , Philipp Wacker

We study the problem of preferential Bayesian optimization (BO), where we aim to optimize a black-box function with only preference feedback over a pair of candidate solutions. Inspired by the likelihood ratio idea, we construct a…

Machine Learning · Computer Science 2024-05-30 Wenjie Xu , Wenbin Wang , Yuning Jiang , Bratislav Svetozarevic , Colin N. Jones

We propose constrained causal Bayesian optimization (cCBO), an approach for finding interventions in a known causal graph that optimize a target variable under some constraints. cCBO first reduces the search space by exploiting the graph…

Machine Learning · Statistics 2023-06-14 Virginia Aglietti , Alan Malek , Ira Ktena , Silvia Chiappa

The mean-field approximations of many-boson dynamics are known to be effective in many physical relevant situations. The mathematical justifications of such approximations rely generally on specific considerations which depend too much on…

Mathematical Physics · Physics 2018-10-29 Clément Rouffort