English
Related papers

Related papers: Consensus-Based Optimization Methods Converge Glob…

200 papers

We propose a gradient-free deep reinforcement learning algorithm to solve high-dimensional, finite-horizon stochastic control problems. Although the recently developed deep reinforcement learning framework has achieved great success in…

Optimization and Control · Mathematics 2025-02-03 Liyao Lyu , Jingrun Chen

Consensus-based optimization (CBO) has established itself as an efficient gradient-free optimization scheme, with attractive mathematical properties, such as mean-field convergence results for non-convex loss functions. In this work, we…

Optimization and Control · Mathematics 2025-07-01 Tim Roith , Leon Bungert , Philipp Wacker

Consensus based optimization (CBO) employs a swarm of particles evolving as a system of stochastic differential equations (SDEs). Recently, it has been adapted to yield a derivative free sampling method referred to as consensus based…

Optimization and Control · Mathematics 2024-09-06 Marvin Koß , Simon Weissmann , Jakob Zech

A consensus-based optimization (CBO) algorithm, which enables derivative and mesh-free optimization, is presented to localize a bioluminescent source. The light propagation is modeled by the radiative transfer equation approximated by…

Quantitative Methods · Quantitative Biology 2024-11-04 Jan Friedrich , Sarah Schraven , Fabian Kiessling , Michael Herty

In this paper we are concerned with the global minimization of a possibly non-smooth and non-convex objective function constrained on the unit hypersphere by means of a multi-agent derivative-free method. The proposed algorithm falls into…

Optimization and Control · Mathematics 2021-04-02 Massimo Fornasier , Hui Huang , Lorenzo Pareschi , Philippe Sünnen

We propose a multi-swarm approach to approximate the Pareto front of general multi-objective optimization problems that is based on the Consensus-based Optimization method (CBO). The algorithm is motivated step by step beginning with a…

Optimization and Control · Mathematics 2022-11-30 Kathrin Klamroth , Michael Stiglmayr , Claudia Totzeck

We investigate the implementation of a new stochastic Kuramoto-Vicsek-type model for global optimization of nonconvex functions on the sphere. This model belongs to the class of Consensus-Based Optimization. In fact, particles move on the…

Machine Learning · Computer Science 2021-07-29 Massimo Fornasier , Hui Huang , Lorenzo Pareschi , Philippe Sünnen

We present convergence and error estimates of the time-discrete consensus-based optimization(CBO) algorithms proposed in [arXiv:1909.09249] for general nonconvex functions. In authors' recent work [arxiv: 1910.08239], rigorous error…

Optimization and Control · Mathematics 2020-03-12 Seug-Yeal Ha , Shi Jin , Doheon Kim

Sampling-based optimization (SBO), like cross-entropy method and evolutionary algorithms, has achieved many successes in solving non-convex problems without gradients, yet its convergence is poorly understood. In this paper, we establish a…

Machine Learning · Computer Science 2026-05-19 Zeji Yi , Chaoyi Pan , Guanya Shi , Guannan Qu

In this paper we propose polarized consensus-based dynamics in order to make consensus-based optimization (CBO) and sampling (CBS) applicable for objective functions with several global minima or distributions with many modes, respectively.…

Optimization and Control · Mathematics 2023-10-10 Leon Bungert , Tim Roith , Philipp Wacker

Causal Bayesian Optimization (CBO) is a methodology designed to optimize an outcome variable by leveraging known causal relationships through targeted interventions. Traditional CBO methods require a fully and accurately specified causal…

Machine Learning · Statistics 2025-03-26 Jean Durand , Yashas Annadani , Stefan Bauer , Sonali Parbhoo

We propose a consensus based optimization algorithm with average drift (in short Ad-CBO) and provide a theoretical framework for it. In the theoretical analysis, we show that particle solutions to Ad-CBO converge to a global minimizer. In…

Optimization and Control · Mathematics 2026-02-24 Hyeong-Ohk Bae , Seung-Yeal Ha , Chanho Min , Jane Yoo , Jaeyoung Yoon

This paper presents a particle-based optimization method designed for addressing minimization problems with equality constraints, particularly in cases where the loss function exhibits non-differentiability or non-convexity. The proposed…

Optimization and Control · Mathematics 2026-03-31 José A. Carrillo , Shi Jin , Haoyu Zhang , Yuhua Zhu

In Causal Bayesian Optimization (CBO), an agent intervenes on an unknown structural causal model to maximize a downstream reward variable. In this paper, we consider the generalization where other agents or external events also intervene on…

Machine Learning · Computer Science 2023-08-02 Scott Sussex , Pier Giuseppe Sessa , Anastasiia Makarova , Andreas Krause

We improve recently introduced consensus-based optimization method, proposed in [R. Pinnau, C. Totzeck, O. Tse and S. Martin, Math. Models Methods Appl. Sci., 27(01):183--204, 2017], which is a gradient-free optimization method for general…

Optimization and Control · Mathematics 2020-03-06 José A. Carrillo , Shi Jin , Lei Li , Yuhua Zhu

In this paper we provide an analytical framework for investigating the efficiency of a consensus-based model for tackling global optimization problems. This work justifies the optimization algorithm in the mean-field sense showing the…

Analysis of PDEs · Mathematics 2018-02-08 José A. Carrillo , Young-Pil Choi , Claudia Totzeck , Oliver Tse

This paper is concerned with the large particle limit for the consensus-based optimization (CBO), which was postulated in the pioneering works [6,28]. In order to solve this open problem, we adapt a compactness argument by first proving the…

Optimization and Control · Mathematics 2022-07-20 Hui Huang , Jinniao Qiu

How should we intervene on an unknown structural equation model to maximize a downstream variable of interest? This setting, also known as causal Bayesian optimization (CBO), has important applications in medicine, ecology, and…

Machine Learning · Computer Science 2023-03-13 Scott Sussex , Anastasiia Makarova , Andreas Krause

Designing a fast and efficient optimization method with local optima avoidance capability on a variety of optimization problems is still an open problem for many researchers. In this work, the concept of a new global optimization method…

Neural and Evolutionary Computing · Computer Science 2012-08-13 Fereydoun Farrahi Moghaddam , Reza Farrahi Moghaddam , Mohamed Cheriet

We introduce a modified Consensus-Based Optimization model that admits a fully unified and rigorous analysis of its finite-particle dynamics, the associated McKean--Vlasov equation, and their optimization behavior under a single set of…

Probability · Mathematics 2025-11-25 Young-Pil Choi , Seungchan Lee , Sihyun Song