English
Related papers

Related papers: Gradient is All You Need? How Consensus-Based Opti…

200 papers

In this paper we study consensus-based optimization (CBO), a versatile, flexible and customizable optimization method suitable for performing nonconvex and nonsmooth global optimizations in high dimensions. CBO is a multi-particle…

Numerical Analysis · Mathematics 2026-05-28 Konstantin Riedl

In this paper, we are interested in finding the global minimizer of a nonsmooth nonconvex unconstrained optimization problem. By combining the discrete consensus-based optimization (CBO) algorithm and the gradient descent method, we develop…

Optimization and Control · Mathematics 2025-01-16 Jiazhen Wei , Fan Wu , Wei Bian

In this paper, we study consensus-based optimization (CBO), which is a multi-agent metaheuristic derivative-free optimization method that can globally minimize nonconvex nonsmooth functions and is amenable to theoretical analysis. Based on…

Numerical Analysis · Mathematics 2024-09-10 Massimo Fornasier , Timo Klock , Konstantin Riedl

A novel multiscale consensus-based optimization (CBO) algorithm for solving bi- and tri-level optimization problems is introduced. Existing CBO techniques are generalized by the proposed method through the employment of multiple interacting…

Optimization and Control · Mathematics 2025-06-23 Michael Herty , Yuyang Huang , Dante Kalise , Hicham Kouhkouh

Consensus-based optimization (CBO) is a powerful and versatile zero-order multi-particle method designed to provably solve high-dimensional global optimization problems, including those that are genuinely nonconvex or nonsmooth. The method…

Optimization and Control · Mathematics 2026-02-13 Massimo Fornasier , Hui Huang , Jona Klemenc , Greta Malaspina

Consensus-based optimization (CBO) is a versatile multi-particle metaheuristic optimization method suitable for performing nonconvex and nonsmooth global optimizations in high dimensions. It has proven effective in various applications…

Optimization and Control · Mathematics 2026-05-12 Massimo Fornasier , Peter Richtárik , Konstantin Riedl , Lukang Sun

Consensus-based optimization (CBO) is a multi-agent metaheuristic derivative-free optimization algorithm that has proven to be capable of globally minimizing nonconvex nonsmooth functions across a diverse range of applications while being…

Optimization and Control · Mathematics 2025-12-12 Sabrina Bonandin , Konstantin Riedl , Sara Veneruso

In this work we are interested in the construction of numerical methods for high dimensional constrained nonlinear optimization problems by particle-based gradient-free techniques. A consensus-based optimization (CBO) approach combined with…

Optimization and Control · Mathematics 2021-11-23 Giacomo Borghi , Michael Herty , Lorenzo Pareschi

Consensus-based optimization (CBO) is an agent-based derivative-free method for non-smooth global optimization that has been introduced in 2017, leveraging a surprising interplay between stochastic exploration and Laplace principle. In…

Analysis of PDEs · Mathematics 2024-10-01 Massimo Fornasier , Lukang Sun

We propose Discrete Consensus-Based Optimization (DCBO), a fully discrete version of the Consensus-Based Optimization (CBO) framework. DCBO is a multi-agent method for the global optimization of possibly non-convex and non-differentiable…

Optimization and Control · Mathematics 2024-04-17 Junhyeok Byeon , Seung-Yeal Ha , Joong-Ho Won

Consensus-based optimization (CBO) is a versatile multi-particle optimization method for performing nonconvex and nonsmooth global optimizations in high dimensions. Proofs of global convergence in probability have been achieved for a broad…

Optimization and Control · Mathematics 2026-01-13 Jonas Beddrich , Enis Chenchene , Massimo Fornasier , Hui Huang , Barbara Wohlmuth

We propose a gradient-free deep reinforcement learning algorithm to solve high-dimensional, finite-horizon stochastic control problems. Although the recently developed deep reinforcement learning framework has achieved great success in…

Optimization and Control · Mathematics 2025-02-03 Liyao Lyu , Jingrun Chen

We propose a variant of consensus-based optimization (CBO) algorithms, controlled-CBO, which introduces a feedback control term to improve convergence towards global minimizers of non-convex functions in multiple dimensions. The feedback…

Optimization and Control · Mathematics 2025-07-29 Yuyang Huang , Michael Herty , Dante Kalise , Nikolas Kantas

Consensus based optimization is a derivative-free particles-based method for the solution of global optimization problems. Several versions of the method have been proposed in the literature, and different convergence results have been…

Optimization and Control · Mathematics 2025-04-04 Stefania Bellavia , Greta Malaspina

In this paper, we propose consensus-based optimization for saddle point problems (CBO-SP), a novel multi-particle metaheuristic derivative-free optimization method capable of provably finding global Nash equilibria. Following the idea of…

Optimization and Control · Mathematics 2024-08-05 Hui Huang , Jinniao Qiu , Konstantin Riedl

Two of the most prominent algorithms for solving unconstrained smooth games are the classical stochastic gradient descent-ascent (SGDA) and the recently introduced stochastic consensus optimization (SCO) [Mescheder et al., 2017]. SGDA is…

Machine Learning · Computer Science 2021-11-05 Nicolas Loizou , Hugo Berard , Gauthier Gidel , Ioannis Mitliagkas , Simon Lacoste-Julien

We introduce a new consensus based optimization (CBO) method where interacting particle system is driven by jump-diffusion stochastic differential equations. We study well-posedness of the particle system as well as of its mean-field limit.…

Probability · Mathematics 2023-05-23 D. Kalise , A. Sharma , M. V. Tretyakov

Stochastic gradient descent (SGD) method is popular for solving non-convex optimization problems in machine learning. This work investigates SGD from a viewpoint of graduated optimization, which is a widely applied approach for non-convex…

Optimization and Control · Mathematics 2023-08-15 Da Li , Jingjing Wu , Qingrun Zhang

In this paper we study anisotropic consensus-based optimization (CBO), a multi-agent metaheuristic derivative-free optimization method capable of globally minimizing nonconvex and nonsmooth functions in high dimensions. CBO is based on…

Numerical Analysis · Mathematics 2024-03-26 Massimo Fornasier , Timo Klock , Konstantin Riedl

In this work we propose MirrorCBO, a consensus-based optimization (CBO) method which generalizes standard CBO in the same way that mirror descent generalizes gradient descent. For this we apply the CBO methodology to a swarm of dual…

Optimization and Control · Mathematics 2025-07-17 Leon Bungert , Franca Hoffmann , Dohyeon Kim , Tim Roith
‹ Prev 1 2 3 10 Next ›