English
Related papers

Related papers: On the mean-field limit for the consensus-based op…

200 papers

We propose and study a novel efficient algorithm for clustering and classification tasks based on the famous MBO scheme. On the one hand, inspired by Jacobs et al. [J. Comp. Phys. 2018], we introduce constraints on the size of clusters…

Analysis of PDEs · Mathematics 2025-03-03 Fabius Krämer , Tim Laux

Bayesian Optimization (BO) is a widely used approach for blackbox optimization that leverages a Gaussian process (GP) model and an acquisition function to guide future sampling. While effective in low-dimensional settings, BO faces…

Machine Learning · Computer Science 2025-11-26 Pavankumar Koratikere , Leifur Leifsson

Bayesian optimization (BO) has become an effective approach for black-box function optimization problems when function evaluations are expensive and the optimum can be achieved within a relatively small number of queries. However, many…

Machine Learning · Statistics 2018-08-06 Zi Wang , Clement Gehring , Pushmeet Kohli , Stefanie Jegelka

We consider first-order conservative systems of particles with binary Coulomb interactions in the mean-field scaling regime in dimensions $d\geq 3$. We show that if at some time, the associated sequence of empirical measures converges in a…

Analysis of PDEs · Mathematics 2020-10-21 Matthew Rosenzweig

We study a kinetic mean-field equation for a system of particles with different sizes, in which particles are allowed to coagulate only if their sizes sum up to a prescribed time-dependent value. We prove well-posedness of this model, study…

Analysis of PDEs · Mathematics 2012-05-22 Ondrej Budáč , Michael Herrmann , Barbara Niethammer , Andrej Spielmann

We review recent results about the derivation of the Gross-Pitaevskii equation and of the Bogoliubov excitation spectrum, starting from many-body quantum mechanics. We focus on the mean-field regime, where the interaction is multiplied by a…

Mathematical Physics · Physics 2015-10-16 Mathieu Lewin

This article addresses the problem of derivative-free (single- or multi-objective) optimization subject to multiple inequality constraints. Both the objective and constraint functions are assumed to be smooth, non-linear and expensive to…

Computation · Statistics 2017-07-28 Paul Feliot , Julien Bect , Emmanuel Vazquez

Bayesian optimization has been successfully applied to optimize black-box functions where the number of evaluations is severely limited. However, in many real-world applications, it is hard or impossible to know in advance which designs are…

Transport processes are universal in real-world complex networks, such as communication and transportation networks. As the increase of the traffic in these complex networks, problems like traffic congestion and transport delay are becoming…

Networking and Internet Architecture · Computer Science 2024-10-30 Jiexin Wu , Cunlai Pu , Shuxin Ding , Guo Cao , Panos M. Pardalos

Recent advances in preference optimization have demonstrated significant potential for improving mathematical reasoning capabilities in large language models (LLMs). While current approaches leverage high-quality pairwise preference data…

Computation and Language · Computer Science 2025-05-30 Yunqiao Yang , Houxing Ren , Zimu Lu , Ke Wang , Weikang Shi , Aojun Zhou , Junting Pan , Mingjie Zhan , Hongsheng Li

Experimental (design) optimization is a key driver in designing and discovering new products and processes. Bayesian Optimization (BO) is an effective tool for optimizing expensive and black-box experimental design processes. While Bayesian…

Machine Learning · Computer Science 2024-02-28 Arun Kumar A , Alistair Shilton , Sunil Gupta , Santu Rana , Stewart Greenhill , Svetha Venkatesh

We propose an algorithm to approximate solutions of global optimization problems in Sobolev spaces that follows the spirit of Consensus-based algorithms in finite dimensions. The main ingredient are Gaussian processes. In fact, we exploit…

Optimization and Control · Mathematics 2026-03-17 Mahmoud Khatab , Claudia Totzeck

Identifying optimal designs for generalized linear models with a binary response can be a challenging task, especially when there are both continuous and discrete independent factors in the model. Theoretical results rarely exist for such…

Applications · Statistics 2016-02-09 Joshua Lukemire , Abhyuday Mandal , Weng Kee Wong

In this paper, we present a rigorous derivation of the mean-field limit for a moderately interacting particle system in $\R^d$ $(d\geq 2)$. For stochastic initial data, we demonstrate that the solution to the interacting particle model,…

Analysis of PDEs · Mathematics 2024-07-08 Jinhuan Wang , Mengdi Zhuang , Hui Huang

We formulate and investigate a mean field optimization (MFO) problem over a set of probability distributions $\mu$ with a prescribed marginal $m$. The cost function depends on an aggregate term, which is the expectation of $\mu$ with…

Optimization and Control · Mathematics 2023-11-01 Kang Liu , Laurent Pfeiffer

We study the variant of Particle Swarm Optimization (PSO) that applies random velocities in a dimension instead of the regular velocity update equations as soon as the so-called potential of the swarm falls below a certain bound in this…

Neural and Evolutionary Computing · Computer Science 2020-12-22 Bernd Bassimir , Manuel Schmitt , Rolf Wanka

In high-dimensional settings, Bayesian optimization (BO) can be expensive and infeasible. The random embedding Bayesian optimization algorithm is commonly used to address high-dimensional BO challenges. However, this method relies on the…

Machine Learning · Computer Science 2024-08-12 Jiaming Lu , Rong J. B. Zhu

Bayesian optimization (BO) is a powerful technology for optimizing noisy expensive-to-evaluate black-box functions, with a broad range of real-world applications in science, engineering, economics, manufacturing, and beyond. In this paper,…

Machine Learning · Computer Science 2024-01-30 Joel A. Paulson , Calvin Tsay

Solving non-convex minimization problems using multi-particle metaheuristic derivative-free optimization methods is still an active area of research. Popular methods are Particle Swarm Optimization (PSO) methods, that iteratively update a…

Optimization and Control · Mathematics 2025-08-21 Michael Herty , Sara Veneruso

Bayesian optimization (BO) is an efficient framework for solving black-box optimization problems with expensive function evaluations. This paper addresses the BO problem setting for combinatorial spaces (e.g., sequences and graphs) that…

Machine Learning · Computer Science 2022-02-07 Aryan Deshwal , Syrine Belakaria , Janardhan Rao Doppa