English
Related papers

Related papers: Enhancing Exploration in Global Optimization by No…

200 papers

In this paper we study consensus-based optimization (CBO), a versatile, flexible and customizable optimization method suitable for performing nonconvex and nonsmooth global optimizations in high dimensions. CBO is a multi-particle…

Numerical Analysis · Mathematics 2026-05-28 Konstantin Riedl

We present the first general purpose framework for marginal maximum a posteriori estimation of probabilistic program variables. By using a series of code transformations, the evidence of any probabilistic program, and therefore of any…

Machine Learning · Statistics 2017-07-17 Tom Rainforth , Tuan Anh Le , Jan-Willem van de Meent , Michael A. Osborne , Frank Wood

Bayesian optimization is a powerful global optimization technique for expensive black-box functions. One of its shortcomings is that it requires auxiliary optimization of an acquisition function at each iteration. This auxiliary…

Machine Learning · Statistics 2014-02-28 Ziyu Wang , Babak Shakibi , Lin Jin , Nando de Freitas

Mean-field Langevin dynamics (MFLD) is an optimization method derived by taking the mean-field limit of noisy gradient descent for two-layer neural networks in the mean-field regime. Recently, the propagation of chaos (PoC) for MFLD has…

Machine Learning · Statistics 2025-08-19 Atsushi Nitanda , Anzelle Lee , Damian Tan Xing Kai , Mizuki Sakaguchi , Taiji Suzuki

McKean-Vlasov stochastic differential equations (MVSDEs) describe systems whose dynamics depend on both individual states and the population distribution, and they arise widely in neuroscience, finance, and epidemiology. In many…

Computation · Statistics 2026-01-21 Ning Ning , Amin Wu

We propose a novel projection-based particle method for solving the McKean-Vlasov stochastic differential equations. Our approach is based on a projection-type estimation of the marginal density of the solution in each time step. The…

Numerical Analysis · Mathematics 2018-08-07 Denis Belomestny , John Schoenmakers

An optimization framework is presented for minimizing the energy functional developed around a generalized equation governing physical systems such as fluid dynamics, particle transport, phase transition, and other related systems. The…

Fluid Dynamics · Physics 2024-04-25 Varsha Gupta

In this paper, we consider the problem of multi-objective optimal control of a dynamical system with additive and multiplicative noises with given second moments and arbitrary probability distributions. The objectives are given by quadratic…

Optimization and Control · Mathematics 2014-02-17 Ather Gattami

Hybrid variational quantum algorithms, which combine a classical optimizer with evaluations on a quantum chip, are the most promising candidates to show quantum advantage on current noisy, intermediate-scale quantum (NISQ) devices. The…

Quantum Physics · Physics 2022-08-05 Juliane Mueller , Wim Lavrijsen , Costin Iancu , Wibe de Jong

We introduce an abstract measure___theoretic framework that serves as a tool to rigorously study stochastic iterative global optimization algorithms as a unified class. The framework is formulated in terms of probability kernels, which, via…

Formal Languages and Automata Theory · Computer Science 2026-03-03 Gaëtan Serré , Argyris Kalogeratos , Nicolas Vayatis

While many advanced statistical methods for the design of experiments exist, it is still typical for physical experiments to be performed adaptively based on human intuition. As a consequence, experimental resources are wasted on…

Methodology · Statistics 2025-03-04 Anton van Beek

In many real world problems, optimization decisions have to be made with limited information. The decision maker may have no a priori or posteriori data about the often nonconvex objective function except from on a limited number of points…

Optimization and Control · Mathematics 2011-11-10 Tansu Alpcan

Variational hybrid quantum-classical optimization represents one of the most promising avenue to show the advantage of nowadays noisy intermediate-scale quantum computers in solving hard problems, such as finding the minimum-energy state of…

Quantum Physics · Physics 2020-11-18 Laura Gentini , Alessandro Cuccoli , Stefano Pirandola , Paola Verrucchi , Leonardo Banchi

In this paper, we introduce a novel approach to multi-modal optimization by enhancing the recently developed kinetic-based optimization (KBO) method with genetic dynamics (GKBO). The proposed method targets objective functions with multiple…

Numerical Analysis · Mathematics 2024-11-12 Federica Ferrarese , Claudia Totzeck

The variational quantum eigensolver (VQE) is a hybrid quantum-classical algorithm used to find the ground state of a Hamiltonian using variational methods. In the context of this Lattice symposium, the procedure can be used to study lattice…

Quantum Physics · Physics 2021-12-02 Giovanni Iannelli , Karl Jansen

Consider a system of $n$ weakly interacting particles driven by independent Brownian motions. In many instances, it is well known that the empirical measure converges to the solution of a partial differential equation, usually called…

Probability · Mathematics 2020-07-28 Florian Bechtold , Fabio Coppini

We investigate propagation of chaos for mean field Markov Decision Process with common noise (CMKV-MDP), and when the optimization is performed over randomized open-loop controls on infinite horizon. We first state a rate of convergence of…

Optimization and Control · Mathematics 2022-07-27 Médéric Motte , Huyên Pham

We study the convergence of $N-$particle systems described by SDEs driven by Brownian motion and Poisson random measure, where the coefficients depend on the empirical measure of the system. Every particle jumps with a jump rate depending…

Probability · Mathematics 2021-03-09 Xavier Erny , Eva Löcherbach , Dasha Loukianova

Variational Quantum Algorithms (VQAs) are a leading approach for near-term quantum computing but face major optimization challenges from noise, barren plateaus, and complex energy landscapes. We benchmarked more than fifty metaheuristic…

Quantum Physics · Physics 2025-09-30 Vojtěch Novák , Ivan Zelinka , Václav Snášel

This article considers nonconvex global optimization problems subject to uncertainties described by continuous random variables. Such problems arise in chemical process design, renewable energy systems, stochastic model predictive control,…

Optimization and Control · Mathematics 2017-09-27 Yuanxun Shao , Joseph Kirk Scott