English
Related papers

Related papers: Binary interaction methods for high dimensional gl…

200 papers

We propose a gradient-free deep reinforcement learning algorithm to solve high-dimensional, finite-horizon stochastic control problems. Although the recently developed deep reinforcement learning framework has achieved great success in…

Optimization and Control · Mathematics 2025-02-03 Liyao Lyu , Jingrun Chen

In this work we survey some recent results on the global minimization of a non-convex and possibly non-smooth high dimensional objective function by means of particle based gradient-free methods. Such problems arise in many situations of…

Optimization and Control · Mathematics 2021-08-21 Sara Grassi , Hui Huang , Lorenzo Pareschi , Jinniao Qiu

We consider stochastic systems of interacting particles or agents, with dynamics determined by an interaction kernel which only depends on pairwise distances. We study the problem of inferring this interaction kernel from observations of…

Statistics Theory · Mathematics 2020-07-31 Fei Lu , Mauro Maggioni , Sui Tang

In this work, we consider smooth unconstrained optimization problems and we deal with the class of gradient methods with momentum, i.e., descent algorithms where the search direction is defined as a linear combination of the current…

Optimization and Control · Mathematics 2025-12-04 Matteo Lapucci , Giampaolo Liuzzi , Stefano Lucidi , Davide Pucci , Marco Sciandrone

Bayesian inference can be embedded into an appropriately defined dynamics in the space of probability measures. In this paper, we take Brownian motion and its associated Fokker--Planck equation as a starting point for such embeddings and…

Numerical Analysis · Mathematics 2021-02-09 Sebastian Reich , Simon Weissmann

Bayesian optimization is a class of data efficient model based algorithms typically focused on global optimization. We consider the more general case where a user is faced with multiple problems that each need to be optimized conditional on…

Machine Learning · Statistics 2020-11-04 Michael Pearce , Janis Klaise , Matthew Groves

Realistic models of biological processes typically involve interacting components on multiple scales, driven by changing environment and inherent stochasticity. Such models are often analytically and numerically intractable. We revisit a…

Populations and Evolution · Quantitative Biology 2022-01-19 K. Bodova , E. Szep , N. H. Barton

In this work we propose MirrorCBO, a consensus-based optimization (CBO) method which generalizes standard CBO in the same way that mirror descent generalizes gradient descent. For this we apply the CBO methodology to a swarm of dual…

Optimization and Control · Mathematics 2025-07-17 Leon Bungert , Franca Hoffmann , Dohyeon Kim , Tim Roith

In this paper, the global optimization problem $\min_{y\in S} F(y)$ with $S$ being a hyperinterval in $\Re^N$ and $F(y)$ satisfying the Lipschitz condition with an unknown Lipschitz constant is considered. It is supposed that the function…

Optimization and Control · Mathematics 2015-09-14 Daniela Lera , Yaroslav D. Sergeyev

The effectiveness of collective navigation of biological or artificial agents requires to accommodate for contrasting requirements, such as staying in a group while avoiding close encounters and at the same time limiting the energy…

Statistical Mechanics · Physics 2021-08-06 Francesco Borra , Massimo Cencini , Antonio Celani

Gradient-based methods are widely used to solve various optimization problems, however, they are either constrained by local optima dilemmas, simple convex constraints, and continuous differentiability requirements, or limited to…

Machine Learning · Computer Science 2026-03-19 Ming Li

Feedback optimization has emerged as a promising approach for optimizing the steady-state operation of dynamical systems while requiring minimal modeling efforts. Unfortunately, most existing feedback optimization methods rely on knowledge…

Optimization and Control · Mathematics 2025-09-16 Amir Mehrnoosh , Gianluca Bianchin

Random Batch Methods (RBM) for mean-field interacting particle systems enable the reduction of the quadratic computational cost associated with particle interactions to a near-linear cost. The essence of these algorithms lies in the random…

Numerical Analysis · Mathematics 2024-01-02 Lorenzo Pareschi , Mattia Zanella

We introduce a derivative-free global optimization algorithm that efficiently computes minima for various classes of one-dimensional functions, including non-convex, and non-smooth functions.This algorithm numerically approximates the…

Optimization and Control · Mathematics 2023-08-21 Alexandra A. Gomes , Diogo A. Gomes

We consider the problem of maximizing an unknown function over a compact and convex set using as few observations as possible. We observe that the optimization of the function essentially relies on learning the induced bipartite ranking…

Machine Learning · Statistics 2017-03-08 Cédric Malherbe , Nicolas Vayatis

Gradient Symbolic Computation is proposed as a means of solving discrete global optimization problems using a neurally plausible continuous stochastic dynamical system. Gradient symbolic dynamics involves two free parameters that must be…

Computation and Language · Computer Science 2018-01-12 Paul Tupper , Paul Smolensky , Pyeong Whan Cho

Many computer vision applications involve modeling complex spatio-temporal patterns in high-dimensional motion data. Recently, restricted Boltzmann machines (RBMs) have been widely used to capture and represent spatial patterns in a single…

Computer Vision and Pattern Recognition · Computer Science 2017-10-24 Siqi Nie , Ziheng Wang , Qiang Ji

We present a hybrid Boltzmann-BGK model for inert mixtures, where each kind of binary interaction may be described by a classical Boltzmann integral or by a suitable relaxation-type operator. We allow also the possibility of changing the…

Mathematical Physics · Physics 2025-05-27 Marzia Bisi , Maria Groppi , Giorgio Martalò

We present a method to approximately solve general instances of combinatorial optimization problems using the physical dynamics of 3d rotors obeying Landau-Lifshitz-Gilbert dynamics. Conventional techniques to solve discrete optimization…

Disordered Systems and Neural Networks · Physics 2025-04-29 Dairong Chen , Andrew D. Kent , Dries Sels , Flaviano Morone

Fokker-Planck equations are extensively employed in various scientific fields as they characterise the behaviour of stochastic systems at the level of probability density functions. Although broadly used, they allow for analytical treatment…

Statistical Mechanics · Physics 2020-08-26 Dimitra Maoutsa , Sebastian Reich , Manfred Opper