English
Related papers

Related papers: On the mean-field limit for the consensus-based op…

200 papers

This paper proposes a new mathematical paradigm to analyze discrete-time mean-field games. It is shown that finding Nash equilibrium solutions for a general class of discrete-time mean-field games is equivalent to solving an optimization…

Optimization and Control · Mathematics 2023-08-29 Xin Guo , Anran Hu , Junzi Zhang

Bayesian optimization (BO) is a model-based approach to sequentially optimize expensive black-box functions, such as the validation error of a deep neural network with respect to its hyperparameters. In many real-world scenarios, the…

Machine Learning · Statistics 2019-10-17 Valerio Perrone , Iaroslav Shcherbatyi , Rodolphe Jenatton , Cedric Archambeau , Matthias Seeger

Particle swam optimization (PSO) is a popular stochastic optimization method that has found wide applications in diverse fields. However, PSO suffers from high computational complexity and slow convergence speed. High computational…

Neural and Evolutionary Computing · Computer Science 2014-01-06 Muhammad Saqib Sohail , Muhammad Omer Bin Saeed , Syed Zeeshan Rizvi , Mobien Shoaib , Asrar Ul Haq Sheikh

We consider mean-field models for data--clustering problems starting from a generalization of the bounded confidence model for opinion dynamics. The microscopic model includes information on the position as well as on additional features of…

Numerical Analysis · Mathematics 2020-03-16 Michael Herty , Lorenzo Pareschi , Giuseppe Visconti

The particle swarm approach provides a low complexity solution to the optimization problem among various existing heuristic algorithms. Recent advances in the algorithm resulted in improved performance at the cost of increased computational…

Neural and Evolutionary Computing · Computer Science 2013-04-16 Muhammad Omer Bin Saeed , Muhammad Saqib Sohail , Syed Zeeshan Rizvi , Mobien Shoaib , Asrar Ul Haq Sheikh

This paper describes a general-purpose extension of max-value entropy search, a popular approach for Bayesian Optimisation (BO). A novel approximation is proposed for the information gain -- an information-theoretic quantity central to…

Machine Learning · Computer Science 2021-10-27 Henry B. Moss , David S. Leslie , Javier Gonzalez , Paul Rayson

Traditional methods present a very restrictive range of applications, mainly limited by the features of the function to be optimized and of the constraint functions. In contrast, evolutionary algorithms present almost no restriction to the…

Neural and Evolutionary Computing · Computer Science 2021-01-26 Mauro S. Innocente , Johann Sienz

In this paper, we study the conditional stochastic optimization (CSO) problem which covers a variety of applications including portfolio selection, reinforcement learning, robust learning, causal inference, etc. The sample-averaged gradient…

Machine Learning · Computer Science 2023-12-05 Lie He , Shiva Prasad Kasiviswanathan

We develop qubit Hamiltonian single parameter estimation techniques using a Bayesian approach. The algorithms considered are restricted to projective measurements in a fixed basis, and are derived under the assumption that the qubit…

Quantum Physics · Physics 2012-10-17 Alexandr Sergeevich , Stephen D. Bartlett

In many high-throughput experimental design settings, such as those common in biochemical engineering, batched queries are more cost effective than one-by-one sequential queries. Furthermore, it is often not possible to directly choose…

Machine Learning · Computer Science 2019-04-18 Kevin K. Yang , Yuxin Chen , Alycia Lee , Yisong Yue

Bayesian optimization (BO) is a popular approach for sample-efficient optimization of black-box objective functions. While BO has been successfully applied to a wide range of scientific applications, traditional approaches to…

Machine Learning · Computer Science 2023-05-04 Natalie Maus , Kaiwen Wu , David Eriksson , Jacob Gardner

The theoretical analysis of spectral clustering mainly focuses on consistency, while there is relatively little research on its generalization performance. In this paper, we study the excess risk bounds of the popular spectral clustering…

Machine Learning · Computer Science 2022-07-19 Shaojie Li , Sheng Ouyang , Yong Liu

We propose an algorithm inspired by optical coherent Ising machines to solve the problem of polynomial unconstrained binary optimization (PUBO). We benchmark the proposed algorithm against existing PUBO algorithms on the extended…

The present study aimed to solve the cure optimization problem of laminated composites through a statistical approach. The approach consisted of using constrained Bayesian Optimization (cBO) along with a Gaussian process model as a…

Applications · Statistics 2025-06-02 Madhura Limaye , Yezhuo Li , Qiong Zhang , Gang Li

We prove a lower bound for the modulus of the amplitude for a two-body process at large scattering angle. This is based on the interplay of the analyticity of the amplitude and the positivity properties of its absorptive part. The…

High Energy Physics - Theory · Physics 2019-07-03 Henri Epstein , André Martin

The Evidence Lower Bound (ELBO) is a quantity that plays a key role in variational inference. It can also be used as a criterion in model selection. However, though extremely popular in practice in the variational Bayes community, there has…

Statistics Theory · Mathematics 2019-04-09 Badr-Eddine Chérief-Abdellatif

This short paper presents a work on the design of low noise microwave amplifiers using particle swarm optimization (PSO) technique. Particle Swarm Optimization is used as a method that is applied to a single stage amplifier circuit to meet…

Neural and Evolutionary Computing · Computer Science 2012-08-31 Sadik Ulker

Particle swarm optimization (PSO) is a search algorithm based on stochastic and population-based adaptive optimization. In this paper, a pathfinding strategy is proposed to improve the efficiency of path planning for a broad range of…

Neural and Evolutionary Computing · Computer Science 2022-06-24 David , Budi Adiperdana

To devise efficient solutions for approximating a mean partition in consensus clustering, Dimitriadou et al. [3] presented a necessary condition of optimality for a consensus function based on least square distances. We show that their…

Machine Learning · Computer Science 2016-04-27 Brijnesh J. Jain

In this paper we study the continuous coagulation and multiple fragmentation equation for the mean-field description of a system of particles taking into account the combined effect of the coagulation and the fragmentation processes in…

Analysis of PDEs · Mathematics 2018-11-16 Prasanta Kumar Barik