A Bayesian Optimization through Sequential Monte Carlo and Statistical Physics-Inspired Techniques
Computation
2024-09-06 v1 Distributed, Parallel, and Cluster Computing
Data Analysis, Statistics and Probability
Abstract
In this paper, we propose an approach for an application of Bayesian optimization using Sequential Monte Carlo (SMC) and concepts from the statistical physics of classical systems. Our method leverages the power of modern machine learning libraries such as NumPyro and JAX, allowing us to perform Bayesian optimization on multiple platforms, including CPUs, GPUs, TPUs, and in parallel. Our approach enables a low entry level for exploration of the methods while maintaining high performance. We present a promising direction for developing more efficient and effective techniques for a wide range of optimization problems in diverse fields.
Cite
@article{arxiv.2409.03094,
title = {A Bayesian Optimization through Sequential Monte Carlo and Statistical Physics-Inspired Techniques},
author = {Anton Lebedev and Thomas Warford and M. Emre Şahin},
journal= {arXiv preprint arXiv:2409.03094},
year = {2024}
}
Comments
8 pages, 7 figures, accepted to the International Conference on Computer Science 2023