English
Related papers

Related papers: Parallel and Distributed Thompson Sampling for Lar…

200 papers

We present Acquisition Thompson Sampling (ATS), a novel technique for batch Bayesian Optimization (BO) based on the idea of sampling multiple acquisition functions from a stochastic process. We define this process through the dependency of…

Machine Learning · Computer Science 2019-10-18 Alessandro De Palma , Celestine Mendler-Dünner , Thomas Parnell , Andreea Anghel , Haralampos Pozidis

The optimization of yields in multi-reactor systems, which are advanced tools in heterogeneous catalysis research, presents a significant challenge due to hierarchical technical constraints. To this respect, this work introduces a novel…

Machine Learning · Computer Science 2024-08-06 Markus Grimm , Sébastien Paul , Pierre Chainais

In Bayesian optimization, Thompson sampling selects the evaluation point by sampling from the posterior distribution over the objective function maximizer. Because this sampling problem is intractable for Gaussian process (GP) surrogates,…

Machine Learning · Computer Science 2026-04-13 Donney Fan , Geoff Pleiss

Bayesian optimization (BO) is a promising approach for hyperparameter optimization of deep neural networks (DNNs), where each model training can take minutes to hours. In BO, a computationally cheap surrogate model is employed to learn the…

Machine Learning · Computer Science 2023-09-27 Romain Egele , Isabelle Guyon , Venkatram Vishwanath , Prasanna Balaprakash

Stochastic, spatial reaction-diffusion simulations have been widely used in systems biology and computational neuroscience. However, the increasing scale and complexity of simulated models and morphologies have exceeded the capacity of any…

Quantitative Methods · Quantitative Biology 2016-10-10 Weiliang Chen , Erik De Schutter

Coupled cluster theory is a vital cornerstone of electronic structure theory and is being applied to ever-larger systems. Stochastic approaches to quantum chemistry have grown in importance and offer compelling advantages over traditional…

Bayesian optimization (BO) is a prominent approach to optimizing expensive-to-evaluate black-box functions. The massive computational capability of edge devices such as mobile phones, coupled with privacy concerns, has led to a surging…

Machine Learning · Computer Science 2020-10-23 Zhongxiang Dai , Kian Hsiang Low , Patrick Jaillet

The frequent elements problem, a key component in demanding stream-data analytics, involves selecting elements whose occurrence exceeds a user-specified threshold. Fast, memory-efficient $\epsilon$-approximate synopsis algorithms select all…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-04 Victor Jarlow , Charalampos Stylianopoulos , Marina Papatriantafilou

Molecular property optimization (MPO) problems are inherently challenging since they are formulated over discrete, unstructured spaces and the labeling process involves expensive simulations or experiments, which fundamentally limits the…

Biomolecules · Quantitative Biology 2024-01-04 Farshud Sorourifar , Thomas Banker , Joel A. Paulson

Bayesian Optimal Experimental Design (BOED) is a powerful tool to reduce the cost of running a sequence of experiments. When based on the Expected Information Gain (EIG), design optimization corresponds to the maximization of some…

Machine Learning · Statistics 2025-03-14 Jacopo Iollo , Christophe Heinkelé , Pierre Alliez , Florence Forbes

Bayesian optimization (BO) is a flexible and powerful framework that is suitable for computationally expensive simulation-based applications and guarantees statistical convergence to the global optimum. While remaining as one of the most…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-16 Anh Tran

Bayesian Optimization (BO) has been widely applied to optimize expensive black-box functions while retaining sample efficiency. However, scaling BO to high-dimensional spaces remains challenging. Existing literature proposes performing…

Machine Learning · Computer Science 2025-08-27 Quanlin Chen , Yiyu Chen , Jing Huo , Tianyu Ding , Yang Gao , Yuetong Chen

Preferential Bayesian optimization (PBO) is a framework for optimizing a decision-maker's latent preferences over available design choices. While preferences often involve multiple conflicting objectives, existing work in PBO assumes that…

Machine Learning · Computer Science 2024-06-24 Raul Astudillo , Kejun Li , Maegan Tucker , Chu Xin Cheng , Aaron D. Ames , Yisong Yue

Compared with random sampling, low-discrepancy sampling is more effective in covering the search space. However, the existing research cannot definitely state whether the impact of a low-discrepancy sample on particle swarm optimization…

Neural and Evolutionary Computing · Computer Science 2023-07-04 Feng Wu , Yuelin Zhao , Jianhua Pang , Jun Yan , Wanxie Zhong

Bayesian optimization (BO) is a powerful framework for estimating parameters of expensive simulation models, particularly in settings where the likelihood is intractable and evaluations are costly. In stochastic models every simulation is…

Bayesian inference is useful to obtain a predictive distribution with a small generalization error. However, since posterior distributions are rarely evaluated analytically, we employ the variational Bayesian inference or sampling method to…

Machine Learning · Computer Science 2025-09-03 Yohei Saito , Shun Kimura , Koujin Takeda

Sequential optimization methods are often confronted with the curse of dimensionality in high-dimensional spaces. Current approaches under the Gaussian process framework are still burdened by the computational complexity of tracking…

Machine Learning · Computer Science 2024-01-08 Zeji Yi , Yunyue Wei , Chu Xin Cheng , Kaibo He , Yanan Sui

We study the problem of performing automated experiment design for drug screening through Bayesian inference and optimisation. In particular, we compare and contrast the behaviour of linear-Gaussian models and Gaussian processes, when used…

Machine Learning · Computer Science 2021-05-11 Hannes Eriksson , Christos Dimitrakakis , Lars Carlsson

Thompson Sampling (TS) from Gaussian Process (GP) models is a powerful tool for the optimization of black-box functions. Although TS enjoys strong theoretical guarantees and convincing empirical performance, it incurs a large computational…

Machine Learning · Statistics 2021-11-08 Sattar Vakili , Henry Moss , Artem Artemev , Vincent Dutordoir , Victor Picheny

A novel parallel efficiency analysis on a framework for simulating the growth of Malignant Pleural Mesothelioma (MPM) tumours is presented. Proliferation of MPM tumours in the pleural space is simulated using a Cellular Potts Model (CPM)…

Computational Engineering, Finance, and Science · Computer Science 2025-05-07 Anton Dolganov , Valeria Krzhizhanovskaya , Stefano Trebeschi , Vivek M. Sheraton