中文
相关论文

相关论文: Scalable3-BO: Big Data meets HPC - A scalable asyn…

200 篇论文

Bayesian Optimization (BO) is a sample-efficient optimization algorithm widely employed across various applications. In some challenging BO tasks, input uncertainty arises due to the inevitable randomness in the optimization process, such…

机器学习 · 计算机科学 2023-11-07 Lin Yang , Junlong Lyu , Wenlong Lyu , Zhitang Chen

We design and analyse variations of the classical Thompson sampling (TS) procedure for Bayesian optimisation (BO) in settings where function evaluations are expensive, but can be performed in parallel. Our theoretical analysis shows that a…

机器学习 · 统计学 2017-05-26 Kirthevasan Kandasamy , Akshay Krishnamurthy , Jeff Schneider , Barnabas Poczos

With continued advances in Geographic Information Systems and related computational technologies, statisticians are often required to analyze very large spatial datasets. This has generated substantial interest over the last decade, already…

统计方法学 · 统计学 2019-05-14 Lu Zhang , Abhirup Datta , Sudipto Banerjee

Bayesian Optimization (BO) has shown promise in tuning processor design parameters. However, standard BO does not support constraints involving categorical parameters such as types of branch predictors and division circuits. In addition,…

硬件体系结构 · 计算机科学 2025-06-10 Haoran Wu , Ce Guo , Wayne Luk , Robert Mullins

Most research in Bayesian optimization (BO) has focused on \emph{direct feedback} scenarios, where one has access to exact values of some expensive-to-evaluate objective. This direction has been mainly driven by the use of BO in machine…

We consider the problem of optimizing expensive black-box functions over high-dimensional combinatorial spaces which arises in many science, engineering, and ML applications. We use Bayesian Optimization (BO) and propose a novel surrogate…

The exploration of novel architectures requires physics-based simulation due to a lack of prior experience to start from, which introduces two specific challenges for optimization algorithms: evaluations become more expensive (in time) and…

机器学习 · 计算机科学 2025-04-14 Jasper Bussemaker , Paul Saves , Nathalie Bartoli , Thierry Lefebvre , Björn Nagel

Multi-objective Bayesian optimization (MOBO) provides a principled framework for optimizing expensive black-box functions with multiple objectives. However, existing MOBO methods often struggle with coverage, scalability with respect to the…

机器学习 · 计算机科学 2026-04-20 Yaohong Yang , Sammie Katt , Samuel Kaski

We propose an adaptive optimisation approach for tuning stochastic model predictive control (MPC) hyper-parameters while jointly estimating probability distributions of the transition model parameters based on performance rewards. In…

机器人学 · 计算机科学 2022-06-02 Rel Guzman , Rafael Oliveira , Fabio Ramos

A long-standing belief holds that Bayesian Optimization (BO) with standard Gaussian processes (GP) -- referred to as standard BO -- underperforms in high-dimensional optimization problems. While this belief seems plausible, it lacks both…

机器学习 · 计算机科学 2025-03-12 Zhitong Xu , Haitao Wang , Jeff M Phillips , Shandian Zhe

We develop a fast and scalable computational framework to solve large-scale and high-dimensional Bayesian optimal experimental design problems. In particular, we consider the problem of optimal observation sensor placement for Bayesian…

数值分析 · 数学 2020-11-09 Keyi Wu , Peng Chen , Omar Ghattas

Given a Hyperparameter Optimization(HPO) problem, how to design an algorithm to find optimal configurations efficiently? Bayesian Optimization(BO) and the multi-fidelity BO methods employ surrogate models to sample configurations based on…

机器学习 · 计算机科学 2024-02-22 Yang Zhang , Haiyang Wu , Yuekui Yang

Bayesian optimization (BO) is a model-based approach to sequentially optimize expensive black-box functions, such as the validation error of a deep neural network with respect to its hyperparameters. In many real-world scenarios, the…

Bayesian optimization (BO) is a popular, sample-efficient technique for expensive, black-box optimization. One such problem arising in manufacturing is that of maximizing the reliability, or equivalently minimizing the probability of a…

机器学习 · 计算机科学 2026-02-03 Jack M. Buckingham , Ivo Couckuyt , Juergen Branke

Efficient optimization of molecules with targeted properties remains a significant challenge due to the vast size and discrete nature of chemical compound space. Conventional machine-learning-based optimization approaches typically require…

化学物理 · 物理学 2026-03-04 Yun-Wen Mao , Roman V. Krems

In decision-making problems, the outcome of an intervention often depends on the causal relationships between system components and is highly costly to evaluate. In such settings, causal Bayesian optimization (CBO) can exploit the causal…

机器学习 · 统计学 2025-02-21 Shriya Bhatija , Paul-David Zuercher , Jakob Thumm , Thomas Bohné

Bayesian Optimization (BO) is a popular framework for optimizing black-box functions. Despite its effectiveness, BO is often inefficient for high-dimensional problems due to the exponential growth of the search space, heterogeneity of the…

最优化与控制 · 数学 2026-05-08 Sourav Das , Debjani Chakraborty , Pabitra Mitra

Bayesian Optimization (BO) is an effective framework for globally optimizing functions whose evaluations are expensive. It is particularly effective for optimizing functions defined over continuous domains and explicitly handles stochastic…

计算工程、金融与科学 · 计算机科学 2026-05-21 Buqing Ou , Frederike Dümbgen

Bayesian optimisation (BO) is a well-known efficient algorithm for finding the global optimum of expensive, black-box functions. The current practical BO algorithms have regret bounds ranging from $\mathcal{O}(\frac{logN}{\sqrt{N}})$ to…

机器学习 · 计算机科学 2026-04-28 Hung Tran-The , Sunil Gupta , Santu Rana , Svetha Venkatesh

Estimation of Distribution Algorithms have been proposed as a new paradigm for evolutionary optimization. This paper focuses on the parallelization of Estimation of Distribution Algorithms. More specifically, the paper discusses how to…

神经与进化计算 · 计算机科学 2007-05-23 Jiri Ocenasek , Martin Pelikan