中文
相关论文

相关论文: Decentralized High-Dimensional Bayesian Optimizati…

200 篇论文

Recent advances have extended the scope of Bayesian optimization (BO) to expensive-to-evaluate black-box functions with dozens of dimensions, aspiring to unlock impactful applications, for example, in the life sciences, neural architecture…

机器学习 · 计算机科学 2026-05-15 Leonard Papenmeier , Luigi Nardi , Matthias Poloczek

Gaussian process (GP) based Bayesian optimization (BO) is a powerful method for optimizing black-box functions efficiently. The practical performance and theoretical guarantees of this approach depend on having the correct GP hyperparameter…

机器学习 · 统计学 2024-06-07 Huong Ha , Vu Nguyen , Hung Tran-The , Hongyu Zhang , Xiuzhen Zhang , Anton van den Hengel

Bayesian Optimization (BO) has been recognized for its effectiveness in optimizing expensive and complex objective functions. Recent advancements in Latent Bayesian Optimization (LBO) have shown promise by integrating generative models such…

机器学习 · 计算机科学 2025-04-22 Seunghun Lee , Jinyoung Park , Jaewon Chu , Minseo Yoon , Hyunwoo J. Kim

Bayesian optimization (BO) has recently been extended to the federated learning (FL) setting by the federated Thompson sampling (FTS) algorithm, which has promising applications such as federated hyperparameter tuning. However, FTS is not…

机器学习 · 计算机科学 2021-10-28 Zhongxiang Dai , Bryan Kian Hsiang Low , Patrick Jaillet

Distributed Optimization is an increasingly important subject area with the rise of multi-agent control and optimization. We consider a decentralized stochastic optimization problem where the agents on a graph aim to asynchronously optimize…

最优化与控制 · 数学 2021-10-22 Vyacheslav Kungurtsev , Mahdi Morafah , Tara Javidi , Gesualdo Scutari

Bayesian Optimization (BO) is an effective framework for globally optimizing functions whose evaluations are expensive. It is particularly effective for optimizing functions defined over continuous domains and explicitly handles stochastic…

计算工程、金融与科学 · 计算机科学 2026-05-21 Buqing Ou , Frederike Dümbgen

In this paper, we study the (decentralized) distributed optimization problem with high-dimensional sparse structure. Building upon the FedDA algorithm, we propose a (Decentralized) FedDA-GT algorithm, which combines the \textbf{gradient…

最优化与控制 · 数学 2023-12-12 Jiadong Liang , Yang Peng , Zhihua Zhang

High-dimensional Bayesian Optimization (BO) has attracted significant attention in recent research. However, existing methods have mainly focused on optimizing in continuous domains, while combinatorial (ordinal and categorical) and mixed…

机器学习 · 统计学 2025-08-26 Lam Ngo , Huong Ha , Jeffrey Chan , Hongyu Zhang

In this paper we study consensus-based optimization (CBO), a versatile, flexible and customizable optimization method suitable for performing nonconvex and nonsmooth global optimizations in high dimensions. CBO is a multi-particle…

数值分析 · 数学 2026-05-28 Konstantin Riedl

Automated hyperparameter optimization (HPO) can support practitioners to obtain peak performance in machine learning models. However, there is often a lack of valuable insights into the effects of different hyperparameters on the final…

机器学习 · 计算机科学 2022-01-27 Julia Moosbauer , Julia Herbinger , Giuseppe Casalicchio , Marius Lindauer , Bernd Bischl

Bayesian optimization (BO) is a popular approach for expensive black-box optimization, with applications including parameter tuning, experimental design, robotics. BO usually models the objective function by a Gaussian process (GP), and…

机器学习 · 统计学 2020-01-22 Chao Qian , Hang Xiong , Ke Xue

Hypervolume (HV)-based Bayesian optimization (BO) is one of the standard approaches for multi-objective decision-making. However, the computational cost of optimizing the acquisition function remains a significant bottleneck, primarily due…

机器学习 · 计算机科学 2025-12-08 Shuhei Watanabe

Variational Autoencoder based Bayesian Optimization (VAE-BO) has demonstrated its excellent performance in addressing high-dimensional structured optimization problems. However, current mainstream methods overlook the potential of utilizing…

机器学习 · 计算机科学 2023-12-29 Taicai Chen , Yue Duan , Dong Li , Lei Qi , Yinghuan Shi , Yang Gao

Learning decompositions of expensive-to-evaluate black-box functions promises to scale Bayesian optimisation (BO) to high-dimensional problems. However, the success of these techniques depends on finding proper decompositions that…

机器学习 · 计算机科学 2023-05-30 Juliusz Ziomek , Haitham Bou-Ammar

Bayesian Optimization (BO) is a well-studied hyperparameter tuning technique that is more efficient than grid search for high-cost, high-parameter machine learning problems. Echocardiography is a ubiquitous modality for evaluating heart…

图像与视频处理 · 电气工程与系统科学 2022-11-21 Son-Tung Tran , Joshua V. Stough , Xiaoyan Zhang , Christopher M. Haggerty

Bayesian Optimization (BO) is a common approach for hyperparameter optimization (HPO) in automated machine learning. Although it is well-accepted that HPO is crucial to obtain well-performing machine learning models, tuning BO's own…

机器学习 · 计算机科学 2019-08-20 Marius Lindauer , Matthias Feurer , Katharina Eggensperger , André Biedenkapp , Frank Hutter

Mobility management in dense cellular networks is challenging due to varying user speeds and deployment conditions. Traditional 3GPP handover (HO) schemes, relying on fixed A3-offset and time-to-trigger (TTT) parameters, struggle to balance…

信息论 · 计算机科学 2025-04-10 Mohamed Benzaghta , Sahar Ammar , David López-Pérez , Basem Shihada , Giovanni Geraci

Bayesian optimization (BO) is an efficient framework for optimizing expensive black-box functions. However, it is typically formulated as learning an end-to-end mapping from inputs to scalar objectives, thereby discarding the potentially…

机器学习 · 计算机科学 2026-05-12 Wenbin Wang , Colin N. Jones

We study decentralized optimization where multiple agents minimize the average of their (strongly) convex, smooth losses over a communication graph. Convergence of the existing decentralized methods generally hinges on an apriori, proper…

最优化与控制 · 数学 2025-08-01 Ilya Kuruzov , Xiaokai Chen , Gesualdo Scutari , Alexander Gasnikov

Federated learning performed by a decentralized networks of agents is becoming increasingly important with the prevalence of embedded software on autonomous devices. Bayesian approaches to learning benefit from offering more information as…

机器学习 · 计算机科学 2021-07-16 Vyacheslav Kungurtsev , Adam Cobb , Tara Javidi , Brian Jalaian