English
Related papers

Related papers: Decentralized High-Dimensional Bayesian Optimizati…

200 papers

There is significant interest in learning and optimizing a complex system composed of multiple sub-components, where these components may be agents or autonomous sensors. Among the rich literature on this topic, agent-based and…

Machine Learning · Computer Science 2021-07-08 Kai Wang , Bryan Wilder , Sze-chuan Suen , Bistra Dilkina , Milind Tambe

Bayesian optimization (BO) is a prominent approach to optimizing expensive-to-evaluate black-box functions. The massive computational capability of edge devices such as mobile phones, coupled with privacy concerns, has led to a surging…

Machine Learning · Computer Science 2020-10-23 Zhongxiang Dai , Kian Hsiang Low , Patrick Jaillet

Modeling heterogeneity by extraction and exploitation of high-order information from heterogeneous information networks (HINs) has been attracting immense research attention in recent times. Such heterogeneous network embedding (HNE)…

Machine Learning · Computer Science 2022-01-11 Mubashir Imran , Hongzhi Yin , Tong Chen , Zi Huang , Kai Zheng

Bayesian optimization (BO) is a popular framework to optimize black-box functions. In many applications, the objective function can be evaluated at multiple fidelities to enable a trade-off between the cost and accuracy. To reduce the…

Machine Learning · Computer Science 2020-12-11 Shibo Li , Wei Xing , Mike Kirby , Shandian Zhe

This paper studies the problem of performing a sequence of optimal interventions in a causal dynamical system where both the target variable of interest and the inputs evolve over time. This problem arises in a variety of domains e.g.…

Machine Learning · Statistics 2021-10-27 Virginia Aglietti , Neil Dhir , Javier González , Theodoros Damoulas

Bayesian Optimization (BO) is a surrogate-based global optimization strategy that relies on a Gaussian Process regression (GPR) model to approximate the objective function and an acquisition function to suggest candidate points. It is…

Machine Learning · Computer Science 2022-06-28 Kirill Antonov , Elena Raponi , Hao Wang , Carola Doerr

Existing score-based methods for directed acyclic graph (DAG) learning from observational data struggle to recover the causal graph accurately and sample-efficiently. To overcome this, in this study, we propose DrBO (DAG recovery via…

Machine Learning · Computer Science 2025-01-28 Bao Duong , Sunil Gupta , Thin Nguyen

Bayesian optimization (BO) algorithm is very popular for solving low-dimensional expensive optimization problems. Extending Bayesian optimization to high dimension is a meaningful but challenging task. One of the major challenges is that it…

Machine Learning · Computer Science 2025-01-13 Dawei Zhan

Higher-order brain connectivity (HOBC), which captures interactions among three or more brain regions, provides richer organizational information than traditional pairwise functional connectivity (FC). Recent studies have begun to infer…

Neurons and Cognition · Quantitative Biology 2025-12-30 Weibin Li , Wendu Li , Quanying Liu

In a previous work we introduced, in the context of gravitational wave science, an initial study on an automated domain-decomposition approach for reduced basis through hp-greedy refinement. The approach constructs local reduced bases of…

General Relativity and Quantum Cosmology · Physics 2023-10-24 Franco Cerino , Andrés Diaz-Pace , Emmanuel Tassone , Manuel Tiglio , Atuel Villegas

Given a Hyperparameter Optimization(HPO) problem, how to design an algorithm to find optimal configurations efficiently? Bayesian Optimization(BO) and the multi-fidelity BO methods employ surrogate models to sample configurations based on…

Machine Learning · Computer Science 2024-02-22 Yang Zhang , Haiyang Wu , Yuekui Yang

Bayesian optimization (BO) is a powerful paradigm for derivative-free global optimization of a black-box objective function (BOF) that is expensive to evaluate. However, the overhead of BO can still be prohibitive for problems with highly…

Machine Learning · Computer Science 2019-12-18 Bin Liu

Bayesian optimisation (BO) uses probabilistic surrogate models - usually Gaussian processes (GPs) - for the optimisation of expensive black-box functions. At each BO iteration, the GP hyperparameters are fit to previously-evaluated data by…

Machine Learning · Computer Science 2021-05-04 George De Ath , Richard Everson , Jonathan Fieldsend

Many real-world tasks require optimizing expensive black-box functions accessible only through noisy evaluations, a setting commonly addressed with Bayesian optimization (BO). While Bayesian neural networks (BNNs) have recently emerged as…

Machine Learning · Computer Science 2026-01-14 Farhad Mirkarimi

We consider derivative-free black-box global optimization of expensive noisy functions, when most of the randomness in the objective is produced by a few influential scalar random inputs. We present a new Bayesian global optimization…

Machine Learning · Computer Science 2016-02-23 Saul Toscano-Palmerin , Peter I. Frazier

Bayesian Optimization (BO) has shown great promise for the global optimization of functions that are expensive to evaluate, but despite many successes, standard approaches can struggle in high dimensions. To improve the performance of BO,…

Machine Learning · Computer Science 2022-06-17 Sebastian Ament , Carla Gomes

Federated Composite Optimization (FCO) has emerged as a promising framework for training models with structural constraints (e.g., sparsity) in distributed edge networks. However, simultaneously achieving communication efficiency and…

Optimization and Control · Mathematics 2026-03-10 Pu Qiu , Chen Ouyang , Yongyang Xiong , Keyou You , Wanquan Liu , Yang Shi

Hyperparameter optimization (HPO) is a critical component of machine learning pipelines, significantly affecting model robustness, stability, and generalization. However, HPO is often a time-consuming and computationally intensive task.…

Machine Learning · Computer Science 2025-03-10 Ruinan Wang , Ian Nabney , Mohammad Golbabaee

Multi-objective Bayesian optimization (MOBO) provides a principled framework for optimizing expensive black-box functions with multiple objectives. However, existing MOBO methods often struggle with coverage, scalability with respect to the…

Machine Learning · Computer Science 2026-04-20 Yaohong Yang , Sammie Katt , Samuel Kaski

This paper presents a decentralized algorithm for non-convex optimization over tree-structured networks. We assume that each node of this network can solve small-scale optimization problems and communicate approximate value functions with…

Optimization and Control · Mathematics 2020-11-02 Yuning Jiang , Dimitris Kouzoupis , Haoyu Yin , Moritz Diehl , Boris Houska
‹ Prev 1 3 4 5 6 7 10 Next ›