English
Related papers

Related papers: A Nested Weighted Tchebycheff Multi-Objective Baye…

200 papers

Bayesian optimization is widely employed for optimizing complex black-box functions but struggles with the curse of dimensionality. Random embedding, as a dimension reduction strategy, simplifies tasks that possess the effective dimension…

Machine Learning · Computer Science 2026-05-26 Hong Qian , Xiang Shu , Xiang Xia , Xuhui Liu , Yangde Fu , Bei Liang , Huibin Wang , Liang Dou

Model selection is an integral problem of model based optimization techniques such as Bayesian optimization (BO). Current approaches often treat model selection as an estimation problem, to be periodically updated with observations coming…

Machine Learning · Computer Science 2023-08-02 Manisha Senadeera , Santu Rana , Sunil Gupta , Svetha Venkatesh

Bayesian optimization (BO) offers an efficient pipeline for optimizing black-box functions with the help of a Gaussian process prior and an acquisition function (AF). Recently, in the context of single-objective BO, learning-based AFs…

Machine Learning · Computer Science 2025-05-30 Yu-Heng Hung , Kai-Jie Lin , Yu-Heng Lin , Chien-Yi Wang , Cheng Sun , Ping-Chun Hsieh

Bayesian optimization (BO) is a popular method to optimize costly black-box functions. While traditional BO optimizes each new target task from scratch, meta-learning has emerged as a way to leverage knowledge from related tasks to optimize…

Machine Learning · Computer Science 2024-07-01 Jiarong Pan , Stefan Falkner , Felix Berkenkamp , Joaquin Vanschoren

We study multi-robot persistent monitoring on weighted graphs, where node weights encode monitoring priorities and edge weights encode travel distances. The goal is to design joint robot trajectories that minimize the worst-case weighted…

Robotics · Computer Science 2026-05-12 Weizhen Wang , Ziheng Wang , Jianping He , Xinping Guan , Xiaoming Duan

Optimization of high-dimensional black-box functions is an extremely challenging problem. While Bayesian optimization has emerged as a popular approach for optimizing black-box functions, its applicability has been limited to…

Machine Learning · Statistics 2018-08-06 Zi Wang , Chengtao Li , Stefanie Jegelka , Pushmeet Kohli

Bayesian optimization (BO) is a sample-efficient approach for tuning design parameters to optimize expensive-to-evaluate, black-box performance metrics. In many manufacturing processes, the design parameters are subject to random input…

Machine Learning · Computer Science 2022-06-06 Samuel Daulton , Sait Cakmak , Maximilian Balandat , Michael A. Osborne , Enlu Zhou , Eytan Bakshy

A multiple objective simulation optimization algorithm named Multiple Objective Probabilistic Branch and Bound with Single Observation (MOPBnB(so)) is presented for approximating the Pareto optimal set and the associated efficient frontier…

Optimization and Control · Mathematics 2025-06-06 Hao Huang , Zelda B. Zabinsky

In this article, we introduce the concept of model confidence bounds (MCB) for variable selection in the context of nested models. Similarly to the endpoints in the familiar confidence interval for parameter estimation, the MCB identifies…

Methodology · Statistics 2018-07-27 Yang Li , Yuetian Luo , Davide Ferrari , Xiaonan Hu , Yichen Qin

We consider the optimization of an uncertain objective over continuous and multi-dimensional decision spaces in problems in which we are only provided with observational data. We propose a novel algorithmic framework that is tractable,…

Machine Learning · Statistics 2018-10-30 Dimitris Bertsimas , Christopher McCord

Many black-box optimization tasks arising in high-stakes applications require risk-averse decisions. The standard Bayesian optimization (BO) paradigm, however, optimizes the expected value only. We generalize BO to trade mean and…

Machine Learning · Computer Science 2021-11-10 Anastasiia Makarova , Ilnura Usmanova , Ilija Bogunovic , Andreas Krause

Extreme value theory (EVT) is well suited to model extreme events, such as floods, heatwaves, or mechanical failures, which is required for reliability assessment of systems across multiple domains for risk management and loss prevention.…

Applications · Statistics 2025-10-15 Shehzaib Irfan , Nabeel Ahmad , Alexander Vinel , Daniel F. Silva , Shuai Shao , Nima Shamsaei , Jia Liu

Bayesian optimization (BO) has gained attention as an efficient algorithm for black-box optimization of expensive-to-evaluate systems, where the BO algorithm iteratively queries the system and suggests new trials based on a probabilistic…

Machine Learning · Computer Science 2026-03-13 Eike Cramer , Luis Kutschat , Oliver Stollenwerk , Joel A. Paulson , Alexander Mitsos

Bayesian optimization (BO) is a popular framework to optimize black-box functions. In many applications, the objective function can be evaluated at multiple fidelities to enable a trade-off between the cost and accuracy. To reduce the…

Machine Learning · Computer Science 2020-12-11 Shibo Li , Wei Xing , Mike Kirby , Shandian Zhe

Bayesian optimization is a popular black-box optimization method for parameter learning in control and robotics. It typically requires an objective function that reflects the user's optimization goal. However, in practical applications,…

Robotics · Computer Science 2026-04-03 Johanna Menn , David Stenger , Sebastian Trimpe

Two non-intrusive uncertainty propagation approaches are proposed for the performance analysis of engineering systems described by expensive-to-evaluate deterministic computer models with parameters defined as interval variables. These…

Signal Processing · Electrical Eng. & Systems 2022-02-15 Alice Cicirello , Filippo Giunta

Bayesian optimization is widely used for hyperparameter optimization when model evaluations are expensive; however, noisy acquisition estimates can lead to unstable decisions. We identify acquisition estimation noise as a failure mode that…

Machine Learning · Computer Science 2026-05-08 Maresa Schröder , Pascal Janetzky , Michael Klar , Stefan Feuerriegel

Various real-world scientific applications involve the mathematical modeling of complex uncertain systems with numerous unknown parameters. Accurate parameter estimation is often practically infeasible in such systems, as the available…

Machine Learning · Computer Science 2023-04-12 Qihua Chen , Xuejin Chen , Hyun-Myung Woo , Byung-Jun Yoon

Bayesian quadrature optimization (BQO) maximizes the expectation of an expensive black-box integrand taken over a known probability distribution. In this work, we study BQO under distributional uncertainty in which the underlying…

Machine Learning · Computer Science 2020-01-22 Thanh Tang Nguyen , Sunil Gupta , Huong Ha , Santu Rana , Svetha Venkatesh

Bayesian Optimization (BO) is a method for globally optimizing black-box functions. While BO has been successfully applied to many scenarios, developing effective BO algorithms that scale to functions with high-dimensional domains is still…

Machine Learning · Computer Science 2024-02-13 Yihang Shen , Carl Kingsford