中文
相关论文

相关论文: Improved Max-value Entropy Search for Multi-object…

200 篇论文

Information-theoretic Bayesian optimization techniques have become popular for optimizing expensive-to-evaluate black-box functions due to their non-myopic qualities. Entropy Search and Predictive Entropy Search both consider the entropy…

机器学习 · 计算机科学 2023-01-18 Carl Hvarfner , Frank Hutter , Luigi Nardi

We consider the problem of multi-objective (MO) blackbox optimization using expensive function evaluations, where the goal is to approximate the true Pareto set of solutions while minimizing the number of function evaluations. For example,…

机器学习 · 计算机科学 2022-04-13 Syrine Belakaria , Aryan Deshwal , Nitthilan Kannappan Jayakodi , Janardhan Rao Doppa

We propose MUMBO, the first high-performing yet computationally efficient acquisition function for multi-task Bayesian optimization. Here, the challenge is to perform efficient optimization by evaluating low-cost functions somehow related…

机器学习 · 计算机科学 2020-06-23 Henry B. Moss , David S. Leslie , Paul Rayson

Classifiers are often utilized in time-constrained settings where labels must be assigned to inputs quickly. To address these scenarios, budgeted multi-stage classifiers (MSC) process inputs through a sequence of partial feature acquisition…

神经与进化计算 · 计算机科学 2021-12-06 Nolan H. Hamilton , Errin W. Fulp

Although the existing max-value entropy search (MES) is based on the widely celebrated notion of mutual information, its empirical performance can suffer due to two misconceptions whose implications on the exploration-exploitation trade-off…

机器学习 · 计算机科学 2022-03-01 Quoc Phong Nguyen , Bryan Kian Hsiang Low , Patrick Jaillet

Bayesian Optimization (BO) is a powerful tool for optimizing expensive black-box objective functions. While extensive research has been conducted on the single-objective optimization problem, the multi-objective optimization problem remains…

机器学习 · 计算机科学 2025-10-27 Lam Ngo , Huong Ha , Jeffrey Chan , Hongyu Zhang

We present a novel adaptive optimization algorithm for black-box multi-objective optimization problems with binary constraints on the foundation of Bayes optimization. Our method is based on probabilistic regression and classification…

机器学习 · 统计学 2021-03-01 Raoul Heese , Michael Bortz

Many real-world applications involve black-box optimization of multiple objectives using continuous function approximations that trade-off accuracy and resource cost of evaluation. For example, in rocket launching research, we need to find…

机器学习 · 统计学 2020-11-24 Syrine Belakaria , Aryan Deshwal , Janardhan Rao Doppa

This paper addresses the problem of constrained multi-objective optimization over black-box objective functions with practitioner-specified preferences over the objectives when a large fraction of the input space is infeasible (i.e.,…

机器学习 · 计算机科学 2023-03-24 Alaleh Ahmadianshalchi , Syrine Belakaria , Janardhan Rao Doppa

Many-objective optimisation, a subset of multi-objective optimisation, involves optimisation problems with more than three objectives. As the number of objectives increases, the number of solutions needed to adequately represent the entire…

人工智能 · 计算机科学 2026-04-13 Chao Jiang , Jingyu Huang , Miqing Li

Information-based Bayesian optimization (BO) algorithms have achieved state-of-the-art performance in optimizing a black-box objective function. However, they usually require several approximations or simplifying assumptions (without…

机器学习 · 计算机科学 2021-08-02 Quoc Phong Nguyen , Zhaoxuan Wu , Bryan Kian Hsiang Low , Patrick Jaillet

There are a lot of real-world black-box optimization problems that need to optimize multiple criteria simultaneously. However, in a multi-objective optimization (MOO) problem, identifying the whole Pareto front requires the prohibitive…

Multi-objective Bayesian optimization has been widely adopted in scientific experiment design, including drug discovery and hyperparameter optimization. In practice, regulatory or safety concerns often impose additional thresholds on…

机器学习 · 计算机科学 2025-04-22 Diantong Li , Fengxue Zhang , Chong Liu , Yuxin Chen

Recent advances in computationally efficient non-myopic Bayesian optimization (BO) improve query efficiency over traditional myopic methods like expected improvement while only modestly increasing computational cost. These advances have…

机器学习 · 统计学 2021-12-07 Yunxiang Zhang , Xiangyu Zhang , Peter I. Frazier

Bayesian optimization is a promising methodology for analog circuit synthesis. However, the sequential nature of the Bayesian optimization framework significantly limits its ability to fully utilize real-world computational resources. In…

机器学习 · 计算机科学 2021-06-30 Shuhan Zhang , Fan Yang , Changhao Yan , Dian Zhou , Xuan Zeng

This study considers multi-objective Bayesian optimization (MOBO) through the information gain of the Pareto-frontier. To calculate the information gain, a predictive distribution conditioned on the Pareto-frontier plays a key role, which…

机器学习 · 计算机科学 2025-09-04 Masanori Ishikura , Masayuki Karasuyama

Multi-Source Bayesian Optimization (MSBO) serves as a variant of the traditional Bayesian Optimization (BO) framework applicable to situations involving optimization of an objective black-box function over multiple information sources such…

机器学习 · 计算机科学 2026-02-17 Luuk Jacobs , Mohammad Ali Javidian

Optimizing multiple competing black-box objectives is a challenging problem in many fields, including science, engineering, and machine learning. Multi-objective Bayesian optimization (MOBO) is a sample-efficient approach for identifying…

机器学习 · 计算机科学 2021-10-28 Samuel Daulton , Maximilian Balandat , Eytan Bakshy

Bayesian optimization (BO) is an efficient framework for solving black-box optimization problems with expensive function evaluations. This paper addresses the BO problem setting for combinatorial spaces (e.g., sequences and graphs) that…

机器学习 · 计算机科学 2022-02-07 Aryan Deshwal , Syrine Belakaria , Janardhan Rao Doppa

We propose a novel information-theoretic approach for Bayesian optimization called Predictive Entropy Search (PES). At each iteration, PES selects the next evaluation point that maximizes the expected information gained with respect to the…

机器学习 · 统计学 2014-06-11 José Miguel Hernández-Lobato , Matthew W. Hoffman , Zoubin Ghahramani