中文
相关论文

相关论文: Information-Theoretic Bayesian Optimization for Bi…

200 篇论文

Bayesian optimization (BO) is an efficient method for optimizing expensive black-box functions. In real-world applications, BO often faces a major problem of missing values in inputs. The missing inputs can happen in two cases. First, the…

机器学习 · 计算机科学 2020-06-22 Phuc Luong , Dang Nguyen , Sunil Gupta , Santu Rana , Svetha Venkatesh

Bilevel optimization (BLO) offers a principled framework for hierarchical decision-making and has been widely applied in machine learning tasks such as hyperparameter optimization and meta-learning. While existing BLO methods are mostly…

最优化与控制 · 数学 2025-10-20 Zhuo Chen , Xinjian Xu , Shihui Ying , Tieyong Zeng

A large number of application problems involve two levels of optimization, where one optimization task is nested inside the other. These problems are known as bilevel optimization problems and have been studied by both classical…

最优化与控制 · 数学 2017-05-09 Ankur Sinha , Zhichao Lu , Kalyanmoy Deb , Pekka Malo

We design and analyze a novel accelerated gradient-based algorithm for a class of bilevel optimization problems. These problems have various applications arising from machine learning and image processing, where optimal solutions of the two…

最优化与控制 · 数学 2023-11-20 Sepideh Samadi , Daniel Burbano , Farzad Yousefian

Bayesian optimization (BO) is a powerful black-box optimization framework that looks to efficiently learn the global optimum of an unknown system by systematically trading-off between exploration and exploitation. However, the use of BO as…

最优化与控制 · 数学 2023-03-28 Dinesh Krishnamoorthy , Joel A. Paulson

Bayesian optimization is a methodology for global optimization of unknown and expensive objectives. It combines a surrogate Bayesian regression model with an acquisition function to decide where to evaluate the objective. Typical regression…

机器学习 · 计算机科学 2023-04-04 Afonso Eduardo , Michael U. Gutmann

Bilevel optimization is a field of significant theoretical and practical interest, yet solving such optimization problems remains challenging. Evolutionary methods have been employed to address these problems in the black-box setting;…

神经与进化计算 · 计算机科学 2026-04-06 Marc Ong , Youhei Akimoto

Bayesian optimisation has proven to be a powerful tool for expensive global black-box optimisation problems. In this paper, we propose new Bayesian optimisation variants of the popular Knowledge Gradient acquisition functions for problems…

机器学习 · 计算机科学 2025-12-22 Xietao Wang Lin , Juan Ungredda , Max Butler , James Town , Alma Rahat , Hemant Singh , Juergen Branke

Many real-world problems can be phrased as a multi-objective optimization problem, where the goal is to identify the best set of compromises between the competing objectives. Multi-objective Bayesian optimization (BO) is a sample efficient…

机器学习 · 计算机科学 2022-10-07 Ben Tu , Axel Gandy , Nikolas Kantas , Behrang Shafei

Bayesian optimization (BO) is a widely-used sequential method for zeroth-order optimization of complex and expensive-to-compute black-box functions. The existing BO methods assume that the function evaluation (feedback) is available to the…

机器学习 · 计算机科学 2022-06-22 Arun Verma , Zhongxiang Dai , Bryan Kian Hsiang Low

Bayesian optimization (BO) is a sample-efficient approach to optimizing costly-to-evaluate black-box functions. Most BO methods ignore how evaluation costs may vary over the optimization domain. However, these costs can be highly…

机器学习 · 计算机科学 2021-11-15 Raul Astudillo , Daniel R. Jiang , Maximilian Balandat , Eytan Bakshy , Peter I. Frazier

In this paper, we study a class of bilevel optimization problems, also known as simple bilevel optimization, where we minimize a smooth objective function over the optimal solution set of another convex constrained optimization problem.…

最优化与控制 · 数学 2023-04-25 Ruichen Jiang , Nazanin Abolfazli , Aryan Mokhtari , Erfan Yazdandoost Hamedani

Bayesian optimization (BO) is a popular paradigm for global optimization of expensive black-box functions, but there are many domains where the function is not completely a black-box. The data may have some known structure (e.g. symmetries)…

机器学习 · 计算机科学 2022-12-08 Samuel Kim , Peter Y. Lu , Charlotte Loh , Jamie Smith , Jasper Snoek , Marin Soljačić

Bayesian optimization (BO) aims to minimize a given blackbox function using a model that is updated whenever new evidence about the function becomes available. Here, we address the problem of BO under partially right-censored response data,…

人工智能 · 计算机科学 2013-10-09 Frank Hutter , Holger Hoos , Kevin Leyton-Brown

Bilevel programming is one of the very active areas of research with many real-life applications in economics and engineering. Bilevel problems are hierarchical problems consisting of lower-level and upper-level problems, respectively. The…

最优化与控制 · 数学 2025-10-24 Kuntal Som , Thirumulanathan D , Joydeep Dutta

Bayesian optimization (BO) is a model-based approach to sequentially optimize expensive black-box functions, such as the validation error of a deep neural network with respect to its hyperparameters. In many real-world scenarios, the…

Bayesian optimization (BO) is a popular technique for sequential black-box function optimization, with applications including parameter tuning, robotics, environmental monitoring, and more. One of the most important challenges in BO is the…

机器学习 · 计算机科学 2018-03-29 Paul Rolland , Jonathan Scarlett , Ilija Bogunovic , Volkan Cevher

This paper studies the joint optimization of edge node activation and resource pricing in edge computing, where an edge computing platform provides heterogeneous resources to accommodate multiple services with diverse preferences. We cast…

最优化与控制 · 数学 2025-07-15 Duong Thuy Anh Nguyen , Tarannum Nisha , Ni Trieu , Duong Tung Nguyen

Bayesian optimization (BO) is among the most effective and widely-used blackbox optimization methods. BO proposes solutions according to an explore-exploit trade-off criterion encoded in an acquisition function, many of which are computed…

机器学习 · 计算机科学 2021-02-19 Louis C. Tiao , Aaron Klein , Matthias Seeger , Edwin V. Bonilla , Cedric Archambeau , Fabio Ramos

Bilevel optimization has been recently used in many machine learning problems such as hyperparameter optimization, policy optimization, and meta learning. Although many bilevel optimization methods have been proposed, they still suffer from…

最优化与控制 · 数学 2022-10-27 Feihu Huang , Junyi Li , Shangqian Gao , Heng Huang