English
Related papers

Related papers: Macro Placement by Wire-Mask-Guided Black-Box Opti…

200 papers

Black-box optimization (BBO) is used in materials design, drug discovery, and hyperparameter tuning in machine learning. The world is experiencing several of these problems. In this review, a factorization machine with quantum annealing or…

Statistical Mechanics · Physics 2026-04-30 Ryo Tamura , Yuya Seki , Yuki Minamoto , Koki Kitai , Yoshiki Matsuda , Shu Tanaka , Koji Tsuda

Bayesian optimization (BO) is a powerful black-box optimization framework that looks to efficiently learn the global optimum of an unknown system by systematically trading-off between exploration and exploitation. However, the use of BO as…

Optimization and Control · Mathematics 2023-03-28 Dinesh Krishnamoorthy , Joel A. Paulson

We present mlrMBO, a flexible and comprehensive R toolbox for model-based optimization (MBO), also known as Bayesian optimization, which addresses the problem of expensive black-box optimization by approximating the given objective function…

Machine Learning · Statistics 2018-12-04 Bernd Bischl , Jakob Richter , Jakob Bossek , Daniel Horn , Janek Thomas , Michel Lang

Bayesian Optimisation (BO) is a state-of-the-art global optimisation technique for black-box problems where derivative information is unavailable, and sample efficiency is crucial. However, improving the general scalability of BO has proved…

Optimization and Control · Mathematics 2024-12-13 Luo Long , Coralia Cartis , Paz Fink Shustin

Bayesian optimisation (BO) is a standard approach for sample-efficient global optimisation of expensive black-box functions, yet its scalability to high dimensions remains challenging. Here, we investigate nonlinear dimensionality reduction…

Optimization and Control · Mathematics 2025-10-20 Luo Long , Coralia Cartis , Paz Fink Shustin

Parameter settings profoundly impact the performance of machine learning algorithms and laboratory experiments. The classical grid search or trial-error methods are exponentially expensive in large parameter spaces, and Bayesian…

Machine Learning · Computer Science 2017-04-18 Vu Nguyen , Santu Rana , Sunil Gupta , Cheng Li , Svetha Venkatesh

The core challenge of high-dimensional and expensive black-box optimization (BBO) is how to obtain better performance faster with little function evaluation cost. The essence of the problem is how to design an efficient optimization…

Machine Learning · Computer Science 2023-07-26 Xiaobin Li , Kai Wu , Xiaoyu Zhang , Handing Wang , Jing Liu

Bayesian optimization (BO) is a well-established method to optimize black-box functions whose direct evaluations are costly. In this paper, we tackle the problem of incorporating expert knowledge into BO, with the goal of further…

Machine Learning · Computer Science 2022-08-19 Daolang Huang , Louis Filstroff , Petrus Mikkola , Runkai Zheng , Samuel Kaski

Black-box optimization (BBO) involves functions that are unknown, inexact and/or expensive-to-evaluate. Existing BBO algorithms face several challenges, including high computational cost from extensive evaluations, difficulty in handling…

Optimization and Control · Mathematics 2025-09-26 Zixuan Zhang , Xiaowei Song , Jiaming Li , Yujiao Zeng , Yaling Nie , Min Zhu , Dongyun Lu , Yibo Zhang , Xin Xiao , Jie Li

Large language models (LLMs) have shown impressive success in various applications. However, these models are often not well aligned with human intents, which calls for additional treatments on them; that is, the alignment problem. To make…

Computation and Language · Computer Science 2024-06-24 Jiale Cheng , Xiao Liu , Kehan Zheng , Pei Ke , Hongning Wang , Yuxiao Dong , Jie Tang , Minlie Huang

Many real-time systems require the optimization of discrete variables. Black-box optimization (BBO) algorithms and multi-armed bandit (MAB) algorithms perform optimization by repeatedly taking actions and observing the corresponding instant…

Artificial Intelligence · Computer Science 2025-06-23 Tomoya Kashimata , Yohei Hamakawa , Masaya Yamasaki , Kosuke Tatsumura

The tuning of hyperparameters becomes increasingly important as machine learning (ML) models have been extensively applied in data mining applications. Among various approaches, Bayesian optimization (BO) is a successful methodology to tune…

Machine Learning · Computer Science 2022-06-07 Yang Li , Yu Shen , Huaijun Jiang , Tianyi Bai , Wentao Zhang , Ce Zhang , Bin Cui

In modern digital circuit back-end design, designers heavily rely on electronic-design-automoation (EDA) tool to close timing. However, the heuristic algorithms used in the place and route tool usually does not result in optimal solution.…

Machine Learning · Computer Science 2018-01-10 Karthik Airani , Rohit Guttal

Bayesian optimization has been successfully applied to optimize black-box functions where the number of evaluations is severely limited. However, in many real-world applications, it is hard or impossible to know in advance which designs are…

In wireless communication systems, mmWave beam tracking is a critical task that affects both sensing and communications, as it is related to the knowledge of the wireless channel. We consider a setup in which a Base Station (BS) needs to…

Signal Processing · Electrical Eng. & Systems 2023-06-28 Cristian J. Vaca-Rubio , Carles Navarro Manchón , Ramoni Adeogun , Petar Popovski

Automatic Machine Learning (Auto-ML) systems tackle the problem of automating the design of prediction models or pipelines for data science. In this paper, we present Lifelong Bayesian Optimization (LBO), an online, multitask Bayesian…

Machine Learning · Statistics 2019-06-24 Yao Zhang , James Jordon , Ahmed M. Alaa , Mihaela van der Schaar

Optimizing multiple, non-preferential objectives for mixed-variable, expensive black-box problems is important in many areas of engineering and science. The expensive, noisy, black-box nature of these problems makes them ideal candidates…

Machine Learning · Computer Science 2022-11-15 Haris Moazam Sheikh , Philip S. Marcus

Gradient-free black-box optimization (BBO) is widely used in engineering design and provides a flexible framework for topology optimization (TO), enabling the discovery of high-performing structural designs without requiring gradient…

Neural and Evolutionary Computing · Computer Science 2026-02-03 Jelle Westra , Iván Olarte Rodríguez , Niki van Stein , Thomas Bäck , Elena Raponi

Optimizing the configuration and placement of sensors is crucial for reliable fall detection, indoor localization, and activity recognition in assisted living spaces. We propose a novel, sample-efficient approach to find a high-quality…

Machine Learning · Computer Science 2023-09-13 Shadan Golestan , Omid Ardakanian , Pierre Boulanger

Bayesian optimization (BO) is an efficient framework for optimization of black-box objectives when function evaluations are costly and gradient information is not easily accessible. BO has been successfully applied to automate the task of…

Machine Learning · Computer Science 2024-07-09 Pallavi Mitra , Felix Biessmann