English
Related papers

Related papers: Best Practices for Multi-Fidelity Bayesian Optimiz…

200 papers

Molecular property optimization (MPO) problems are inherently challenging since they are formulated over discrete, unstructured spaces and the labeling process involves expensive simulations or experiments, which fundamentally limits the…

Biomolecules · Quantitative Biology 2024-01-04 Farshud Sorourifar , Thomas Banker , Joel A. Paulson

Bayesian optimization (BO) is a popular global optimization scheme for sample-efficient optimization in domains with expensive function evaluations. The existing BO techniques are capable of finding a single global optimum solution.…

Optimization and Control · Mathematics 2023-08-08 Yongsheng Mei , Tian Lan , Mahdi Imani , Suresh Subramaniam

Bayesian optimization (BO) is widely used for autonomous materials discovery, yet its classical sequential formulation is insufficient for design of experimental workflows that often combine parallel or batch synthesis with inherently…

Materials Science · Physics 2026-02-10 Boris Slautin , Sergei Kalinin

Optimizing multiple, non-preferential objectives for mixed-variable, expensive black-box problems is important in many areas of engineering and science. The expensive, noisy, black-box nature of these problems makes them ideal candidates…

Machine Learning · Computer Science 2022-11-15 Haris Moazam Sheikh , Philip S. Marcus

In many applications, ranging from logistics to engineering, a designer is faced with a sequence of optimization tasks for which the objectives are in the form of black-box functions that are costly to evaluate. Furthermore, higher-fidelity…

Machine Learning · Computer Science 2025-01-09 Yunchuan Zhang , Sangwoo Park , Osvaldo Simeone

Data-driven design shows the promise of accelerating materials discovery but is challenging due to the prohibitive cost of searching the vast design space of chemistry, structure, and synthesis methods. Bayesian Optimization (BO) employs…

Machine Learning · Statistics 2023-04-12 Hengrui Zhang , Wei Wayne Chen , Akshay Iyer , Daniel W. Apley , Wei Chen

Some real problems require the evaluation of expensive and noisy objective functions. Moreover, the analytical expression of these objective functions may be unknown. These functions are known as black-boxes, for example, estimating the…

Machine Learning · Statistics 2021-07-12 Lucia Asencio Martín , Eduardo C. Garrido-Merchán

Automation is one of the cornerstones of contemporary material discovery. Bayesian optimization (BO) is an essential part of such workflows, enabling scientists to leverage prior domain knowledge into efficient exploration of a large…

Machine Learning · Computer Science 2024-05-30 Agustinus Kristiadi , Felix Strieth-Kalthoff , Marta Skreta , Pascal Poupart , Alán Aspuru-Guzik , Geoff Pleiss

First Order Bayesian Optimization (FOBO) is a sample efficient sequential approach to find the global maxima of an expensive-to-evaluate black-box objective function by suitably querying for the function and its gradient evaluations. Such…

Machine Learning · Computer Science 2023-06-21 Utkarsh Prakash , Aryan Chollera , Kushagra Khatwani , Prabuchandran K. J. , Tejas Bodas

Bayesian optimization is used in many areas of AI for the optimization of black-box processes and has achieved impressive improvements of the state of the art for a lot of applications. It intelligently explores large and complex design…

Materials Science · Physics 2021-08-03 Lars Kotthoff , Hud Wahab , Patrick Johnson

Bayesian optimization (BO) is a powerful approach for optimizing black-box, expensive-to-evaluate functions. To enable a flexible trade-off between the cost and accuracy, many applications allow the function to be evaluated at different…

Machine Learning · Computer Science 2021-10-27 Shibo Li , Robert M. Kirby , Shandian Zhe

In system analysis and design optimization, multiple computational models are typically available to represent a given physical system. These models can be broadly classified as high-fidelity models, which provide highly accurate…

Machine Learning · Computer Science 2024-11-01 Ruda Zhang , Negin Alemazkoor

Bayesian optimization is efficient even with a small amount of data and is used in engineering and in science, including biology and chemistry. In Bayesian optimization, a parameterized model with an uncertainty is fitted to explain the…

Machine Learning · Computer Science 2024-12-06 Yujin Taguchi , Yusuke Shibuya , Yusuke Hiki , Takashi Morikura , Takahiro G. Yamada , Akira Funahashi

How can we efficiently gather information to optimize an unknown function, when presented with multiple, mutually dependent information sources with different costs? For example, when optimizing a robotic system, intelligently trading off…

Machine Learning · Computer Science 2018-11-05 Jialin Song , Yuxin Chen , Yisong Yue

In this paper, we address the problem of cost-sensitive multi-fidelity Bayesian Optimization (BO) for efficient hyperparameter optimization (HPO). Specifically, we assume a scenario where users want to early-stop the BO when the performance…

Machine Learning · Computer Science 2024-05-29 Dong Bok Lee , Aoxuan Silvia Zhang , Byungjoo Kim , Junhyeon Park , Juho Lee , Sung Ju Hwang , Hae Beom Lee

Scientific discovery is increasingly constrained by costly experiments and limited resources, underscoring the need for efficient optimization in AI for science. Bayesian Optimization (BO), though widely adopted for balancing exploration…

Artificial Intelligence · Computer Science 2026-05-19 Xinzhe Yuan , Zhuo Chen , Jianshu Zhang , Huan Xiong , Nanyang Ye , Yuqiang Li , Qinying Gu

How should we intervene on an unknown structural equation model to maximize a downstream variable of interest? This setting, also known as causal Bayesian optimization (CBO), has important applications in medicine, ecology, and…

Machine Learning · Computer Science 2023-03-13 Scott Sussex , Anastasiia Makarova , Andreas Krause

Machine learning (ML) provides access to fast and accurate quantum chemistry (QC) calculations for various properties of interest such as excitation energies. It is often the case that high accuracy in prediction using an ML model, demands…

Chemical Physics · Physics 2024-03-13 Vivin Vinod , Ulrich Kleinekathöfer , Peter Zaspel

Bayesian optimization (BO) is a popular, sample-efficient technique for expensive, black-box optimization. One such problem arising in manufacturing is that of maximizing the reliability, or equivalently minimizing the probability of a…

Machine Learning · Computer Science 2026-02-03 Jack M. Buckingham , Ivo Couckuyt , Juergen Branke

Bayesian optimization (BO) is a popular method to optimize costly black-box functions. While traditional BO optimizes each new target task from scratch, meta-learning has emerged as a way to leverage knowledge from related tasks to optimize…

Machine Learning · Computer Science 2024-07-01 Jiarong Pan , Stefan Falkner , Felix Berkenkamp , Joaquin Vanschoren