English
Related papers

Related papers: In-Context Freeze-Thaw Bayesian Optimization for H…

200 papers

Bayesian optimization (BO) is an effective technique for black-box optimization. However, its applicability is typically limited to moderate-budget problems due to the cubic complexity of fitting the Gaussian process (GP) surrogate model.…

Machine Learning · Statistics 2025-10-13 Qiyu Wei , Haowei Wang , Zirui Cao , Songhao Wang , Richard Allmendinger , Mauricio A Álvarez

Designing materials with controlled heat flow at the nano-scale is central to advances in microelectronics, thermoelectrics, and energy-conversion technologies. At these scales, phonon transport follows the Boltzmann Transport Equation…

Computational Physics · Physics 2026-03-24 Antonio Varagnolo , Giuseppe Romano , Raphaël Pestourie

Frozen sectioning (FS) is the preparation method of choice for microscopic evaluation of tissues during surgical operations. The high speed of the procedure allows pathologists to rapidly assess the key microscopic features, such as tumour…

Bayesian Optimisation (BO) refers to a class of methods for global optimisation of a function $f$ which is only accessible via point evaluations. It is typically used in settings where $f$ is expensive to evaluate. A common use case for BO…

Machine Learning · Computer Science 2019-03-19 Kirthevasan Kandasamy , Willie Neiswanger , Jeff Schneider , Barnabas Poczos , Eric Xing

Active learning (AL) has emerged as a powerful paradigm for accelerating materials discovery by iteratively steering experiments toward promising candidates, reducing the number of costly synthesis-and-characterization cycles needed to…

Materials Science · Physics 2026-03-25 Jeffrey Hu , Rongzhi Dong , Ying Feng , Ming Hu , Jianjun Hu

Bayesian optimization (BO) is a powerful approach for optimizing complex and expensive-to-evaluate black-box functions. Its importance is underscored in many applications, notably including hyperparameter tuning, but its efficacy depends on…

Machine Learning · Computer Science 2024-03-11 Tennison Liu , Nicolás Astorga , Nabeel Seedat , Mihaela van der Schaar

Modern deep learning methods are very sensitive to many hyperparameters, and, due to the long training times of state-of-the-art models, vanilla Bayesian hyperparameter optimization is typically computationally infeasible. On the other…

Machine Learning · Computer Science 2018-07-06 Stefan Falkner , Aaron Klein , Frank Hutter

The goal of Multi-task Bayesian Optimization (MBO) is to minimize the number of queries required to accurately optimize a target black-box function, given access to offline evaluations of other auxiliary functions. When offline datasets are…

Machine Learning · Computer Science 2022-03-11 Kourosh Hakhamaneshi , Pieter Abbeel , Vladimir Stojanovic , Aditya Grover

Bayesian Optimization (BO) is a technique for sample-efficient black-box optimization that employs probabilistic models to identify promising input locations for evaluation. When dealing with composite-structured functions, such as f=g o h,…

Machine Learning · Computer Science 2024-07-11 Natalie Maus , Zhiyuan Jerry Lin , Maximilian Balandat , Eytan Bakshy

Physics simulations like computational fluid dynamics (CFD) are a computational bottleneck in computer-aided design (CAD) optimization processes. To overcome this bottleneck, one requires either an optimization framework that is highly…

Machine Learning · Computer Science 2024-08-29 Harsh Vardhan , David Hyde , Umesh Timalsina , Peter Volgyesi , Janos Sztipanovits

Molecular property optimization (MPO) problems are inherently challenging since they are formulated over discrete, unstructured spaces and the labeling process involves expensive simulations or experiments, which fundamentally limits the…

Biomolecules · Quantitative Biology 2024-01-04 Farshud Sorourifar , Thomas Banker , Joel A. Paulson

Sparse attention mechanisms promise to break the quadratic bottleneck of long-context transformers, yet production adoption remains limited by a critical usability gap: optimal hyperparameters vary substantially across layers and models,…

Machine Learning · Computer Science 2026-03-20 Arundhathi Dev , Justin Zhan

Bayesian Optimization (BO) is an effective approach for global optimization of black-box functions when function evaluations are expensive. Most prior works use Gaussian processes to model the black-box function, however, the use of kernels…

Machine Learning · Computer Science 2023-09-25 Dat Phan-Trong , Hung Tran-The , Sunil Gupta

Cyber-physical systems (CPSs) are often complex and safety-critical, making it both challenging and crucial to ensure that the system's specifications are met. Simulation-based falsification is a practical testing technique for increasing…

Systems and Control · Electrical Eng. & Systems 2025-02-13 Zahra Ramezani , Kenan Šehić , Luigi Nardi , Knut Åkesson

Bayesian optimization (BO) is a sequential approach for optimizing black-box objective functions using zeroth-order noisy observations. In BO, Gaussian processes (GPs) are employed as probabilistic surrogate models to estimate the objective…

Machine Learning · Computer Science 2025-04-02 Dongwon Kim , Matteo Zecchin , Sangwoo Park , Joonhyuk Kang , Osvaldo Simeone

Motivated by the success of Bayesian optimisation algorithms in the Euclidean space, we propose a novel approach to construct Intrinsic Bayesian optimisation (In-BO) on manifolds with a primary focus on complex constrained domains or…

Machine Learning · Statistics 2023-01-31 Yuan Liu , Mu Niu , Claire Miller

Active learning optimizes the exploration of large parameter spaces by strategically selecting which experiments or simulations to conduct, thus reducing resource consumption and potentially accelerating scientific discovery. A key…

Machine Learning · Computer Science 2024-05-20 Maxim Ziatdinov

The sample efficiency of Bayesian optimization(BO) is often boosted by Gaussian Process(GP) surrogate models. However, on mixed variable spaces, surrogate models other than GPs are prevalent, mainly due to the lack of kernels which can…

Machine Learning · Statistics 2022-07-19 Changyong Oh , Efstratios Gavves , Max Welling

Inertial Confinement Fusion (ICF) holds transformative promise for sustainable, near-limitless clean energy, yet remains constrained by prohibitively high costs and limited experimental opportunities. This paper presents Human-in-the-Loop…

Federated learning faces huge challenges from model overfitting due to the lack of data and statistical diversity among clients. To address these challenges, this paper proposes a novel personalized federated learning method via Bayesian…

Machine Learning · Computer Science 2022-06-17 Xu Zhang , Yinchuan Li , Wenpeng Li , Kaiyang Guo , Yunfeng Shao