English
Related papers

Related papers: Fast Bayesian Optimization of Needle-in-a-Haystack…

200 papers

We propose an algorithm for a family of optimization problems where the objective can be decomposed as a sum of functions with monotonicity properties. The motivating problem is optimization of hyperparameters of machine learning…

Machine Learning · Computer Science 2018-02-20 Wenyi Wang , William J. Welch

Bayesian Optimization (BO) is a method for globally optimizing black-box functions. While BO has been successfully applied to many scenarios, developing effective BO algorithms that scale to functions with high-dimensional domains is still…

Machine Learning · Computer Science 2024-02-13 Yihang Shen , Carl Kingsford

Advancements in materials play a crucial role in technological progress. However, the process of discovering and developing materials with desired properties is often impeded by substantial experimental costs, extensive resource…

Machine Learning · Computer Science 2023-11-17 Ahmed Shoyeb Raihan , Hamed Khosravi , Srinjoy Das , Imtiaz Ahmed

Bayesian optimization (BO) is a powerful approach for optimizing complex and expensive-to-evaluate black-box functions. Its importance is underscored in many applications, notably including hyperparameter tuning, but its efficacy depends on…

Machine Learning · Computer Science 2024-03-11 Tennison Liu , Nicolás Astorga , Nabeel Seedat , Mihaela van der Schaar

Bayesian Optimization (BO) is an effective approach for global optimization of black-box functions when function evaluations are expensive. Most prior works use Gaussian processes to model the black-box function, however, the use of kernels…

Machine Learning · Computer Science 2023-09-25 Dat Phan-Trong , Hung Tran-The , Sunil Gupta

Bayesian optimization (BO) is a popular approach to optimize expensive-to-evaluate black-box functions. A significant challenge in BO is to scale to high-dimensional parameter spaces while retaining sample efficiency. A solution considered…

Machine Learning · Statistics 2020-10-26 Benjamin Letham , Roberto Calandra , Akshara Rai , Eytan Bakshy

Randomized experiments are the gold standard for evaluating the effects of changes to real-world systems. Data in these tests may be difficult to collect and outcomes may have high variance, resulting in potentially large measurement error.…

Machine Learning · Statistics 2018-06-27 Benjamin Letham , Brian Karrer , Guilherme Ottoni , Eytan Bakshy

Bayesian optimisation (BO) has been a successful approach to optimise functions which are expensive to evaluate and whose observations are noisy. Classical BO algorithms, however, do not account for errors about the location where…

Machine Learning · Computer Science 2019-02-22 Rafael Oliveira , Lionel Ott , Fabio Ramos

Efficient optimization of molecules with targeted properties remains a significant challenge due to the vast size and discrete nature of chemical compound space. Conventional machine-learning-based optimization approaches typically require…

Chemical Physics · Physics 2026-03-04 Yun-Wen Mao , Roman V. Krems

Hyperparameter optimization aims to find the optimal hyperparameter configuration of a machine learning model, which provides the best performance on a validation dataset. Manual search usually leads to get stuck in a local hyperparameter…

Machine Learning · Statistics 2018-11-01 Jungtaek Kim , Saehoon Kim , Seungjin Choi

We consider the problem of optimizing hybrid structures (mixture of discrete and continuous input variables) via expensive black-box function evaluations. This problem arises in many real-world applications. For example, in materials design…

Machine Learning · Computer Science 2021-12-03 Aryan Deshwal , Syrine Belakaria , Janardhan Rao Doppa

This work presents PESMOC, Predictive Entropy Search for Multi-objective Bayesian Optimization with Constraints, an information-based strategy for the simultaneous optimization of multiple expensive-to-evaluate black-box functions under the…

Machine Learning · Statistics 2021-04-15 Eduardo C. Garrido-Merchán , Daniel Hernández-Lobato

Bayesian optimization (BO) methods are useful for optimizing functions that are expensive to evaluate, lack an analytical expression and whose evaluations can be contaminated by noise. These methods rely on a probabilistic model of the…

Machine Learning · Statistics 2020-02-04 Eduardo C. Garrido-Merchán , Daniel Hernández-Lobato

Bayesian optimisation (BO) uses probabilistic surrogate models - usually Gaussian processes (GPs) - for the optimisation of expensive black-box functions. At each BO iteration, the GP hyperparameters are fit to previously-evaluated data by…

Machine Learning · Computer Science 2021-05-04 George De Ath , Richard Everson , Jonathan Fieldsend

Bilevel optimization problems consist of minimizing a value function whose evaluation depends on the solution of an inner optimization problem. These problems are typically tackled using first-order methods that require computing the…

Optimization and Control · Mathematics 2026-01-30 Marco Rando , Samuel Vaiter

Realizing high-throughput aberration-corrected Scanning Transmission Electron Microscopy (STEM) exploration of atomic structures requires rapid tuning of multipole probe correctors while compensating for the inevitable drift of the optical…

Machine Learning · Computer Science 2026-01-28 Utkarsh Pratiush , Austin Houston , Richard Liu , Gerd Duscher , Sergei Kalinin

Bayesian Neural Networks (BNNs) can overcome the problem of overconfidence that plagues traditional frequentist deep neural networks, and are hence considered to be a key enabler for reliable AI systems. However, conventional hardware…

Neural and Evolutionary Computing · Computer Science 2024-01-30 Prabodh Katti , Nicolas Skatchkovsky , Osvaldo Simeone , Bipin Rajendran , Bashir M. Al-Hashimi

In this investigation, we propose several algorithms to recover the location and intensity of a radiation source located in a simulated 250 m x 180 m block in an urban center based on synthetic measurements. Radioactive decay and detection…

Applications · Statistics 2016-07-05 Razvan Stefanescu , Kathleen Schmidt , Jason Hite , Ralph Smith , John Mattingly

In many high-throughput experimental design settings, such as those common in biochemical engineering, batched queries are more cost effective than one-by-one sequential queries. Furthermore, it is often not possible to directly choose…

Machine Learning · Computer Science 2019-04-18 Kevin K. Yang , Yuxin Chen , Alycia Lee , Yisong Yue

Accelerating the discovery of mechanical properties in combinatorial materials requires autonomous experimentation that accounts for both instrument behavior and experimental cost. Here, an automated nanoindentation (AE-NI) framework is…

Materials Science · Physics 2025-11-24 Vivek Chawla , Stephen Puplampu , Haochen Zhu , Philip D. Rack , Dayakar Penumadu , Sergei Kalinin
‹ Prev 1 3 4 5 6 7 10 Next ›