English
Related papers

Related papers: A General Bayesian Algorithm for the Autonomous Al…

200 papers

Bayesian optimization is a sample-efficient method for solving expensive, black-box optimization problems. Stochastic programming concerns optimization under uncertainty where, typically, average performance is the quantity of interest. In…

Machine Learning · Statistics 2025-02-19 Jack M. Buckingham , Ivo Couckuyt , Juergen Branke

Bayesian optimization offers a flexible framework to optimize an objective function that is expensive to be evaluated. A Bayesian optimizer iteratively queries the function values on its carefully selected points. Subsequently, it makes a…

Machine Learning · Computer Science 2019-06-25 Yang Li , Yaqiang Yao

Within the framework of complex system design, it is often necessary to solve mixed variable optimization problems, in which the objective and constraint functions can depend simultaneously on continuous and discrete variables.…

Optimization and Control · Mathematics 2020-03-10 Julien Pelamatti , Loic Brevault , Mathieu Balesdent , El-Ghazali Talbi , Yannick Guerin

Bayesian optimization is normally performed within fixed variable bounds. In cases like hyperparameter tuning for machine learning algorithms, setting the variable bounds is not trivial. It is hard to guarantee that any fixed bounds will…

Optimization and Control · Mathematics 2020-01-15 Wei Chen , Mark Fuge

Bayesian optimization is a class of data efficient model based algorithms typically focused on global optimization. We consider the more general case where a user is faced with multiple problems that each need to be optimized conditional on…

Machine Learning · Statistics 2020-11-04 Michael Pearce , Janis Klaise , Matthew Groves

We propose a framework for the configuration and operation of expensive-to-evaluate advanced manufacturing methods, based on Bayesian optimization. The framework unifies a tailored acquisition function, a parallel acquisition procedure, and…

Machine Learning · Computer Science 2023-01-18 Xavier Guidetti , Alisa Rupenyan , Lutz Fassl , Majid Nabavi , John Lygeros

Bayesian optimization is used in many areas of AI for the optimization of black-box processes and has achieved impressive improvements of the state of the art for a lot of applications. It intelligently explores large and complex design…

Materials Science · Physics 2021-08-03 Lars Kotthoff , Hud Wahab , Patrick Johnson

Bayesian optimization is a coherent, ubiquitous approach to decision-making under uncertainty, with applications including multi-arm bandits, active learning, and black-box optimization. Bayesian optimization selects decisions (i.e.…

Machine Learning · Computer Science 2023-12-13 Samuel Stanton , Wesley Maddox , Andrew Gordon Wilson

Bayesian optimization works effectively optimizing parameters in black-box problems. However, this method did not work for high-dimensional parameters in limited trials. Parameters can be efficiently explored by nonlinearly embedding them…

Machine Learning · Computer Science 2022-06-14 Shoki Miyagawa , Atsuyoshi Yano , Naoko Sawada , Isamu Ogawa

With a Bayesian approach, the linear optics correction algorithm for storage rings is revisited. Starting from the Bayes' theorem, a complete linear optics model is simplified as "likelihood functions" and "prior probability distributions".…

Accelerator Physics · Physics 2019-04-18 Yongjun Li , Robert Rainer , Weixing Cheng

Bayesian optimization (BO) is a popular global optimization scheme for sample-efficient optimization in domains with expensive function evaluations. The existing BO techniques are capable of finding a single global optimum solution.…

Optimization and Control · Mathematics 2023-08-08 Yongsheng Mei , Tian Lan , Mahdi Imani , Suresh Subramaniam

One of the goals of computer-aided surgery is to match intraoperative data to preoperative images of the anatomy and add complementary information that can facilitate the task of surgical navigation. In this context, mechanical palpation…

Robotics · Computer Science 2015-09-22 Elif Ayvali , Rangaprasad Arun Srivatsan , Long Wang , Rajarshi Roy , Nabil Simaan , Howie Choset

We present a Bayesian algorithm to combine optical imaging of unresolved objects from distinct epochs and observation platforms for orbit determination and tracking. By propagating the non-Gaussian uncertainties we are able to optimally…

Instrumentation and Methods for Astrophysics · Physics 2016-09-26 Michael D. Schneider , William A. Dawson

Bayesian optimisation is a powerful tool to solve expensive black-box problems, but fails when the stationary assumption made on the objective function is strongly violated, which is the case in particular for ill-conditioned or…

Machine Learning · Statistics 2019-12-06 Victor Picheny , Sattar Vakili , Artem Artemev

Global optimization finds applications in a wide range of real world problems. The multi-start methods are a popular class of global optimization techniques, which are based on the ideas of conducting local searches at multiple starting…

Machine Learning · Statistics 2020-07-01 Yuzhou Gao , Tengchao Yu , Jinglai Li

Synchrotron radiation sources play a crucial role in fields such as materials science, biology, and chemistry. The beamline, a key subsystem of the synchrotron, modulates and directs the radiation to the sample for analysis. However, the…

Systems and Control · Electrical Eng. & Systems 2024-11-20 Siyu Wang , Shengran Dai , Jianhui Jiang , Shuang Wu , Yufei Peng , Junbin Zhang

Finding optimal parameter configurations for tunable GPU kernels is a non-trivial exercise for large search spaces, even when automated. This poses an optimization task on a non-convex search space, using an expensive to evaluate function…

Machine Learning · Computer Science 2021-12-01 Floris-Jan Willemsen , Rob van Nieuwpoort , Ben van Werkhoven

This paper addresses the challenge of fine-grained alignment in Vision-and-Language Navigation (VLN) tasks, where robots navigate realistic 3D environments based on natural language instructions. Current approaches use contrastive learning…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Yuhang Song , Mario Gianni , Chenguang Yang , Kunyang Lin , Te-Chuan Chiu , Anh Nguyen , Chun-Yi Lee

Asynchronous Bayesian optimization is a recently implemented technique that allows for parallel operation of experimental systems and disjointed workflows. Contrasting with serial Bayesian optimization which individually selects experiments…

Machine Learning · Computer Science 2024-10-23 Amanda A. Volk , Kristofer G. Reyes , Jeffrey G. Ethier , Luke A. Baldwin

The purpose of this paper is twofold. On one side, we present a general framework for Bayesian optimization and we compare it with some related fields in active learning and Bayesian numerical analysis. On the other hand, Bayesian…

Robotics · Computer Science 2018-02-13 Ruben Martinez-Cantin