English
Related papers

Related papers: Bayesian optimization for mixed variables using an…

200 papers

This paper focuses on Bayesian Optimization in combinatorial spaces. In many applications in the natural science. Broad applications include the study of molecules, proteins, DNA, device structures and quantum circuit designs, a on…

Machine Learning · Computer Science 2020-11-13 Tony C. Wu , Daniel Flam-Shepherd , Alán Aspuru-Guzik

A fully Bayesian approach is proposed for ultrahigh-dimensional nonparametric additive models in which the number of additive components may be larger than the sample size, though ideally the true model is believed to include only a small…

Methodology · Statistics 2013-09-24 Zuofeng Shang , Ping Li

Scaling Bayesian optimization to high dimensions is challenging task as the global optimization of high-dimensional acquisition function can be expensive and often infeasible. Existing methods depend either on limited active variables or…

Machine Learning · Statistics 2018-02-16 Cheng Li , Sunil Gupta , Santu Rana , Vu Nguyen , Svetha Venkatesh , Alistair Shilton

Surrogate model-based optimization has been increasingly used in the field of engineering design. It involves creating a surrogate model with objective functions or constraints based on the data obtained from simulations or real-world…

Optimization and Control · Mathematics 2023-08-28 Minyoung Jwa , Jihoon Kim , Seungyeon Shin , Ah-hyeon Jin , Dongju Shin , Namwoo Kang

Posterior sampling by Monte Carlo methods provides a more comprehensive solution approach to inverse problems than computing point estimates such as the maximum posterior using optimization methods, at the expense of usually requiring many…

Numerical Analysis · Mathematics 2024-11-28 Paolo Villani , Daniel Andrés-Arcones , Jörg F. Unger , Martin Weiser

Bayesian optimization is an effective methodology for the global optimization of functions with expensive evaluations. It relies on querying a distribution over functions defined by a relatively cheap surrogate model. An accurate model for…

A common challenge in computer experiments and related fields is to efficiently explore the input space using a small number of samples, i.e., the experimental design problem. Much of the recent focus in the computer experiment literature,…

Methodology · Statistics 2019-07-01 Boya Zhang , D. Austin Cole , Robert B. Gramacy

The optimization of industrial processes remains a critical challenge, particularly when no mathematical formulation of objective functions or constraints is available. This study addresses this issue by proposing a surrogate-based,…

Computational Engineering, Finance, and Science · Computer Science 2025-07-16 Eider Garate-Perez , Kerman López de Calle-Etxabe , Susana Ferreiro

Bayesian Optimization using Gaussian Processes is a popular approach to deal with the optimization of expensive black-box functions. However, because of the a priori on the stationarity of the covariance matrix of classic Gaussian…

Machine Learning · Statistics 2019-05-10 Ali Hebbal , Loic Brevault , Mathieu Balesdent , El-Ghazali Talbi , Nouredine Melab

Adaptive designs are increasingly used in clinical trials and online experiments to improve participant outcomes by dynamically updating treatment allocation as data accumulate. In practice, experimenters often consider multiple candidate…

Methodology · Statistics 2026-04-08 Wenxin Zhang , Aaron Hudson , Maya Petersen , Mark van der Laan

Bayesian optimization has been shown to be a powerful tool for solving black box problems during online accelerator optimization. The major advantage of Bayesian based optimization techniques is the ability to include prior information…

Accelerator Physics · Physics 2022-11-17 Connie Xu , Ryan Roussel , Auralee Edelen

Bayesian optimization works effectively optimizing parameters in black-box problems. However, this method did not work for high-dimensional parameters in limited trials. Parameters can be efficiently explored by nonlinearly embedding them…

Machine Learning · Computer Science 2022-06-14 Shoki Miyagawa , Atsuyoshi Yano , Naoko Sawada , Isamu Ogawa

We present an optimizer which uses Bayesian optimization to tune the system parameters of distributed stochastic gradient descent (SGD). Given a specific context, our goal is to quickly find efficient configurations which appropriately…

Machine Learning · Statistics 2016-12-04 Valentin Dalibard , Michael Schaarschmidt , Eiko Yoneki

Surrogate models provide compact relations between user-defined input parameters and output quantities of interest, enabling the efficient evaluation of complex parametric systems in many-query settings. Such capabilities are essential in a…

Numerical Analysis · Mathematics 2026-03-16 Matteo Giacomini , Pedro Díez

Building a surrogate model of an objective function has shown to be effective to assist evolutionary algorithms (EAs) to solve real-world complex optimisation problems which involve either computationally expensive numerical simulations or…

Neural and Evolutionary Computing · Computer Science 2020-02-11 Xiaoran Ruan , Ke Li , Bilel Derbel , Arnaud Liefooghe

While existing mathematical descriptions can accurately account for phenomena at microscopic scales (e.g. molecular dynamics), these are often high-dimensional, stochastic and their applicability over macroscopic time scales of physical…

Machine Learning · Statistics 2016-09-08 P. S. Koutsourelakis , Elias Bilionis

With growing interest in space exploration, optimized airfoil design has become increasingly important. However, airfoil design in rarefied gas flows remains underexplored because solving the Boltzmann equation formulated in a six…

Fluid Dynamics · Physics 2025-12-09 Xiaoda Li , Ruifeng Yuan , Yanbing Zhang , Lei Wu

In this thesis, I explore the possibilities of conducting Bayesian optimization techniques in high dimensional domains. Although high dimensional domains can be defined to be between hundreds and thousands of dimensions, we will primarily…

Machine Learning · Computer Science 2020-10-09 David Yenicelik

This paper considers the creation of parametric surrogate models for applications in science and engineering where the goal is to predict high-dimensional spatiotemporal output quantities of interest, such as pressure, temperature and…

Computational Physics · Physics 2022-03-24 Chi Hoang , Kenny Chowdhary , Kookjin Lee , Jaideep Ray

This paper deals with some of the methodologies used to construct polynomial surrogate models based on generalized polynomial chaos (gPC) expansions for applications to uncertainty quantification (UQ) in aerodynamic computations. A core…

Fluid Dynamics · Physics 2018-03-14 Eric Savin , Andrea Resmini , Jacques Peter
‹ Prev 1 3 4 5 6 7 10 Next ›