English
Related papers

Related papers: Cost-effective Reduced-Order Modeling via Bayesian…

200 papers

Bayesian optimization (BO) provides a powerful framework for optimizing black-box, expensive-to-evaluate functions. It is therefore an attractive tool for engineering design problems, typically involving multiple objectives. Thanks to the…

Machine Learning · Computer Science 2024-09-06 Navid Ansari , Alireza Javanmardi , Eyke Hüllermeier , Hans-Peter Seidel , Vahid Babaei

One predominant challenge in additive manufacturing (AM) is to achieve specific material properties by manipulating manufacturing process parameters during the runtime. Such manipulation tends to increase the computational load imposed on…

Machine Learning · Computer Science 2023-10-24 Mahmoud Yaseen , Dewen Yushu , Peter German , Xu Wu

Bayesian optimisation is a sample efficient method for finding a global optimum of expensive black-box objective functions. Historic datasets from related problems can be exploited to help improve performance of Bayesian optimisation by…

Machine Learning · Computer Science 2026-01-23 Natasha Trinkle , Huong Ha , Jeffrey Chan

For applications in healthcare, physics, energy, robotics, and many other fields, designing maximally informative experiments is valuable, particularly when experiments are expensive, time-consuming, or pose safety hazards. While existing…

Machine Learning · Computer Science 2022-03-09 Vincent Lim , Ellen Novoseller , Jeffrey Ichnowski , Huang Huang , Ken Goldberg

Bayesian Optimization (BO) is a well-established method for addressing black-box optimization problems. In many real-world scenarios, optimization often involves multiple functions, emphasizing the importance of leveraging data and learned…

Machine Learning · Computer Science 2025-03-11 Khoa Nguyen , Viet Huynh , Binh Tran , Tri Pham , Tin Huynh , Thin Nguyen

This paper introduces a reduced-order modeling approach based on finite volume methods for hyperbolic systems, combining Proper Orthogonal Decomposition (POD) with the Discrete Empirical Interpolation Method (DEIM) and Proper Interval…

Numerical Analysis · Mathematics 2025-05-07 I. Gómez-Bueno , E. D. Fernández-Nieto , S. Rubino

Expensive multi-objective optimization problems can be found in many real-world applications, where their objective function evaluations involve expensive computations or physical experiments. It is desirable to obtain an approximate Pareto…

Neural and Evolutionary Computing · Computer Science 2022-10-18 Xi Lin , Zhiyuan Yang , Xiaoyuan Zhang , Qingfu Zhang

We study pool-based active learning with abstention feedbacks where a labeler can abstain from labeling a queried example with some unknown abstention rate. This is an important problem with many useful applications. We take a Bayesian…

Machine Learning · Computer Science 2021-01-01 Cuong V. Nguyen , Lam Si Tung Ho , Huan Xu , Vu Dinh , Binh Nguyen

Bayesian optimization (BO) is a widely used algorithm for solving expensive black-box optimization problems. However, its performance decreases significantly on high-dimensional problems due to the inherent high-dimensionality of the…

Machine Learning · Computer Science 2025-04-16 Jundi Huang , Dawei Zhan

Bayesian optimisation has been successfully applied to a variety of reinforcement learning problems. However, the traditional approach for learning optimal policies in simulators does not utilise the opportunity to improve learning by…

We consider the problem of optimizing expensive black-box functions over high-dimensional combinatorial spaces which arises in many science, engineering, and ML applications. We use Bayesian Optimization (BO) and propose a novel surrogate…

Machine Learning · Computer Science 2023-03-06 Aryan Deshwal , Sebastian Ament , Maximilian Balandat , Eytan Bakshy , Janardhan Rao Doppa , David Eriksson

The pursuit of long-term autonomy mandates that machine learning models must continuously adapt to their changing environments and learn to solve new tasks. Continual learning seeks to overcome the challenge of catastrophic forgetting,…

Machine Learning · Computer Science 2024-07-25 Jack Foster , Alexandra Brintrup

We provide an introduction to POD-MOR with focus on (nonlinear) parametric PDEs and (nonlinear) time-dependent PDEs, and PDE constrained optimization with POD surrogate models as application. We cover the relation of POD and SVD, POD from…

Numerical Analysis · Mathematics 2020-08-04 Carmen Gräßle , Michael Hinze , Stefan Volkwein

Bayesian optimization (BO) is a sample-efficient approach to optimizing costly-to-evaluate black-box functions. Most BO methods ignore how evaluation costs may vary over the optimization domain. However, these costs can be highly…

Machine Learning · Computer Science 2021-11-15 Raul Astudillo , Daniel R. Jiang , Maximilian Balandat , Eytan Bakshy , Peter I. Frazier

Bayesian optimization (BO) protocol based on Active Learning (AL) principles has garnered significant attention due to its ability to optimize black-box objective functions efficiently. This capability is a prerequisite for guiding…

Chemical Physics · Physics 2024-08-07 Osman Mamun , Markus Bause , Bhuiyan Shameem Mahmud Ebna Hai

Machine learning models are increasingly being utilized across various fields and tasks due to their outstanding performance and strong generalization capabilities. Nonetheless, their success hinges on the availability of large volumes of…

Machine Learning · Computer Science 2024-11-26 Shreen Gul , Mohamed Elmahallawy , Sanjay Madria , Ardhendu Tripathy

Particle-in-Cell (PIC) simulations are widely used for modeling plasma kinetics by tracking discrete particle dynamics. However, their computational cost remains prohibitively high, due to the need to simulate large numbers of particles to…

Computational Physics · Physics 2025-04-29 Jianhua Lv , Linlin Zhong

Bayesian Optimization (BO) is an effective method for optimizing expensive-to-evaluate black-box functions with a wide range of applications for example in robotics, system design and parameter optimization. However, scaling BO to problems…

Systems and Control · Electrical Eng. & Systems 2020-01-22 Lukas P. Fröhlich , Edgar D. Klenske , Christian G. Daniel , Melanie N. Zeilinger

Bayesian optimization (BO) methods often rely on the assumption that the objective function is well-behaved, but in practice, this is seldom true for real-world objectives even if noise-free observations can be collected. Common approaches,…

Machine Learning · Statistics 2020-09-10 Erik Bodin , Markus Kaiser , Ieva Kazlauskaite , Zhenwen Dai , Neill D. F. Campbell , Carl Henrik Ek

In this paper, we address the problem of cost-sensitive multi-fidelity Bayesian Optimization (BO) for efficient hyperparameter optimization (HPO). Specifically, we assume a scenario where users want to early-stop the BO when the performance…

Machine Learning · Computer Science 2024-05-29 Dong Bok Lee , Aoxuan Silvia Zhang , Byungjoo Kim , Junhyeon Park , Juho Lee , Sung Ju Hwang , Hae Beom Lee