English
Related papers

Related papers: Accurate, scalable, and efficient Bayesian optimal…

200 papers

Numerical simulations play a critical role in design and development of engineering products and processes. Traditional computational methods, such as CFD, can provide accurate predictions but are computationally expensive, particularly for…

Bayesian Optimization (BO) is a popular approach to optimizing expensive-to-evaluate black-box functions. Despite the success of BO, its performance may decrease exponentially as the dimensionality increases. A common framework to tackle…

Machine Learning · Computer Science 2024-12-24 Quoc-Anh Hoang Nguyen , The Hung Tran

Bayesian optimization (BO) is a widely used algorithm for solving expensive black-box optimization problems. However, its performance decreases significantly on high-dimensional problems due to the inherent high-dimensionality of the…

Machine Learning · Computer Science 2025-04-16 Jundi Huang , Dawei Zhan

The design of machine learning systems often requires trading off different objectives, for example, prediction error and energy consumption for deep neural networks (DNNs). Typically, no single design performs well in all objectives;…

Machine Learning · Computer Science 2022-08-23 Md Shahriar Iqbal , Jianhai Su , Lars Kotthoff , Pooyan Jamshidi

Physics-informed neural networks (PINNs) is becoming a popular alternative method for solving partial differential equations (PDEs). However, they require dedicated manual modifications to the hyperparameters of the network, the sampling…

Computational Engineering, Finance, and Science · Computer Science 2025-04-15 Rui Zhang , Liang Li , Stéphane Lanteri , Hao Kang , Jiaqi Li

Bayesian optimization (BO) is a promising approach for hyperparameter optimization of deep neural networks (DNNs), where each model training can take minutes to hours. In BO, a computationally cheap surrogate model is employed to learn the…

Machine Learning · Computer Science 2023-09-27 Romain Egele , Isabelle Guyon , Venkatram Vishwanath , Prasanna Balaprakash

Optimal experimental design is a well studied field in applied science and engineering. Techniques for estimating such a design are commonly used within the framework of parameter estimation. Nonetheless, in recent years parameter…

Machine Learning · Statistics 2025-01-13 Md Shahriar Rahim Siddiqui , Arman Rahmim , Eldad Haber

The fundamental computational issues in Bayesian inverse problems (BIP) governed by partial differential equations (PDEs) stem from the requirement of repeated forward model evaluations. A popular strategy to reduce such costs is to replace…

Numerical Analysis · Mathematics 2024-09-05 Zhiwei Gao , Liang Yan , Tao Zhou

Bayesian optimization (BO) is one of the most effective methods for closed-loop experimental design and black-box optimization. However, a key limitation of BO is that it is an inherently sequential algorithm (one experiment is proposed per…

Machine Learning · Statistics 2023-11-21 Leonardo D. González , Victor M. Zavala

Bayesian optimization (BO) has become an effective approach for black-box function optimization problems when function evaluations are expensive and the optimum can be achieved within a relatively small number of queries. However, many…

Machine Learning · Statistics 2018-08-06 Zi Wang , Clement Gehring , Pushmeet Kohli , Stefanie Jegelka

Modelling complex multiphysics systems governed by nonlinear and strongly coupled partial differential equations (PDEs) is a cornerstone in computational science and engineering. However, it remains a formidable challenge for traditional…

Machine Learning · Computer Science 2025-02-28 Biao Yuan , He Wang , Yanjie Song , Ana Heitor , Xiaohui Chen

Parameter estimation remains a challenging task across many areas of engineering. Because data acquisition can often be costly, limited, or prone to inaccuracies (noise, uncertainty) it is crucial to identify sensor configurations that…

Machine Learning · Statistics 2025-11-20 Georgios Venianakis , Constantinos Theodoropoulos , Michail Kavousanakis

In Bayesian inference, the most probable explanation (MPE) problem requests a variable instantiation with the highest probability given some evidence. Since a Bayesian network can be encoded as a literal-weighted CNF formula $\varphi$, we…

Logic in Computer Science · Computer Science 2022-05-19 Vu H. N. Phan , Moshe Y. Vardi

Complex dynamic systems are typically either modeled using expert knowledge in the form of differential equations or via data-driven universal approximation models such as artificial neural networks (ANN). While the first approach has…

Optimization and Control · Mathematics 2024-09-09 Christoph Plate , Carl Julius Martensen , Sebastian Sager

Bayesian optimisation (BO) is a standard approach for sample-efficient global optimisation of expensive black-box functions, yet its scalability to high dimensions remains challenging. Here, we investigate nonlinear dimensionality reduction…

Optimization and Control · Mathematics 2025-10-20 Luo Long , Coralia Cartis , Paz Fink Shustin

Bayesian optimization is an effective method for optimizing expensive-to-evaluate black-box functions. High-dimensional problems are particularly challenging as the surrogate model of the objective suffers from the curse of dimensionality,…

Machine Learning · Computer Science 2023-10-06 Erik Orm Hellsten , Carl Hvarfner , Leonard Papenmeier , Luigi Nardi

Deep learning-based segmentation and classification are crucial to large-scale biomedical imaging, particularly for 3D data, where manual analysis is impractical. Although many methods exist, selecting suitable models and tuning parameters…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 David Exler , Joaquin Eduardo Urrutia Gómez , Martin Krüger , Maike Schliephake , John Jbeily , Mario Vitacolonna , Rüdiger Rudolf , Markus Reischl

This study investigates the application of Bayesian Optimization (BO) for the hyperparameter tuning of neural networks, specifically targeting the enhancement of Convolutional Neural Networks (CNN) for image classification tasks. Bayesian…

Machine Learning · Computer Science 2024-10-30 Gabriele Onorato

Existing score-based methods for directed acyclic graph (DAG) learning from observational data struggle to recover the causal graph accurately and sample-efficiently. To overcome this, in this study, we propose DrBO (DAG recovery via…

Machine Learning · Computer Science 2025-01-28 Bao Duong , Sunil Gupta , Thin Nguyen

Bayesian optimization (BO) is a powerful approach for seeking the global optimum of expensive black-box functions and has proven successful for fine tuning hyper-parameters of machine learning models. However, BO is practically limited to…

Machine Learning · Statistics 2020-09-28 Riccardo Moriconi , Marc P. Deisenroth , K. S. Sesh Kumar