English
Related papers

Related papers: PINN-BO: A Black-box Optimization Algorithm using …

200 papers

We study the problem of black-box optimization of a function f of any dimension, given function evaluations perturbed by noise. The function is assumed to be locally smooth around one of its global optima, but this smoothness is unknown.…

Machine Learning · Statistics 2026-05-05 Jean-Bastien Grill , Michal Valko , Rémi Munos

Physics-Informed Neural Networks (PINNs) have revolutionized the computation of PDE solutions by integrating partial differential equations (PDEs) into the neural network's training process as soft constraints, becoming an important…

Machine Learning · Computer Science 2026-02-10 Elham Kiyani , Khemraj Shukla , Jorge F. Urbán , Jérôme Darbon , George Em Karniadakis

Bayesian Optimization (BO) is a method for globally optimizing black-box functions. While BO has been successfully applied to many scenarios, developing effective BO algorithms that scale to functions with high-dimensional domains is still…

Machine Learning · Computer Science 2024-02-13 Yihang Shen , Carl Kingsford

Physics-informed neural networks (PINNs) provide a deep learning framework for numerically solving partial differential equations (PDEs), and have been widely used in a variety of PDE problems. However, there still remain some challenges in…

Machine Learning · Computer Science 2022-05-19 Wensheng Li , Chao Zhang , Chuncheng Wang , Hanting Guan , Dacheng Tao

Physics-informed neural networks (PINNs) have been widely applied to solve partial differential equations (PDEs) by enforcing outputs and gradients of deep models to satisfy target equations. Due to the limitation of numerical computation,…

Machine Learning · Computer Science 2024-10-24 Haixu Wu , Huakun Luo , Yuezhou Ma , Jianmin Wang , Mingsheng Long

Many physical and engineering systems require solving direct problems to predict behavior and inverse problems to determine unknown parameters from measurement. In this work, we study both aspects for systems governed by differential…

Numerical Analysis · Mathematics 2026-03-04 Noura Al Helwani , Sophie Moufawad , Georges Sakr

Partial differential equations (PDEs) serve as the cornerstone of mathematical physics. In recent years, Physics-Informed Neural Networks (PINNs) have significantly reduced the dependence on large datasets by embedding physical laws…

Machine Learning · Computer Science 2025-06-09 Wenxuan Huo , Qiang He , Gang Zhu , Weifeng Huang

Physics-Informed Neural Networks (PINN) are neural networks (NNs) that encode model equations, like Partial Differential Equations (PDE), as a component of the neural network itself. PINNs are nowadays used to solve PDEs, fractional…

Bayesian optimization (BO) has emerged during the last few years as an effective approach to optimizing black-box functions where direct queries of the objective are expensive. In this paper we consider the case where direct access to the…

Machine Learning · Statistics 2017-04-13 Javier Gonzalez , Zhenwen Dai , Andreas Damianou , Neil D. Lawrence

Bayesian optimization (BO) has become an effective approach for black-box function optimization problems when function evaluations are expensive and the optimum can be achieved within a relatively small number of queries. However, many…

Machine Learning · Statistics 2018-08-06 Zi Wang , Clement Gehring , Pushmeet Kohli , Stefanie Jegelka

This study investigates the application of Bayesian Optimization (BO) for the hyperparameter tuning of neural networks, specifically targeting the enhancement of Convolutional Neural Networks (CNN) for image classification tasks. Bayesian…

Machine Learning · Computer Science 2024-10-30 Gabriele Onorato

Deep learning models trained on finite data lack a complete understanding of the physical world. On the other hand, physics-informed neural networks (PINNs) are infused with such knowledge through the incorporation of mathematically…

Neural and Evolutionary Computing · Computer Science 2026-02-23 Jian Cheng Wong , Abhishek Gupta , Chin Chun Ooi , Pao-Hsiung Chiu , Jiao Liu , Yew-Soon Ong

A wide spectrum of design and decision problems, including parameter tuning, A/B testing and drug design, intrinsically are instances of black-box optimization. Bayesian optimization (BO) is a powerful tool that models and optimizes such…

Machine Learning · Computer Science 2023-02-14 Tianyi Bai , Yang Li , Yu Shen , Xinyi Zhang , Wentao Zhang , Bin Cui

Black-box optimization minimizes an objective function without derivatives or explicit forms. Such an optimization method with continuous variables has been successful in the fields of machine learning and material science. For discrete…

Black-box optimization (BBO) algorithms are concerned with finding the best solutions for problems with missing analytical details. Most classical methods for such problems are based on strong and fixed a priori assumptions, such as…

Machine Learning · Computer Science 2023-02-01 Minfang Lu , Shuai Ning , Shuangrong Liu , Fengyang Sun , Bo Zhang , Bo Yang , Lin Wang

Physics-informed neural networks (PINNs) are revolutionizing science and engineering practice by bringing together the power of deep learning to bear on scientific computation. In forward modeling problems, PINNs are meshless partial…

Machine Learning · Computer Science 2023-11-28 Yicheng Wang , Xiaotian Han , Chia-Yuan Chang , Daochen Zha , Ulisses Braga-Neto , Xia Hu

Physics-informed neural networks (PINNs) [31] use automatic differentiation to solve partial differential equations (PDEs) by penalizing the PDE in the loss function at a random set of points in the domain of interest. Here, we develop a…

Neural and Evolutionary Computing · Computer Science 2019-12-03 E. Kharazmi , Z. Zhang , G. E. Karniadakis

In this paper, numerical methods using Physics-Informed Neural Networks (PINNs) are presented with the aim to solve higher-order ordinary differential equations (ODEs). Indeed, this deep-learning technique is successfully applied for…

Computational Physics · Physics 2023-07-17 Hubert Baty

In recent years, Physics-Informed Neural Networks (PINNs) have become a representative method for solving partial differential equations (PDEs) with neural networks. PINNs provide a novel approach to solving PDEs through optimization…

Computational Physics · Physics 2024-11-28 Weiwei Zhang , Wei Suo , Jiahao Song , Wenbo Cao

Bayesian optimization (BO) is widely used for black-box optimization problems, and have been shown to perform well in various real-world tasks. However, most of the existing BO methods aim to learn the optimal solution, which may become…

Machine Learning · Computer Science 2023-10-20 Xiaobin Song , Benben Jiang