English
Related papers

Related papers: A PAC-Bayesian View of Generalisation for Physics-…

200 papers

We present a unified theoretical framework for analyzing the stability and consistency of Physics-Informed Neural Networks (PINNs), grounded in operator coercivity, variational formulations, and non-asymptotic perturbation theory. PINNs…

Machine Learning · Computer Science 2025-09-04 Ronald Katende

Application of deep neural networks to medical imaging tasks has in some sense become commonplace. Still, a "thorn in the side" of the deep learning movement is the argument that deep networks are prone to overfitting and are thus unable to…

Machine Learning · Computer Science 2021-07-12 Anthony Sicilia , Xingchen Zhao , Anastasia Sosnovskikh , Seong Jae Hwang

Physics-Informed Neural Networks present a novel approach in SciML that integrates physical laws in the form of partial differential equations directly into the NN through soft constraints in the loss function. This work studies the…

Neural and Evolutionary Computing · Computer Science 2026-02-17 Suhas Suresh Bharadwaj , Reuben Thomas Thovelil

Several recent works in scientific machine learning have revived interest in the application of neural networks to partial differential equations (PDEs). A popular approach is to aggregate the residual form of the governing PDE and its…

Machine Learning · Computer Science 2023-09-13 Shamsulhaq Basir , Inanc Senocak

The combination of machine learning and physical laws has shown immense potential for solving scientific problems driven by partial differential equations (PDEs) with the promise of fast inference, zero-shot generalisation, and the ability…

Machine Learning · Computer Science 2024-09-11 Nacime Bouziani , David A. Ham , Ado Farsi

Physics-informed neural networks (PINNs) represent a new paradigm for solving partial differential equations (PDEs) by integrating physical laws into the learning process of neural networks. However, ensuring that such frameworks fully…

Machine Learning · Computer Science 2025-12-12 Nanxi Chen , Sifan Wang , Rujin Ma , Airong Chen , Chuanjie Cui

The numerical approximation of partial differential equations (PDEs) using neural networks has seen significant advancements through Physics-Informed Neural Networks (PINNs). Despite their straightforward optimization framework and…

Machine Learning · Computer Science 2025-03-19 Namgyu Kang , Jaemin Oh , Youngjoon Hong , Eunbyung Park

We present a distributionally robust PAC-Bayesian framework for certifying the performance of learning-based finite-horizon controllers. While existing PAC-Bayes control literature typically assumes bounded losses and matching training and…

Machine Learning · Computer Science 2026-04-14 Domagoj Herceg , Duarte Antunes

Physics-informed neural networks (PINNs) are a new tool for solving boundary value problems by defining loss functions of neural networks based on governing equations, boundary conditions, and initial conditions. Recent investigations have…

Computational Engineering, Finance, and Science · Computer Science 2023-11-14 Ali Harandi , Ahmad Moeineddin , Michael Kaliske , Stefanie Reese , Shahed Rezaei

Understanding real-world dynamical phenomena remains a challenging task. Across various scientific disciplines, machine learning has advanced as the go-to technology to analyze nonlinear dynamical systems, identify patterns in big data, and…

Machine Learning · Computer Science 2022-12-07 Kevin Linka , Amelie Schafer , Xuhui Meng , Zongren Zou , George Em Karniadakis , Ellen Kuhl

The Probably Approximately Correct (PAC) Bayes framework (McAllester, 1999) can incorporate knowledge about the learning algorithm and (data) distribution through the use of distribution-dependent priors, yielding tighter generalization…

Machine Learning · Computer Science 2019-04-22 Gintare Karolina Dziugaite , Daniel M. Roy

Harnessing data to discover the underlying governing laws or equations that describe the behavior of complex physical systems can significantly advance our modeling, simulation and understanding of such systems in various science and…

Machine Learning · Computer Science 2021-11-17 Zhao Chen , Yang Liu , Hao Sun

Recent work in scientific machine learning (SciML) has focused on incorporating partial differential equation (PDE) information into the learning process. Much of this work has focused on relatively "easy" PDE operators (e.g., elliptic and…

Machine Learning · Computer Science 2023-10-24 Derek Hansen , Danielle C. Maddix , Shima Alizadeh , Gaurav Gupta , Michael W. Mahoney

Generalised Bayesian learning algorithms are increasingly popular in machine learning, due to their PAC generalisation properties and flexibility. The present paper aims at providing a self-contained survey on the resulting PAC-Bayes…

Machine Learning · Statistics 2020-02-06 Benjamin Guedj

Modeling stiff partial differential equations (PDEs) with sharp gradients remains a significant challenge for scientific machine learning. While Physics-Informed Neural Networks (PINNs) struggle with spectral bias and slow training times,…

Computational Engineering, Finance, and Science · Computer Science 2026-03-09 Akshay Govind Srinivasan , Balaji Srinivasan

Deep kernel learning is a promising combination of deep neural networks and nonparametric function learning. However, as a data driven approach, the performance of deep kernel learning can still be restricted by scarce or insufficient data,…

Machine Learning · Statistics 2022-01-20 Zheng Wang , Wei Xing , Robert Kirby , Shandian Zhe

Offline goal-conditioned reinforcement learning (GCRL) learns goal-conditioned policies from static pre-collected datasets. However, accurate value estimation remains a challenge due to the limited coverage of the state-action space. Recent…

Machine Learning · Computer Science 2026-02-27 Hrishikesh Viswanath , Juanwu Lu , S. Talha Bukhari , Damon Conover , Ziran Wang , Aniket Bera

Physics-informed Neural Networks (PINNs) show that embedding physical laws directly into the learning objective can significantly enhance the efficiency and physical consistency of neural network solutions. Similar to optimizing loss…

Quantum Physics · Physics 2026-03-27 Kaichen Ouyang , Mingyang Yu , Zong Ke , Jun Zhang , Yi Chen , Huiling Chen

In this study, we present and validate the predictive capability of the Physics-Informed Neural Networks (PINNs) methodology for solving a variety of engineering and biological dynamical systems governed by ordinary differential equations…

Machine Learning · Computer Science 2025-11-19 Tyrus Whitman , Andrew Particka , Christopher Diers , Ian Griffin , Charuka Wickramasinghe , Pradeep Ranaweera

Machine learning (ML) is redefining what is possible in data-intensive fields of science and engineering. However, applying ML to problems in the physical sciences comes with a unique set of challenges: scientists want physically…

Computational Physics · Physics 2020-07-06 Kathleen Champion , Peng Zheng , Aleksandr Y. Aravkin , Steven L. Brunton , J. Nathan Kutz