English
Related papers

Related papers: A PAC-Bayesian View of Generalisation for Physics-…

200 papers

The integration of machine learning with domain-specific physics is transforming the design, monitoring, and control of electricity systems, where data scarcity, limited interpretability, and the need to enforce physical laws constrain…

Systems and Control · Electrical Eng. & Systems 2026-05-22 Joseph Nyangon

Metal additive manufacturing enables unprecedented design freedom and the production of customized, complex components. However, the rapid melting and solidification dynamics inherent to metal AM processes generate heterogeneous,…

Machine Learning · Computer Science 2025-05-05 D. Patel , R. Sharma , Y. B. Guo

Traditional data-driven deep learning models often struggle with high training costs, error accumulation, and poor generalizability in complex physical processes. Physics-informed deep learning (PiDL) addresses these challenges by…

Machine Learning · Computer Science 2024-01-17 Xin-Yang Liu , Min Zhu , Lu Lu , Hao Sun , Jian-Xun Wang

Many practical machine learning tasks can be framed as Structured prediction problems, where several output variables are predicted and considered interdependent. Recent theoretical advances in structured prediction have focused on…

Machine Learning · Computer Science 2020-12-22 Théophile Cantelobre , Benjamin Guedj , María Pérez-Ortiz , John Shawe-Taylor

Machine Learning (ML) has widely been used for modeling and predicting physical systems. These techniques offer high expressive power and good generalizability for interpolation within observed data sets. However, the disadvantage of…

Machine Learning · Statistics 2023-03-02 Omid Sedehi , Antonina M. Kosikova , Costas Papadimitriou , Lambros S. Katafygiotis

Complex optimal design and control processes often require repeated evaluations of expensive objective functions and consist of large design spaces. Data-driven surrogates such as neural networks and Gaussian processes provide an attractive…

Computational Engineering, Finance, and Science · Computer Science 2023-07-10 Manaswin Oddiraju , Divyang Amin , Michael Piedmonte , Souma Chowdhury

PAC-Bayes learning is an established framework to both assess the generalisation ability of learning algorithms, and design new learning algorithm by exploiting generalisation bounds as training objectives. Most of the exisiting bounds…

Machine Learning · Statistics 2023-05-31 Maxime Haddouche , Benjamin Guedj

Current hydrological modeling methods combine data-driven Machine Learning (ML) algorithms and traditional physics-based models to address their respective limitations incorrect parameter estimates from rigid physics-based models and the…

Machine Learning · Computer Science 2024-02-22 Mostafa Esmaeilzadeh , Melika Amirzadeh

Physics-informed machine learning (PIML) has emerged as a promising alternative to conventional numerical methods for solving partial differential equations (PDEs). PIML models are increasingly built via deep neural networks (NNs) whose…

Machine Learning · Computer Science 2024-09-30 Carlos Mora , Amin Yousefpour , Shirin Hosseinmardi , Ramin Bostanabad

We propose data-dependent uniform generalization bounds by approaching the problem from a PAC-Bayesian perspective. We first apply the PAC-Bayesian framework on "random sets" in a rigorous way, where the training algorithm is assumed to…

Machine Learning · Statistics 2025-02-11 Benjamin Dupuis , Paul Viallard , George Deligiannidis , Umut Simsekli

This paper presents a new approach to simulate forward and inverse problems of moving loads using physics-informed machine learning (PIML). Physics-informed neural networks (PINNs) utilize the underlying physics of moving load problems and…

Machine Learning · Computer Science 2023-04-04 Taniya Kapoor , Hongrui Wang , Alfredo Núñez , Rolf Dollevoet

This position paper takes a broad look at Physics-Enhanced Machine Learning (PEML) -- also known as Scientific Machine Learning -- with particular focus to those PEML strategies developed to tackle dynamical systems' challenges. The need to…

Machine Learning · Computer Science 2024-12-30 Alice Cicirello

PAC-Bayesian is an analysis framework where the training error can be expressed as the weighted average of the hypotheses in the posterior distribution whilst incorporating the prior knowledge. In addition to being a pure generalization…

Machine Learning · Computer Science 2022-02-07 Wei Huang , Chunrui Liu , Yilan Chen , Tianyu Liu , Richard Yi Da Xu

This paper is aimed at using the newly developing field of physics informed machine learning (PIML) to develop models for predicting the remaining useful lifetime (RUL) aircraft engines. We consider the well-known benchmark NASA Commercial…

Machine Learning · Computer Science 2024-06-25 Sriram Nagaraj , Truman Hickok

Previous research on PAC-Bayes learning theory has focused extensively on establishing tight upper bounds for test errors. A recently proposed training procedure called PAC-Bayes training, updates the model toward minimizing these bounds.…

Machine Learning · Statistics 2024-10-22 Xitong Zhang , Avrajit Ghosh , Guangliang Liu , Rongrong Wang

Physics-informed machine learning (PIML) provides a promising solution for building energy modeling and can serve as a virtual environment to enable reinforcement learning (RL) agents to interact and learn. However, challenges remain in…

Systems and Control · Electrical Eng. & Systems 2025-12-16 Zixin Jiang , Xuezheng Wang , Bing Dong

Minimising upper bounds on the population risk or the generalisation gap has been widely used in structural risk minimisation (SRM) -- this is in particular at the core of PAC-Bayesian learning. Despite its successes and unfailing surge of…

Machine Learning · Statistics 2023-10-30 Paul Viallard , Maxime Haddouche , Umut Şimşekli , Benjamin Guedj

Machine learning has emerged as a powerful tool in various fields, including computer vision, natural language processing, and speech recognition. It can unravel hidden patterns within large data sets and reveal unparalleled insights,…

Machine Learning · Computer Science 2024-05-24 Abdeldjalil Latrach , Mohamed Lamine Malki , Misael Morales , Mohamed Mehana , Minou Rabiei

This study investigates why physics-informed machine learning (PIML) can fail in macroscopic traffic flow modeling. We define failure as cases where a PIML model underperforms both purely data-driven and purely physics-based baselines by a…

Machine Learning · Computer Science 2025-09-16 Yuan-Zheng Lei , Yaobang Gong , Dianwei Chen , Yao Cheng , Xianfeng Terry Yang

We present a PAC-Bayes-style generalization bound which enables the replacement of the KL-divergence with a variety of Integral Probability Metrics (IPM). We provide instances of this bound with the IPM being the total variation metric and…

Machine Learning · Statistics 2023-01-02 Ron Amit , Baruch Epstein , Shay Moran , Ron Meir