English
Related papers

Related papers: Physics-informed fine-tuning of foundation models …

200 papers

Foundation models have revolutionized artificial intelligence by providing robust, versatile architectures pre-trained on large-scale datasets. However, adapting these massive models to specific downstream tasks requires fine-tuning, which…

Machine Learning · Computer Science 2025-05-01 Jieming Bian , Yuanzhe Peng , Lei Wang , Yin Huang , Jie Xu

Partial differential equations (PDEs) govern physical phenomena across the full range of scientific scales, yet their computational solution remains one of the defining challenges of modern science. This critical review examines two mature…

Machine Learning · Computer Science 2026-03-10 Mohammad Nooraiepour , Jakub Wiktor Both , Teeratorn Kadeethum , Saeid Sadeghnejad

This paper presents a physics-informed training framework for projection-based Reduced Order Models (ROMs). We extend the PROM-ANN architecture by complementing snapshot-based training with a FEM-based, discrete physics-informed residual…

Machine Learning · Computer Science 2025-10-27 N. Sibuet , S. Ares de Parga , J. R. Bravo , R. Rossi

Physics-Informed Neural Networks (PINNs) are a class of deep learning neural networks that learn the response of a physical system without any simulation data, and only by incorporating the governing partial differential equations (PDEs) in…

Machine Learning · Computer Science 2023-12-19 Rini J. Gladstone , Mohammad A. Nabian , N. Sukumar , Ankit Srivastava , Hadi Meidani

Partial differential equations (PDEs) are an essential computational kernel in physics and engineering. With the advance of deep learning, physics-informed neural networks (PINNs), as a mesh-free method, have shown great potential for fast…

Machine Learning · Computer Science 2023-06-19 Junjun Yan , Xinhai Chen , Zhichao Wang , Enqiang Zhoui , Jie Liu

The field of partial differential equations (PDEs) is vast in size and diversity. The basic reason for this is that essentially all fundamental laws of physics are formulated in terms of PDEs. In addition, approximations to these…

History and Overview · Mathematics 2019-01-11 Per Kristen Jakobsen

As traditional machine learning tools are increasingly applied to science and engineering applications, physics-informed methods have emerged as effective tools for endowing inferences with properties essential for physical realizability.…

Numerical Analysis · Mathematics 2020-12-23 Nathaniel Trask , Andy Huang , Xiaozhe Hu

The discovery of partial differential equations (PDEs) is a challenging task that involves both theoretical and empirical methods. Machine learning approaches have been developed and used to solve this problem; however, it is important to…

Machine Learning · Statistics 2023-06-09 Kalpesh More , Tapas Tripura , Rajdip Nayek , Souvik Chakraborty

(Partial) differential equations (PDEs) are fundamental tools for describing natural phenomena, making their solution crucial in science and engineering. While traditional methods, such as the finite element method, provide reliable…

Machine Learning · Computer Science 2025-03-11 Viggo Moro , Luiz F. O. Chamon

The measured spatiotemporal response of various physical processes is utilized to infer the governing partial differential equations (PDEs). We propose SimultaNeous Basis Function Approximation and Parameter Estimation (SNAPE), a technique…

Machine Learning · Computer Science 2021-09-17 Sutanu Bhowmick , Satish Nagarajaiah

Solving partial differential equations (PDEs) can be prohibitively expensive using traditional numerical methods. Deep learning-based surrogate models typically specialize in a single PDE with fixed parameters. We present a framework for…

Machine Learning · Computer Science 2025-11-14 Qian-Ze Zhu , Paul Raccuglia , Michael P. Brenner

Physics Informed Neural Networks (PINNs) have frequently been used for the numerical approximation of Partial Differential Equations (PDEs). The goal of this paper is to construct PINNs along with a computable upper bound of the error,…

Numerical Analysis · Mathematics 2022-12-19 Lewin Ernst , Karsten Urban

Modeling nonlinear spatiotemporal dynamical systems has primarily relied on partial differential equations (PDEs). However, the explicit formulation of PDEs for many underexplored processes, such as climate systems, biochemical reaction and…

Machine Learning · Computer Science 2023-05-23 Chengping Rao , Hao Sun , Yang Liu

Foundation models are an emerging research direction in tabular deep learning. Notably, TabPFNv2 recently claimed superior performance over traditional GBDT-based methods on small-scale datasets using an in-context learning paradigm, which…

Machine Learning · Computer Science 2025-06-12 Ivan Rubachev , Akim Kotelnikov , Nikolay Kartashev , Artem Babenko

Physics-informed neural networks (PINNs) have emerged as a powerful paradigm for solving partial differential equations (PDEs) by embedding physical laws directly into neural network training. However, solving high-fidelity PDEs remains…

Machine Learning · Computer Science 2026-02-03 Olaf Yunus Laitinen Imanov

Physics-informed neural networks approach the approximation of differential equations by directly incorporating their structure and given conditions in a loss function. This enables conditions like, e.g., invariants to be easily added…

Machine Learning · Computer Science 2025-08-20 Santosh Humagain , Toni Schneidereit

The numerical simulation and optimization of technical systems described by partial differential equations is expensive, especially in multi-query scenarios in which the underlying equations have to be solved for different parameters. A…

Numerical Analysis · Mathematics 2025-04-09 Franziska Griese , Fabian Hoppe , Alexander Rüttgers , Philipp Knechtges

We propose a Pretrained Finite Element Method (PFEM),a physics driven framework that bridges the efficiency of neural operator learning with the accuracy and robustness of classical finite element methods (FEM). PFEM consists of a physics…

Simulations of complex physical systems are typically realized by discretizing partial differential equations (PDEs) on unstructured meshes. While neural networks have recently been explored for surrogate and reduced order modeling of PDE…

Machine Learning · Computer Science 2021-10-27 Jiayang Xu , Aniruddhe Pradhan , Karthik Duraisamy

The use of neural networks to approximate partial differential equations (PDEs) has gained significant attention in recent years. However, the approximation of PDEs with localised phenomena, e.g., sharp gradients and singularities, remains…

Numerical Analysis · Mathematics 2025-01-30 Santiago Badia , Wei Li , Alberto F. Martín
‹ Prev 1 8 9 10 Next ›