English
Related papers

Related papers: SPUS: A Lightweight and Parameter-Efficient Founda…

200 papers

We present Unified PDE Solvers (UPS), a data- and compute-efficient approach to developing unified neural operators for diverse families of spatiotemporal PDEs from various domains, dimensions, and resolutions. UPS embeds different PDEs…

Machine Learning · Computer Science 2024-11-26 Junhong Shen , Tanya Marwah , Ameet Talwalkar

Physics-Informed Neural Networks (PINNs) have emerged as a powerful framework for solving partial differential equations (PDEs) by embedding physical laws into neural network training. However, traditional PINN models are typically designed…

Machine Learning · Computer Science 2025-05-05 Keon Vin Park

We propose S$^2$GPT-PINN, a sparse and small model for solving parametric partial differential equations (PDEs). Similar to Small Language Models (SLMs), S$^2$GPT-PINN is tailored to domain-specific (families of) PDEs and characterized by…

Machine Learning · Computer Science 2025-06-23 Yajie Ji , Yanlai Chen , Shawn Koohy

Background: Deep learning techniques, particularly neural networks, have revolutionized computational physics, offering powerful tools for solving complex partial differential equations (PDEs). However, ensuring stability and efficiency…

Artificial Intelligence · Computer Science 2024-07-11 A. Noorizadegan , R. Cavoretto , D. L. Young , C. S. Chen

Deep learning-based methods have shown remarkable effectiveness in solving PDEs, largely due to their ability to enable fast simulations once trained. However, despite the availability of high-performance computing infrastructure, many…

Machine Learning · Computer Science 2026-02-23 Pietro Sittoni , Emanuele Zangrando , Angelo A. Casulli , Nicola Guglielmi , Francesco Tudisco

Partial differential equations (PDEs) govern a wide range of physical systems, but solving them efficiently remains a major challenge. The idea of a scientific foundation model (SciFM) is emerging as a promising tool for learning…

Machine Learning · Computer Science 2025-03-26 Amin Totounferoush , Serge Kotchourko , Michael W. Mahoney , Steffen Staab

The numerical solution of partial differential equations (PDEs) is fundamental to scientific and engineering computing. In the presence of strong anisotropy, material heterogeneity, and complex geometries, however, classical iterative…

Numerical Analysis · Mathematics 2026-03-26 Yun Liu , Chen Cui , Shi Shu , Zhen Wang

Neural networks have shown promising potential in accelerating the numerical simulation of systems governed by partial differential equations (PDEs). Different from many existing neural network surrogates operating on high-dimensional…

Machine Learning · Computer Science 2025-01-09 Zijie Li , Saurabh Patil , Francis Ogoke , Dule Shu , Wilson Zhen , Michael Schneier , John R. Buchanan, , Amir Barati Farimani

We present PDE-FM, a modular foundation model for physics-informed machine learning that unifies spatial, spectral, and temporal reasoning across heterogeneous partial differential equation (PDE) systems. PDE-FM combines spatial-spectral…

Machine Learning · Computer Science 2025-12-01 Eduardo Soares , Emilio Vital Brazil , Victor Shirasuna , Breno W. S. R. de Carvalho , Cristiano Malossi

We propose a finite-element local basis-based operator learning framework for solving partial differential equations (PDEs). Operator learning aims to approximate mappings from input functions to output functions, where the latter are…

Numerical Analysis · Mathematics 2025-11-03 Zecheng Zhang , Hao Liu , Guosheng Fu , Hayden Schaeffer , Guang Lin

We introduce a class of Sparse, Physics-based, and partially Interpretable Neural Networks (SPINN) for solving ordinary and partial differential equations (PDEs). By reinterpreting a traditional meshless representation of solutions of PDEs…

Machine Learning · Computer Science 2021-08-13 Amuthan A. Ramabathiran , Prabhu Ramachandran

We introduce a method that combines neural operators, physics-informed machine learning, and standard numerical methods for solving PDEs. The proposed approach extends each of the aforementioned methods and unifies them within a single…

Computational Engineering, Finance, and Science · Computer Science 2025-12-02 Shahed Rezaei , Reza Najian Asl , Kianoosh Taghikhani , Ahmad Moeineddin , Michael Kaliske , Markus Apel

Developing efficient methods for solving parametric partial differential equations is crucial for addressing inverse problems. This work introduces a Least-Squares-based Neural Network (LS-Net) method for solving linear parametric PDEs. It…

Numerical Analysis · Mathematics 2025-02-13 Shima Baharlouei , Jamie M. Taylor , Carlos Uriarte , David Pardo

In this work, we propose an adaptive sparse learning algorithm that can be applied to learn the physical processes and obtain a sparse representation of the solution given a large snapshot space. Assume that there is a rich class of…

Machine Learning · Computer Science 2022-07-26 Yating Wang , Wing Tat Leung , Guang Lin

We investigate numerous structural connections between numerical algorithms for partial differential equations (PDEs) and neural architectures. Our goal is to transfer the rich set of mathematical foundations from the world of PDEs to…

Numerical Analysis · Mathematics 2022-03-22 Tobias Alt , Karl Schrader , Matthias Augustin , Pascal Peter , Joachim Weickert

Neural networks are one tool for approximating non-linear differential equations used in scientific computing tasks such as surrogate modeling, real-time predictions, and optimal control. PDE foundation models utilize neural networks to…

Machine Learning · Computer Science 2025-02-11 Elisa Negrini , Yuxuan Liu , Liu Yang , Stanley J. Osher , Hayden Schaeffer

A novel approach to approximate solutions of Stochastic Differential Equations (SDEs) by Deep Neural Networks is derived and analysed. The architecture is inspired by the notion of Deep Operator Networks (DeepONets), which is based on…

Numerical Analysis · Mathematics 2025-12-23 Martin Eigel , Charles Miranda

Physics-informed neural operators have emerged as a powerful paradigm for solving parametric partial differential equations (PDEs), particularly in the aerospace field, enabling the learning of solution operators that generalize across…

Machine Learning · Computer Science 2025-06-24 Jing Wang , Biao Chen , Hairun Xie , Rui Wang , Yifan Xia , Jifa Zhang , Hui Xu

We introduce Poseidon, a foundation model for learning the solution operators of PDEs. It is based on a multiscale operator transformer, with time-conditioned layer norms that enable continuous-in-time evaluations. A novel training strategy…

While Physics-Informed Neural Networks (PINNs) offer a mesh-free approach to solving PDEs, standard point-wise residual minimization suffers from convergence pathologies in topologically complex domains like Triply Periodic Minimal Surfaces…

Machine Learning · Computer Science 2026-03-11 Weizheng Zhang , Xunjie Xie , Hao Pan , Xiaowei Duan , Bingteng Sun , Qiang Du , Lin Lu
‹ Prev 1 2 3 10 Next ›