English
Related papers

Related papers: UPS: Efficiently Building Foundation Models for PD…

200 papers

This paper introduces PDEformer-1, a versatile neural solver capable of simultaneously addressing various partial differential equations (PDEs). With the PDE represented as a computational graph, we facilitate the seamless integration of…

Numerical Analysis · Mathematics 2025-01-28 Zhanhong Ye , Xiang Huang , Leheng Chen , Zining Liu , Bingyang Wu , Hongsheng Liu , Zidong Wang , Bin Dong

This paper introduces PDEformer, a neural solver for partial differential equations (PDEs) capable of simultaneously addressing various types of PDEs. We propose to represent the PDE in the form of a computational graph, facilitating the…

Numerical Analysis · Mathematics 2025-01-28 Zhanhong Ye , Xiang Huang , Leheng Chen , Hongsheng Liu , Zidong Wang , Bin Dong

We propose the *State Space Neural Operator* (SS-NO), a compact architecture for learning solution operators of time-dependent partial differential equations (PDEs). Our formulation extends structured state space models (SSMs) to joint…

Machine Learning · Computer Science 2026-03-09 Nodens Koren , Samuel Lanthaler

Neural operators, serving as physics surrogate models, have recently gained increased interest. With ever increasing problem complexity, the natural question arises: what is an efficient way to scale neural operators to larger and more…

Machine Learning · Computer Science 2025-02-28 Benedikt Alkin , Andreas Fürst , Simon Schmid , Lukas Gruber , Markus Holzleitner , Johannes Brandstetter

Fourier neural operators (FNOs) are a recently introduced neural network architecture for learning solution operators of partial differential equations (PDEs), which have been shown to perform significantly better than comparable deep…

Partial differential equations (PDEs) are widely used across the physical and computational sciences. Decades of research and engineering went into designing fast iterative solution methods. Existing solvers are general purpose, but may be…

Numerical Analysis · Mathematics 2024-09-23 Jun-Ting Hsieh , Shengjia Zhao , Stephan Eismann , Lucia Mirabella , Stefano Ermon

Solving Partial Differential Equations (PDEs) is fundamental to numerous scientific and engineering disciplines. A common challenge arises from solving the PDE families, which are characterized by sharing an identical mathematical structure…

Artificial Intelligence · Computer Science 2026-02-13 Yipeng Huang , Dejun Xu , Zexin Lin , Zhenzhong Wang , Min Jiang

The numerical solution of partial differential equations (PDEs) is fundamental to scientific and engineering computing. In the presence of strong anisotropy, material heterogeneity, and complex geometries, however, classical iterative…

Numerical Analysis · Mathematics 2026-03-26 Yun Liu , Chen Cui , Shi Shu , Zhen Wang

In this work, we study physics-informed neural networks (PINNs) constrained by partial differential equations (PDEs) and their application in approximating PDEs with two characteristic scales. From a continuous perspective, our formulation…

Optimization and Control · Mathematics 2024-09-06 Michael Hintermüller , Denis Korolev

Stochastic partial differential equations (SPDEs) are the mathematical tool of choice for modelling spatiotemporal PDE-dynamics under the influence of randomness. Based on the notion of mild solution of an SPDE, we introduce a novel neural…

Machine Learning · Computer Science 2022-09-27 Cristopher Salvi , Maud Lemercier , Andris Gerasimovics

Partial differential equations (PDEs) are fundamental for modeling complex physical systems, yet classical numerical solvers face prohibitive computational costs in high-dimensional and multi-scale regimes. While Transformer-based neural…

Machine Learning · Computer Science 2026-03-04 Pengyu Lai , Yixiao Chen , Dewu Yang , Rui Wang , Feng Wang , Hui Xu

Partial differential equations (PDEs) play a crucial role in studying a vast number of problems in science and engineering. Numerically solving nonlinear and/or high-dimensional PDEs is often a challenging task. Inspired by the traditional…

Numerical Analysis · Mathematics 2022-01-11 Yihao Hu , Tong Zhao , Shixin Xu , Zhiliang Xu , Lizhen Lin

Recent years have witnessed the promise of coupling machine learning methods and physical domain-specific insights for solving scientific problems based on partial differential equations (PDEs). However, being data-intensive, these methods…

Machine Learning · Computer Science 2025-06-03 Wuyang Chen , Jialin Song , Pu Ren , Shashank Subramanian , Dmitriy Morozov , Michael W. Mahoney

There has recently been increasing attention towards developing foundational neural Partial Differential Equation (PDE) solvers and neural operators through large-scale pretraining. However, unlike vision and language models that make use…

Machine Learning · Computer Science 2024-11-21 AmirPouya Hemmasian , Amir Barati Farimani

Recently, researchers have utilized neural networks to accurately solve partial differential equations (PDEs), enabling the mesh-free method for scientific computation. Unfortunately, the network performance drops when encountering a high…

Machine Learning · Computer Science 2021-09-29 Pongpisit Thanasutives , Masayuki Numao , Ken-ichi Fukui

Neural solvers for partial differential equations (PDEs) have great potential to generate fast and accurate physics solutions, yet their practicality is currently limited by their generalizability. PDEs evolve over broad scales and exhibit…

Machine Learning · Computer Science 2024-12-06 Anthony Zhou , Amir Barati Farimani

We propose a novel machine learning framework for solving optimization problems governed by large-scale partial differential equations (PDEs) with high-dimensional random parameters. Such optimization under uncertainty (OUU) problems may be…

Optimization and Control · Mathematics 2023-06-01 Dingcheng Luo , Thomas O'Leary-Roseberry , Peng Chen , Omar Ghattas

Physics-Informed Neural Networks (PINNs) have emerged as a powerful framework for solving partial differential equations (PDEs) by embedding physical laws into neural network training. However, traditional PINN models are typically designed…

Machine Learning · Computer Science 2025-05-05 Keon Vin Park

Unified models (UMs) hold promise for their ability to understand and generate content across heterogeneous modalities. Compared to merely generating visual content, the use of UMs for interleaved cross-modal reasoning is more promising and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Jiachun Jin , Zetong Zhou , Xiao Yang , Hao Zhang , Pengfei Liu , Jun Zhu , Zhijie Deng

Partial differential equations (PDEs) underpin the modeling of many natural and engineered systems. It can be convenient to express such models as neural PDEs rather than using traditional numerical PDE solvers by replacing part or all of…

Machine Learning · Computer Science 2025-09-26 Sanket Jantre , Deepak Akhare , Zhiyuan Wang , Xiaoning Qian , Nathan M. Urban