English
Related papers

Related papers: Towards a Foundation Model for Partial Differentia…

200 papers

Although neural operators are widely used in data-driven physical simulations, their training remains computationally expensive. Recent advances address this issue via downstream learning, where a model pretrained on simpler problems is…

Machine Learning · Computer Science 2025-11-17 Mikhail Masliaev , Dmitry Gusarov , Ilya Markov , Alexander Hvatov

Learning probabilistic surrogates for partial differential equations remains challenging in data-scarce regimes: neural operators require large amounts of high-fidelity data, while generative approaches typically sacrifice resolution…

Computation · Statistics 2025-12-18 Sahil Bhola , Karthik Duraisamy

We utilize extreme-learning machines for the prediction of partial differential equations (PDEs). Our method splits the state space into multiple windows that are predicted individually using a single model. Despite requiring only few data…

Machine Learning · Computer Science 2024-08-20 Hans Harder , Jean Rabault , Ricardo Vinuesa , Mikael Mortensen , Sebastian Peitz

Partial differential equations (PDEs) govern a wide range of physical systems, but solving them efficiently remains a major challenge. The idea of a scientific foundation model (SciFM) is emerging as a promising tool for learning…

Machine Learning · Computer Science 2025-03-26 Amin Totounferoush , Serge Kotchourko , Michael W. Mahoney , Steffen Staab

In this work we study the problem about learning a partial differential equation (PDE) from its solution data. PDEs of various types are used as examples to illustrate how much the solution data can reveal the PDE operator depending on the…

Numerical Analysis · Mathematics 2022-11-10 Yuchen He , Hongkai Zhao , Yimin Zhong

Solving parametric Partial Differential Equations (PDEs) for a broad range of parameters is a critical challenge in scientific computing. To this end, neural operators, which \textcolor{black}{predicts the PDE solution with variable PDE…

Numerical Analysis · Mathematics 2024-11-14 Weiheng Zhong , Hadi Meidani

Advanced deep learning-based approaches have been actively applied to forecast the spatiotemporal physical dynamics governed by partial differential equations (PDEs), which acts as a critical procedure in tackling many science and…

Machine Learning · Computer Science 2026-03-03 Siyang Li , Yize Chen , Yan Guo , Ming Huang , Hui Xiong

We consider a general class of nonsmooth optimal control problems with partial differential equation (PDE) constraints, which are very challenging due to its nonsmooth objective functionals and the resulting high-dimensional and…

Optimization and Control · Mathematics 2023-07-26 Yongcun Song , Xiaoming Yuan , Hangrui Yue

Neural Ordinary Differential Equations (NODEs) have proven to be a powerful modeling tool for approximating (interpolation) and forecasting (extrapolation) irregularly sampled time series data. However, their performance degrades…

Machine Learning · Computer Science 2020-04-29 Hammad A. Ayyubi , Yi Yao , Ajay Divakaran

Neural operators have recently grown in popularity as Partial Differential Equation (PDE) surrogate models. Learning solution functionals, rather than functions, has proven to be a powerful approach to calculate fast, accurate solutions to…

Machine Learning · Computer Science 2024-09-25 Cooper Lorsung , Amir Barati Farimani

Traditional data-driven deep learning models often struggle with high training costs, error accumulation, and poor generalizability in complex physical processes. Physics-informed deep learning (PiDL) addresses these challenges by…

Machine Learning · Computer Science 2024-01-17 Xin-Yang Liu , Min Zhu , Lu Lu , Hao Sun , Jian-Xun Wang

Modeling sequential patterns from data is at the core of various time series forecasting tasks. Deep learning models have greatly outperformed many traditional models, but these black-box models generally lack explainability in prediction…

Machine Learning · Computer Science 2023-05-23 Yingtao Luo , Chang Xu , Yang Liu , Weiqing Liu , Shun Zheng , Jiang Bian

Modeling complex spatiotemporal dynamical systems, such as the reaction-diffusion processes, have largely relied on partial differential equations (PDEs). However, due to insufficient prior knowledge on some under-explored dynamical…

Machine Learning · Computer Science 2023-05-23 Chengping Rao , Pu Ren , Qi Wang , Oral Buyukozturk , Hao Sun , Yang Liu

Recent years have witnessed a growth in mathematics for deep learning--which seeks a deeper understanding of the concepts of deep learning with mathematics and explores how to make it more robust--and deep learning for mathematics, where…

Machine Learning · Computer Science 2023-10-31 Derick Nganyu Tanyu , Jianfeng Ning , Tom Freudenberg , Nick Heilenkötter , Andreas Rademacher , Uwe Iben , Peter Maass

Fractional-order differential equations (FDEs) enhance traditional differential equations by extending the order of differential operators from integers to real numbers, offering greater flexibility in modeling complex dynamical systems…

Machine Learning · Computer Science 2025-03-24 Qiyu Kang , Xuhao Li , Kai Zhao , Wenjun Cui , Yanan Zhao , Weihua Deng , Wee Peng Tay

Solving partial differential equations (PDEs) can be prohibitively expensive using traditional numerical methods. Deep learning-based surrogate models typically specialize in a single PDE with fixed parameters. We present a framework for…

Machine Learning · Computer Science 2025-11-14 Qian-Ze Zhu , Paul Raccuglia , Michael P. Brenner

Time-dependent wave equations represent an important class of partial differential equations (PDE) for describing wave propagation phenomena, which are often formulated over unbounded domains. Given a compactly supported initial condition,…

Numerical Analysis · Mathematics 2021-07-21 Changjian Xie , Jingrun Chen , Xiantao Li

Fast and accurate simulation of dynamical systems is a fundamental challenge across scientific and engineering domains. Traditional numerical integrators often face a trade-off between accuracy and computational efficiency, while existing…

Computational Engineering, Finance, and Science · Computer Science 2026-03-06 Jiaxin Yuan , Haizhao Yang , Maria Cameron

Machine learning for scientific applications faces the challenge of limited data. We propose a framework that leverages a priori known physics to reduce overfitting when training on relatively small datasets. A deep neural network is…

Machine Learning · Computer Science 2019-11-22 Jonathan B. Freund , Jonathan F. MacArt , Justin Sirignano

Neural operator learning accelerates PDE solution by approximating operators as mappings between continuous function spaces. Yet in many engineering settings, varying geometry induces discrete structural changes, including topological…

Machine Learning · Computer Science 2026-03-04 Jinshuai Bai , Haolin Li , Zahra Sharif Khodaei , M. H. Aliabadi , YuanTong Gu , Xi-Qiao Feng