English
Related papers

Related papers: NeuralStagger: Accelerating Physics-constrained Ne…

200 papers

Partial differential equations (PDEs) are central to scientific modeling. Modern workflows increasingly rely on learning-based components to support model reuse, inference, and integration across large computational processes. Despite the…

Machine Learning · Computer Science 2026-02-20 Yilong Dai , Shengyu Chen , Ziyi Wang , Xiaowei Jia , Yiqun Xie , Vipin Kumar , Runlong Yu

Machine learning for scientific applications faces the challenge of limited data. We propose a framework that leverages a priori known physics to reduce overfitting when training on relatively small datasets. A deep neural network is…

Machine Learning · Computer Science 2019-11-22 Jonathan B. Freund , Jonathan F. MacArt , Justin Sirignano

Solving partial differential equations (PDEs) with machine learning typically requires training a new neural network for every new equation. This optimization is slow. We introduce MetaColloc. It is an optimization-free and data-free…

Machine Learning · Computer Science 2026-05-13 Zichuan Yang

We present Neural Spectral Methods, a technique to solve parametric Partial Differential Equations (PDEs), grounded in classical spectral methods. Our method uses orthogonal bases to learn PDE solutions as mappings between spectral…

Machine Learning · Computer Science 2024-01-22 Yiheng Du , Nithin Chalapathi , Aditi Krishnapriyan

Learning underlying dynamics from data is important and challenging in many real-world scenarios. Incorporating differential equations (DEs) to design continuous networks has drawn much attention recently, however, most prior works make…

Machine Learning · Computer Science 2023-02-03 Yesom Park , Jaemoo Choi , Changyeon Yoon , Chang hoon Song , Myungjoo Kang

Recently, the use of neural networks to accelerate the solving of partial differential equations (PDEs) has gained significant traction in both academia and industry. However, employing neural networks as standalone surrogate models raises…

Deep learning paradigms, such as PINNs and neural operators, have significantly advanced the solving of PDEs. However, they often struggle to capture the continuous integral nature of physical systems, relying either on pointwise residuals…

Machine Learning · Computer Science 2026-05-12 Hanru Bai , Yuncheng Zhou , Difan Zou

We present a lightweighted neural PDE representation to discover the hidden structure and predict the solution of different nonlinear PDEs. Our key idea is to leverage the prior of ``translational similarity'' of numerical PDE differential…

Machine Learning · Computer Science 2023-03-14 Ziqian Wu , Xingzhe He , Yijun Li , Cheng Yang , Rui Liu , Shiying Xiong , Bo Zhu

Neural networks can be used to learn the solution of partial differential equations (PDEs) on arbitrary domains without requiring a computational mesh. Common approaches integrate differential operators in training neural networks using a…

Machine Learning · Computer Science 2022-07-07 Shamsulhaq Basir , Inanc Senocak

The growing body of research shows how to replace classical partial differential equation (PDE) integrators with neural networks. The popular strategy is to generate the input-output pairs with a PDE solver, train the neural network in the…

Numerical Analysis · Mathematics 2023-06-01 Vladimir Fanaskov , Tianchi Yu , Alexander Rudikov , Ivan Oseledets

The expedient design of precision components in aerospace and other high-tech industries requires simulations of physical phenomena often described by partial differential equations (PDEs) without exact solutions. Modern design problems…

Computational Physics · Physics 2018-01-11 Daniel J Magee , Kyle E Niemeyer

Using vanilla NeuralODEs to model large and/or complex systems often fails due two reasons: Stability and convergence. NeuralODEs are capable of describing stable as well as instable dynamic systems. Selecting an appropriate numerical…

Machine Learning · Computer Science 2023-02-23 Tobias Thummerer , Lars Mikelsons

Neural Ordinary Differential Equations (Neural ODEs) represent continuous-time dynamics with neural networks, offering advancements for modeling and control tasks. However, training Neural ODEs requires solving differential equations at…

Machine Learning · Computer Science 2025-02-24 Mariia Shapovalova , Calvin Tsay

In this paper, we propose a novel algorithm called Neuron-wise Parallel Subspace Correction Method (NPSC) for the finite neuron method that approximates numerical solutions of partial differential equations (PDEs) using neural network…

Numerical Analysis · Mathematics 2025-11-11 Jongho Park , Jinchao Xu , Xiaofeng Xu

Efficiently solving Poisson equations on complex, irregular domains remains a fundamental challenge in scientific computing, as classical iterative solvers often suffer from prohibitive runtime due to ill-conditioned systems. While neural…

Machine Learning · Computer Science 2026-05-26 Bocheng Zeng , Rui Zhang , Runze Mao , Mengtao Yan , Xuan Bai , Yang Liu , Zhi X. Chen , Hao Sun

Neural PDE surrogates can improve the cost-accuracy tradeoff of classical solvers, but often generalize poorly to new initial conditions and accumulate errors over time. Physical and symmetry constraints have shown promise in closing this…

Machine Learning · Computer Science 2025-06-09 Yunfei Huang , David S. Greenberg

Physics-based models often involve large systems of parametrized partial differential equations, where design parameters control various properties. However, high-fidelity simulations of such systems on large domains or with high grid…

Computational Physics · Physics 2025-05-15 Diba Behnoudfar

Numerical simulations for engineering applications solve partial differential equations (PDE) to model various physical processes. Traditional PDE solvers are very accurate but computationally costly. On the other hand, Machine Learning…

Machine Learning · Computer Science 2021-10-11 Rishikesh Ranade , Chris Hill , Haiyang He , Amir Maleki , Norman Chang , Jay Pathak

Parametric partial differential equations (PDEs) are fundamental for modeling a wide range of physical and engineering systems influenced by uncertain or varying parameters. Traditional neural network-based solvers, such as Physics-Informed…

Machine Learning · Computer Science 2025-12-29 Qiuqi Li , Yiting Liu , Jin Zhao , Wencan Zhu

Fast and accurate solution of time-dependent partial differential equations (PDEs) is of key interest in many research fields including physics, engineering, and biology. Generally, implicit schemes are preferred over the explicit ones for…

Numerical Analysis · Mathematics 2019-11-28 Suprosanna Shit , Abinav Ravi Venkatakrishnan , Ivan Ezhov , Jana Lipkova , Marie Piraud , Bjoern Menze