English
Related papers

Related papers: Neural Preconditioning Operator for Efficient PDE …

200 papers

Pre-training has been investigated to improve the efficiency and performance of training neural operators in data-scarce settings. However, it is largely in its infancy due to the inherent complexity and diversity, such as long…

Machine Learning · Computer Science 2024-05-08 Zhongkai Hao , Chang Su , Songming Liu , Julius Berner , Chengyang Ying , Hang Su , Anima Anandkumar , Jian Song , Jun Zhu

Modern power systems require fast and accurate dynamic simulations for stability assessment, digital twins, and real-time control, but classical ODE solvers are often too slow for large-scale or online applications. We propose a…

Systems and Control · Electrical Eng. & Systems 2025-11-10 Ioannis Karampinis , Petros Ellinas , Johanna Vorwerk , Spyros Chatzivasileiadis

Traditional approaches to stabilizing hyperbolic PDEs, such as PDE backstepping, often encounter challenges when dealing with high-dimensional or complex nonlinear problems. Their solutions require high computational and analytical costs.…

Analysis of PDEs · Mathematics 2024-11-08 Xianhe Zhang , Yu Xiao , Xiaodong Xu , Biao Luo

Preconditioning has long been a staple technique in optimization, often applied to reduce the condition number of a matrix and speed up the convergence of algorithms. Although there are many popular preconditioning techniques in practice,…

Optimization and Control · Mathematics 2022-11-08 Zhaonan Qu , Wenzhi Gao , Oliver Hinder , Yinyu Ye , Zhengyuan Zhou

We introduce a novel Multimodal Neural Operator (MNO) architecture designed to learn solution operators for multi-parameter nonlinear boundary value problems (BVPs). Traditional neural operators primarily map either the PDE coefficients or…

Computational Engineering, Finance, and Science · Computer Science 2025-07-17 Vamshi C. Madala , Nithin Govindarajan , Shivkumar Chandrasekaran

Neural operators generalize classical neural networks to maps between infinite-dimensional spaces, e.g., function spaces. Prior works on neural operators proposed a series of novel methods to learn such maps and demonstrated unprecedented…

Machine Learning · Computer Science 2023-05-08 Md Ashiqur Rahman , Zachary E. Ross , Kamyar Azizzadenesheli

Long-term fluid dynamics forecasting is a critically important problem in science and engineering. While neural operators have emerged as a promising paradigm for modeling systems governed by partial differential equations (PDEs), they…

Machine Learning · Computer Science 2026-03-31 Huanshuo Dong , Hao Wu , Hong Wang , Qin-Yi Zhang , Zhezheng Hao

Minimizing PDE-residual losses is a common strategy to promote physical consistency in neural operators. However, standard formulations often lack variational correctness, meaning that small residuals do not guarantee small solution errors…

Numerical Analysis · Mathematics 2025-12-25 Yuan Qiu , Wolfgang Dahmen , Peng Chen

Partial Differential Equations (PDEs) are central to science and engineering. Since solving them is computationally expensive, a lot of effort has been put into approximating their solution operator via both traditional and recently…

Machine Learning · Computer Science 2025-02-14 Alessandro Longhi , Danny Lathouwers , Zoltán Perkó

Solving partial differential equations (PDEs) by learning the solution operators has emerged as an attractive alternative to traditional numerical methods. However, implementing such architectures presents two main challenges: flexibility…

Machine Learning · Computer Science 2023-12-19 Seungjun Lee , Taeil Oh

Nonlinear model predictive control (NMPC) often requires real-time solution to optimization problems. However, in cases where the mathematical model is of high dimension in the solution space, e.g. for solution of partial differential…

The convergence behavior of classical iterative solvers for parametric partial differential equations (PDEs) is often highly sensitive to the domain and specific discretization of PDEs. Previously, we introduced hybrid solvers by combining…

Machine Learning · Computer Science 2025-12-17 Youngkyu Lee , Francesc Levrero Florencio , Jay Pathak , George Em Karniadakis

Neural ordinary differential equations (NODEs) are an effective approach for data-driven modeling of dynamical systems arising from simulations and experiments. One of the major shortcomings of NODEs, especially when coupled with explicit…

Numerical Analysis · Mathematics 2025-12-30 Allen Alvarez Loya , Daniel A. Serino , J. W. Burby , Qi Tang

Recently, the use of neural networks to accelerate the solving of partial differential equations (PDEs) has gained significant traction in both academia and industry. However, employing neural networks as standalone surrogate models raises…

Solving partial differential equations (PDEs) efficiently is essential for analyzing complex physical systems. Recent advancements in leveraging deep learning for solving PDE have shown significant promise. However, machine learning…

Machine Learning · Computer Science 2024-02-16 Ruichen Li , Chuwei Wang , Haotian Ye , Di He , Liwei Wang

We propose the Factorized Fourier Neural Operator (F-FNO), a learning-based approach for simulating partial differential equations (PDEs). Starting from a recently proposed Fourier representation of flow fields, the F-FNO bridges the…

Machine Learning · Computer Science 2023-03-03 Alasdair Tran , Alexander Mathews , Lexing Xie , Cheng Soon Ong

Physics-informed deep learning often faces optimization challenges due to the complexity of solving partial differential equations (PDEs), which involve exploring large solution spaces, require numerous iterations, and can lead to unstable…

The discretization of the double-layer potential integral equation for the interior Dirichlet Laplace problem in a domain with smooth boundary results in a linear system that has a bounded condition number. Thus, the number of iterations…

Numerical Analysis · Mathematics 2014-02-27 Bryan Quaife , George Biros

Physics-informed neural networks (PINNs) have made significant strides in modeling dynamical systems governed by partial differential equations (PDEs). However, their generalization capabilities across varying scenarios remain limited. To…

Machine Learning · Computer Science 2024-12-02 Honghui Wang , Yifan Pu , Shiji Song , Gao Huang

Learning partial differential equations' (PDEs) solution operators is an essential problem in machine learning. However, there are several challenges for learning operators in practical applications like the irregular mesh, multiple input…

Machine Learning · Computer Science 2023-06-16 Zhongkai Hao , Zhengyi Wang , Hang Su , Chengyang Ying , Yinpeng Dong , Songming Liu , Ze Cheng , Jian Song , Jun Zhu