English
Related papers

Related papers: Solving High-Dimensional PDEs with Latent Spectral…

200 papers

Latent neural stochastic differential equations (SDEs) have recently emerged as a promising approach for learning generative models from stochastic time series data. However, they systematically underestimate the noise level inherent in…

Machine Learning · Computer Science 2025-06-11 Linus Heck , Maximilian Gelbrecht , Michael T. Schaub , Niklas Boers

Neural networks have shown significant potential in solving partial differential equations (PDEs). While deep networks are capable of approximating complex functions, direct one-shot training often faces limitations in both accuracy and…

Numerical Analysis · Mathematics 2025-03-10 Mingxing Weng , Zhiping Mao , Jie Shen

We introduce variational spectral learning (VSL), a machine learning framework for solving partial differential equations (PDEs) that operates directly in the coefficient space of spectral expansions. VSL offers a principled bridge between…

Numerical Analysis · Mathematics 2026-01-07 M. M. Hammad

Fast and accurate solutions of time-dependent partial differential equations (PDEs) are of pivotal interest to many research fields, including physics, engineering, and biology. Generally, implicit/semi-implicit schemes are preferred over…

Physical systems whose dynamics are governed by partial differential equations (PDEs) find applications in numerous fields, from engineering design to weather forecasting. The process of obtaining the solution from such PDEs may be…

Machine Learning · Computer Science 2022-09-21 Pratyush Bhatt , Yash Kumar , Azzeddine Soulaimani

State-space models (SSMs) offer a powerful framework for dynamical system analysis, wherein the temporal dynamics of the system are assumed to be captured through the evolution of the latent states, which govern the values of the…

Machine Learning · Statistics 2024-12-17 Jiahe Lin , George Michailidis

We present a new framework for computing fine-scale solutions of multiscale Partial Differential Equations (PDEs) using operator learning tools. Obtaining fine-scale solutions of multiscale PDEs can be challenging, but there are many…

Numerical Analysis · Mathematics 2023-08-29 Zecheng Zhang , Christian Moya , Wing Tat Leung , Guang Lin , Hayden Schaeffer

Numerical approximations of partial differential equations (PDEs) are routinely employed to formulate the solution of physics, engineering, and mathematical problems involving functions of several variables, such as the propagation of heat…

Physics-informed deep learning often faces optimization challenges due to the complexity of solving partial differential equations (PDEs), which involve exploring large solution spaces, require numerous iterations, and can lead to unstable…

Many scientific and industrial applications require solving Partial Differential Equations (PDEs) to describe the physical phenomena of interest. Some examples can be found in the fields of aerodynamics, astrodynamics, combustion and many…

Computational Physics · Physics 2019-12-11 Juan B. Pedro , Juan Maroñas , Roberto Paredes

We develop a novel computational framework to approximate solution operators of evolution partial differential equations (PDEs). By employing a general nonlinear reduced-order model, such as a deep neural network, to approximate the…

Numerical Analysis · Mathematics 2023-11-13 Nathan Gaby , Xiaojing Ye , Haomin Zhou

We combine concepts from multilevel solvers for partial differential equations (PDEs) with neural network based deep learning and propose a new methodology for the efficient numerical solution of high-dimensional parametric PDEs. An…

Machine Learning · Computer Science 2023-04-05 Cosmas Heiß , Ingo Gühring , Martin Eigel

The use of deep learning methods for solving PDEs is a field in full expansion. In particular, Physical Informed Neural Networks, that implement a sampling of the physical domain and use a loss function that penalizes the violation of the…

Machine Learning · Computer Science 2021-12-08 Valentin Mercier , Serge Gratton , Pierre Boudier

Recently, researchers have utilized neural networks to accurately solve partial differential equations (PDEs), enabling the mesh-free method for scientific computation. Unfortunately, the network performance drops when encountering a high…

Machine Learning · Computer Science 2021-09-29 Pongpisit Thanasutives , Masayuki Numao , Ken-ichi Fukui

In this review, we survey the latest approaches and techniques developed to overcome the spectral bias towards low frequency of deep neural network learning methods in learning multiple-frequency solutions of partial differential equations.…

Numerical Analysis · Mathematics 2025-01-20 Zhi-Qin John Xu , Lulu Zhang , Wei Cai

Solving high-dimensional partial differential equations (PDEs) is a major challenge in scientific computing. We develop a new numerical method for solving elliptic-type PDEs by adapting the Q-learning algorithm in reinforcement learning.…

Numerical Analysis · Mathematics 2023-06-27 Samuel N. Cohen , Deqing Jiang , Justin Sirignano

Rapidly developing machine learning methods has stimulated research interest in computationally reconstructing differential equations (DEs) from observational data which may provide additional insight into underlying causative mechanisms.…

Machine Learning · Computer Science 2026-05-12 Mingtao Xia , Xiangting Li , Qijing Shen , Tom Chou

We propose a numerical method for solving high dimensional fully nonlinear partial differential equations (PDEs). Our algorithm estimates simultaneously by backward time induction the solution and its gradient by multi-layer neural…

Optimization and Control · Mathematics 2021-01-27 Huyen Pham , Xavier Warin , Maximilien Germain

Recent advances in deep learning have inspired numerous works on data-driven solutions to partial differential equation (PDE) problems. These neural PDE solvers can often be much faster than their numerical counterparts; however, each…

Machine Learning · Computer Science 2025-02-06 Anthony Zhou , Zijie Li , Michael Schneier , John R Buchanan , Amir Barati Farimani

Machine learning for differential equations paves the way for computationally efficient alternatives to numerical solvers, with potentially broad impacts in science and engineering. Though current algorithms typically require simulated…

Machine Learning · Computer Science 2024-02-15 Grégoire Mialon , Quentin Garrido , Hannah Lawrence , Danyal Rehman , Yann LeCun , Bobak T. Kiani